Apr 12 10:31:08 user nova-compute[71557]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 12 10:31:11 user nova-compute[71557]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71557) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71557) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71557) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 10:31:11 user nova-compute[71557]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:31:11 user nova-compute[71557]: INFO nova.virt.driver [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 12 10:31:11 user nova-compute[71557]: INFO nova.compute.provider_config [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] Acquiring lock "singleton_lock" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] Acquired lock "singleton_lock" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] Releasing lock "singleton_lock" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] Full set of CONF: {{(pid=71557) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ******************************************************************************** {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] Configuration options gathered from: {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ================================================================================ {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] allow_resize_to_same_host      = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] arq_binding_timeout            = 300 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] backdoor_port                  = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] backdoor_socket                = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] block_device_allocate_retries  = 300 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] block_device_allocate_retries_interval = 5 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cert                           = self.pem {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] compute_monitors               = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] config_dir                     = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] config_drive_format            = iso9660 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] config_source                  = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] console_host                   = user {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] control_exchange               = nova {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cpu_allocation_ratio           = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] daemon                         = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] debug                          = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] default_access_ip_network_name = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] default_availability_zone      = nova {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] default_ephemeral_format       = ext4 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] default_schedule_zone          = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] disk_allocation_ratio          = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] enable_new_services            = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] enabled_apis                   = ['osapi_compute'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] enabled_ssl_apis               = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] flat_injected                  = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] force_config_drive             = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] force_raw_images               = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] graceful_shutdown_timeout      = 5 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] heal_instance_info_cache_interval = 60 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] host                           = user {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] instance_build_timeout         = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] instance_delete_interval       = 300 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] instance_name_template         = instance-%08x {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] instance_usage_audit           = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] instance_usage_audit_period    = month {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] internal_service_availability_zone = internal {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] key                            = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] live_migration_retry_count     = 30 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] log_config_append              = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] log_dir                        = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] log_file                       = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] log_options                    = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] log_rotate_interval            = 1 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] log_rotate_interval_type       = days {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] log_rotation_type              = none {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] long_rpc_timeout               = 1800 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] max_concurrent_builds          = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] max_concurrent_live_migrations = 1 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] max_concurrent_snapshots       = 5 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] max_local_block_devices        = 3 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] max_logfile_count              = 30 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] max_logfile_size_mb            = 200 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] maximum_instance_delete_attempts = 5 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] metadata_listen                = 0.0.0.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] metadata_listen_port           = 8775 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] metadata_workers               = 3 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] migrate_max_retries            = -1 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] mkisofs_cmd                    = genisoimage {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] my_ip                          = 10.0.0.210 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] network_allocate_retries       = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] osapi_compute_listen_port      = 8774 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] osapi_compute_unique_server_name_scope =  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] osapi_compute_workers          = 3 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] password_length                = 12 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] periodic_enable                = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] periodic_fuzzy_delay           = 60 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] pointer_model                  = ps2mouse {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] preallocate_images             = none {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] publish_errors                 = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] pybasedir                      = /opt/stack/nova {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ram_allocation_ratio           = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] rate_limit_burst               = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] rate_limit_except_level        = CRITICAL {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] rate_limit_interval            = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] reboot_timeout                 = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] reclaim_instance_interval      = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] record                         = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] reimage_timeout_per_gb         = 20 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] report_interval                = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] rescue_timeout                 = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] reserved_host_cpus             = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] reserved_host_disk_mb          = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] reserved_host_memory_mb        = 512 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] reserved_huge_pages            = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] resize_confirm_window          = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] resize_fs_using_block_device   = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] resume_guests_state_on_host_boot = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] rpc_response_timeout           = 60 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] run_external_periodic_tasks    = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] running_deleted_instance_action = reap {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] running_deleted_instance_poll_interval = 1800 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] running_deleted_instance_timeout = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] scheduler_instance_sync_interval = 120 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] service_down_time              = 60 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] servicegroup_driver            = db {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] shelved_offload_time           = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] shelved_poll_interval          = 3600 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] shutdown_timeout               = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] source_is_ipv6                 = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ssl_only                       = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] state_path                     = /opt/stack/data/nova {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] sync_power_state_interval      = 600 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] sync_power_state_pool_size     = 1000 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] syslog_log_facility            = LOG_USER {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] tempdir                        = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] timeout_nbd                    = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] transport_url                  = **** {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] update_resources_interval      = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] use_cow_images                 = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] use_eventlog                   = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] use_journal                    = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] use_json                       = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] use_rootwrap_daemon            = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] use_stderr                     = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] use_syslog                     = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vcpu_pin_set                   = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vif_plugging_is_fatal          = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vif_plugging_timeout           = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] virt_mkfs                      = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] volume_usage_poll_interval     = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] watch_log_file                 = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] web                            = /usr/share/spice-html5 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_concurrency.disable_process_locking = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.auth_strategy              = keystone {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.compute_link_prefix        = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.dhcp_domain                = novalocal {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.enable_instance_password   = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.glance_link_prefix         = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.instance_list_per_project_cells = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.list_records_by_skipping_down_cells = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.local_metadata_per_cell    = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.max_limit                  = 1000 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.metadata_cache_expiration  = 15 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.neutron_default_tenant_id  = default {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.use_forwarded_for          = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.use_neutron_default_nets   = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.vendordata_dynamic_targets = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.vendordata_jsonfile_path   = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.backend                  = dogpile.cache.memcached {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.backend_argument         = **** {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.config_prefix            = cache.oslo {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.dead_timeout             = 60.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.debug_cache_backend      = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.enable_retry_client      = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.enable_socket_keepalive  = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.enabled                  = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.expiration_time          = 600 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.hashclient_retry_attempts = 2 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.memcache_dead_retry      = 300 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.memcache_password        =  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.memcache_sasl_enabled    = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.memcache_username        =  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.proxies                  = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.retry_attempts           = 2 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.retry_delay              = 0.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.socket_keepalive_count   = 1 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.socket_keepalive_idle    = 1 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.socket_keepalive_interval = 1 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.tls_allowed_ciphers      = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.tls_cafile               = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.tls_certfile             = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.tls_enabled              = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cache.tls_keyfile              = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cinder.auth_section            = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cinder.auth_type               = password {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cinder.cafile                  = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cinder.certfile                = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cinder.collect_timing          = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cinder.cross_az_attach         = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cinder.debug                   = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cinder.endpoint_template       = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cinder.http_retries            = 3 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cinder.insecure                = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cinder.keyfile                 = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cinder.os_region_name          = RegionOne {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cinder.split_loggers           = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cinder.timeout                 = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] compute.cpu_dedicated_set      = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] compute.cpu_shared_set         = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] compute.image_type_exclude_list = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] compute.max_concurrent_disk_ops = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] compute.max_disk_devices_to_attach = -1 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] compute.resource_provider_association_refresh = 300 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] compute.shutdown_retry_interval = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] conductor.workers              = 3 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] console.allowed_origins        = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] console.ssl_ciphers            = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] console.ssl_minimum_version    = default {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] consoleauth.token_ttl          = 600 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cyborg.cafile                  = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cyborg.certfile                = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cyborg.collect_timing          = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cyborg.connect_retries         = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cyborg.connect_retry_delay     = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cyborg.endpoint_override       = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cyborg.insecure                = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cyborg.keyfile                 = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cyborg.max_version             = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cyborg.min_version             = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cyborg.region_name             = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cyborg.service_name            = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cyborg.service_type            = accelerator {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cyborg.split_loggers           = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cyborg.status_code_retries     = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cyborg.status_code_retry_delay = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cyborg.timeout                 = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] cyborg.version                 = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] database.backend               = sqlalchemy {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] database.connection            = **** {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] database.connection_debug      = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] database.connection_parameters =  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] database.connection_recycle_time = 3600 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] database.connection_trace      = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] database.db_inc_retry_interval = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] database.db_max_retries        = 20 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] database.db_max_retry_interval = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] database.db_retry_interval     = 1 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] database.max_overflow          = 50 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] database.max_pool_size         = 5 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] database.max_retries           = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] database.mysql_enable_ndb      = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] database.mysql_wsrep_sync_wait = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] database.pool_timeout          = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] database.retry_interval        = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] database.slave_connection      = **** {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] database.sqlite_synchronous    = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api_database.backend           = sqlalchemy {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api_database.connection        = **** {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api_database.connection_debug  = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api_database.connection_parameters =  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api_database.connection_recycle_time = 3600 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api_database.connection_trace  = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api_database.db_inc_retry_interval = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api_database.db_max_retries    = 20 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api_database.db_max_retry_interval = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api_database.db_retry_interval = 1 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api_database.max_overflow      = 50 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api_database.max_pool_size     = 5 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api_database.max_retries       = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api_database.mysql_enable_ndb  = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api_database.pool_timeout      = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api_database.retry_interval    = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api_database.slave_connection  = **** {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] api_database.sqlite_synchronous = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] devices.enabled_mdev_types     = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ephemeral_storage_encryption.enabled = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.api_servers             = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.cafile                  = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.certfile                = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.collect_timing          = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.connect_retries         = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.connect_retry_delay     = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.debug                   = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.default_trusted_certificate_ids = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.enable_certificate_validation = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.enable_rbd_download     = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.endpoint_override       = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.insecure                = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.keyfile                 = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.max_version             = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.min_version             = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.num_retries             = 3 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.rbd_ceph_conf           =  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.rbd_connect_timeout     = 5 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.rbd_pool                =  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.rbd_user                =  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.region_name             = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.service_name            = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.service_type            = image {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.split_loggers           = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.status_code_retries     = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.status_code_retry_delay = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.timeout                 = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.verify_glance_signatures = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] glance.version                 = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] guestfs.debug                  = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] hyperv.config_drive_cdrom      = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] hyperv.config_drive_inject_password = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] hyperv.enable_instance_metrics_collection = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] hyperv.enable_remotefx         = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] hyperv.instances_path_share    =  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] hyperv.iscsi_initiator_list    = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] hyperv.limit_cpu_features      = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] hyperv.power_state_check_timeframe = 60 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] hyperv.use_multipath_io        = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] hyperv.volume_attach_retry_count = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] hyperv.vswitch_name            = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] mks.enabled                    = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] image_cache.manager_interval   = 2400 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] image_cache.precache_concurrency = 1 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] image_cache.remove_unused_base_images = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] image_cache.subdirectory_name  = _base {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.api_max_retries         = 60 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.api_retry_interval      = 2 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.auth_section            = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.auth_type               = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.cafile                  = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.certfile                = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.collect_timing          = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.connect_retries         = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.connect_retry_delay     = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.endpoint_override       = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.insecure                = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.keyfile                 = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.max_version             = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.min_version             = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.partition_key           = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.peer_list               = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.region_name             = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.serial_console_state_timeout = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.service_name            = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.service_type            = baremetal {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.split_loggers           = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.status_code_retries     = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.status_code_retry_delay = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.timeout                 = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ironic.version                 = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] key_manager.fixed_key          = **** {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican.barbican_api_version  = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican.barbican_endpoint     = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican.barbican_endpoint_type = public {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican.barbican_region_name  = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican.cafile                = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican.certfile              = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican.collect_timing        = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican.insecure              = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican.keyfile               = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican.number_of_retries     = 60 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican.retry_delay           = 1 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican.send_service_user_token = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican.split_loggers         = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican.timeout               = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican.verify_ssl            = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican.verify_ssl_path       = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican_service_user.auth_section = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican_service_user.auth_type = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican_service_user.cafile   = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican_service_user.certfile = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican_service_user.collect_timing = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican_service_user.insecure = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican_service_user.keyfile  = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican_service_user.split_loggers = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] barbican_service_user.timeout  = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vault.approle_role_id          = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vault.approle_secret_id        = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vault.cafile                   = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vault.certfile                 = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vault.collect_timing           = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vault.insecure                 = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vault.keyfile                  = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vault.kv_mountpoint            = secret {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vault.kv_version               = 2 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vault.namespace                = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vault.root_token_id            = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vault.split_loggers            = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vault.ssl_ca_crt_file          = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vault.timeout                  = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vault.use_ssl                  = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] keystone.cafile                = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] keystone.certfile              = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] keystone.collect_timing        = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] keystone.connect_retries       = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] keystone.connect_retry_delay   = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] keystone.endpoint_override     = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] keystone.insecure              = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] keystone.keyfile               = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] keystone.max_version           = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] keystone.min_version           = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] keystone.region_name           = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] keystone.service_name          = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] keystone.service_type          = identity {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] keystone.split_loggers         = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] keystone.status_code_retries   = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] keystone.status_code_retry_delay = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] keystone.timeout               = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] keystone.version               = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.connection_uri         =  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.cpu_mode               = custom {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: WARNING oslo_config.cfg [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.cpu_power_governor_high = performance {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.cpu_power_governor_low = powersave {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.cpu_power_management   = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.device_detach_attempts = 8 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.device_detach_timeout  = 20 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.disk_cachemodes        = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.disk_prefix            = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.enabled_perf_events    = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.file_backed_memory     = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.gid_maps               = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.hw_disk_discard        = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.hw_machine_type        = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.images_rbd_glance_store_name =  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.images_rbd_pool        = rbd {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.images_type            = default {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.images_volume_group    = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.inject_key             = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.inject_partition       = -2 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.inject_password        = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.iscsi_iface            = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.iser_use_multipath     = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.live_migration_bandwidth = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.live_migration_downtime = 500 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.live_migration_inbound_addr = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.live_migration_permit_post_copy = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.live_migration_scheme  = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.live_migration_timeout_action = abort {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.live_migration_tunnelled = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: WARNING oslo_config.cfg [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 12 10:31:11 user nova-compute[71557]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 12 10:31:11 user nova-compute[71557]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 12 10:31:11 user nova-compute[71557]: and ``live_migration_inbound_addr`` respectively.
Apr 12 10:31:11 user nova-compute[71557]: ).  Its value may be silently ignored in the future.
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.live_migration_with_native_tls = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.max_queues             = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.nfs_mount_options      = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.num_memory_encrypted_guests = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.num_pcie_ports         = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.pmem_namespaces        = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.quobyte_client_cfg     = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.rbd_secret_uuid        = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.rbd_user               = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.remote_filesystem_transport = ssh {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.rescue_image_id        = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.rescue_kernel_id       = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.rescue_ramdisk_id      = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.rx_queue_size          = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.smbfs_mount_options    =  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.snapshot_compression   = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.snapshot_image_format  = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.sparse_logical_volumes = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.swtpm_enabled          = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.swtpm_group            = tss {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.swtpm_user             = tss {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.sysinfo_serial         = unique {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.tx_queue_size          = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.uid_maps               = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.use_virtio_for_bridges = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.virt_type              = kvm {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.volume_clear           = zero {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.volume_clear_size      = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.volume_use_multipath   = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.vzstorage_cache_path   = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.vzstorage_mount_user   = stack {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.auth_section           = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.auth_type              = password {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.cafile                 = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.certfile               = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.collect_timing         = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.connect_retries        = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.connect_retry_delay    = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.default_floating_pool  = public {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.endpoint_override      = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.extension_sync_interval = 600 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.http_retries           = 3 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.insecure               = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.keyfile                = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.max_version            = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.min_version            = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.ovs_bridge             = br-int {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.physnets               = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.region_name            = RegionOne {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.service_metadata_proxy = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.service_name           = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.service_type           = network {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.split_loggers          = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.status_code_retries    = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.status_code_retry_delay = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.timeout                = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] neutron.version                = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] notifications.bdms_in_notifications = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] notifications.default_level    = INFO {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] notifications.notification_format = unversioned {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] notifications.notify_on_state_change = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] pci.alias                      = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] pci.device_spec                = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] pci.report_in_placement        = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.auth_section         = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.auth_type            = password {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.cafile               = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.certfile             = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.collect_timing       = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.connect_retries      = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.connect_retry_delay  = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.default_domain_id    = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.default_domain_name  = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.domain_id            = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.domain_name          = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.endpoint_override    = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.insecure             = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.keyfile              = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.max_version          = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.min_version          = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.password             = **** {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.project_domain_id    = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.project_domain_name  = Default {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.project_id           = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.project_name         = service {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.region_name          = RegionOne {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.service_name         = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.service_type         = placement {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.split_loggers        = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.status_code_retries  = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.status_code_retry_delay = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.system_scope         = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.timeout              = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.trust_id             = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.user_domain_id       = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.user_domain_name     = Default {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.user_id              = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.username             = placement {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] placement.version              = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] quota.cores                    = 20 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] quota.count_usage_from_placement = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] quota.injected_file_content_bytes = 10240 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] quota.injected_file_path_length = 255 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] quota.injected_files           = 5 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] quota.instances                = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] quota.key_pairs                = 100 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] quota.metadata_items           = 128 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] quota.ram                      = 51200 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] quota.recheck_quota            = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] quota.server_group_members     = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] quota.server_groups            = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] rdp.enabled                    = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] scheduler.image_metadata_prefilter = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] scheduler.max_attempts         = 3 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] scheduler.max_placement_results = 1000 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] scheduler.query_placement_for_availability_zone = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] scheduler.query_placement_for_image_type_support = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] scheduler.workers              = 3 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.host_subset_size = 1 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.isolated_hosts = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.isolated_images = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.pci_in_placement = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.track_instance_changes = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] metrics.required               = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] metrics.weight_multiplier      = 1.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] metrics.weight_setting         = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] serial_console.enabled         = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] serial_console.port_range      = 10000:20000 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] serial_console.serialproxy_port = 6083 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] service_user.auth_section      = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] service_user.auth_type         = password {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] service_user.cafile            = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] service_user.certfile          = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] service_user.collect_timing    = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] service_user.insecure          = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] service_user.keyfile           = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] service_user.send_service_user_token = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] service_user.split_loggers     = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] service_user.timeout           = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] spice.agent_enabled            = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] spice.enabled                  = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] spice.html5proxy_port          = 6082 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] spice.image_compression        = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] spice.jpeg_compression         = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] spice.playback_compression     = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] spice.server_listen            = 127.0.0.1 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] spice.streaming_mode           = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] spice.zlib_compression         = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] upgrade_levels.baseapi         = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] upgrade_levels.cert            = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] upgrade_levels.compute         = auto {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] upgrade_levels.conductor       = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] upgrade_levels.scheduler       = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vendordata_dynamic_auth.auth_section = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vendordata_dynamic_auth.auth_type = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vendordata_dynamic_auth.cafile = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vendordata_dynamic_auth.certfile = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vendordata_dynamic_auth.insecure = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vendordata_dynamic_auth.keyfile = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vendordata_dynamic_auth.timeout = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.api_retry_count         = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.ca_file                 = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.cache_prefix            = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.cluster_name            = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.connection_pool_size    = 10 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.console_delay_seconds   = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.datastore_regex         = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.host_ip                 = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.host_password           = **** {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.host_port               = 443 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.host_username           = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.insecure                = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.integration_bridge      = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.maximum_objects         = 100 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.pbm_default_policy      = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.pbm_enabled             = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.pbm_wsdl_location       = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.serial_port_proxy_uri   = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.serial_port_service_uri = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.task_poll_interval      = 0.5 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.use_linked_clone        = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.vnc_keymap              = en-us {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.vnc_port                = 5900 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vmware.vnc_port_total          = 10000 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vnc.auth_schemes               = ['none'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vnc.enabled                    = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vnc.novncproxy_port            = 6080 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vnc.server_listen              = 0.0.0.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vnc.vencrypt_ca_certs          = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vnc.vencrypt_client_cert       = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vnc.vencrypt_client_key        = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] workarounds.disable_rootwrap   = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] workarounds.enable_numa_live_migration = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] workarounds.libvirt_disable_apic = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] wsgi.client_socket_timeout     = 900 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] wsgi.default_pool_size         = 1000 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] wsgi.keep_alive                = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] wsgi.max_header_line           = 16384 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] wsgi.ssl_ca_file               = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] wsgi.ssl_cert_file             = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] wsgi.ssl_key_file              = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] wsgi.tcp_keepidle              = 600 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] zvm.ca_file                    = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] zvm.cloud_connector_url        = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] zvm.reachable_timeout          = 300 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_policy.enforce_new_defaults = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_policy.enforce_scope      = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_policy.policy_default_rule = default {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] profiler.connection_string     = messaging:// {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] profiler.enabled               = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] profiler.es_doc_type           = notification {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] profiler.es_scroll_size        = 10000 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] profiler.es_scroll_time        = 2m {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] profiler.filter_error_trace    = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] profiler.sentinel_service_name = mymaster {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] profiler.socket_timeout        = 0.1 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] profiler.trace_sqlalchemy      = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] remote_debug.host              = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] remote_debug.port              = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_notifications.retry = -1 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_limit.auth_section        = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_limit.auth_type           = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_limit.cafile              = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_limit.certfile            = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_limit.collect_timing      = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_limit.connect_retries     = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_limit.connect_retry_delay = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_limit.endpoint_id         = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_limit.endpoint_override   = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_limit.insecure            = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_limit.keyfile             = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_limit.max_version         = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_limit.min_version         = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_limit.region_name         = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_limit.service_name        = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_limit.service_type        = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_limit.split_loggers       = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_limit.status_code_retries = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_limit.status_code_retry_delay = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_limit.timeout             = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_limit.valid_interfaces    = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_limit.version             = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_reports.file_event_handler = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] oslo_reports.log_dir           = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vif_plug_ovs_privileged.group  = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] vif_plug_ovs_privileged.user   = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] os_vif_linux_bridge.flat_interface = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] os_vif_ovs.isolate_vif         = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] os_vif_ovs.per_port_bridge     = False {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] os_brick.lock_path             = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] privsep_osbrick.capabilities   = [21] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] privsep_osbrick.group          = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] privsep_osbrick.helper_command = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] privsep_osbrick.user           = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] nova_sys_admin.group           = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] nova_sys_admin.helper_command  = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] nova_sys_admin.user            = None {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG oslo_service.service [None req-9f4a1d2a-4cb4-4df1-9faf-a68d5d370c30 None None] ******************************************************************************** {{(pid=71557) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 12 10:31:11 user nova-compute[71557]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 12 10:31:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Starting native event thread {{(pid=71557) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Starting green dispatch thread {{(pid=71557) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Starting connection event dispatch thread {{(pid=71557) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Connecting to libvirt: qemu:///system {{(pid=71557) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f4fdd1c6620> {{(pid=71557) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 12 10:31:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f4fdd1c6620> {{(pid=71557) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 12 10:31:11 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Connection event '1' reason 'None'
Apr 12 10:31:11 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 12 10:31:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.mount [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Initialising _HostMountState generation 0 {{(pid=71557) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 12 10:31:19 user nova-compute[71557]: INFO nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Libvirt host capabilities <capabilities>
Apr 12 10:31:19 user nova-compute[71557]:   <host>
Apr 12 10:31:19 user nova-compute[71557]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 12 10:31:19 user nova-compute[71557]:     <cpu>
Apr 12 10:31:19 user nova-compute[71557]:       <arch>x86_64</arch>
Apr 12 10:31:19 user nova-compute[71557]:       <model>IvyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <vendor>Intel</vendor>
Apr 12 10:31:19 user nova-compute[71557]:       <microcode version='1070'/>
Apr 12 10:31:19 user nova-compute[71557]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 12 10:31:19 user nova-compute[71557]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature name='ss'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature name='vmx'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature name='pcid'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature name='osxsave'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature name='hypervisor'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature name='arat'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature name='tsc_adjust'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature name='md-clear'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature name='stibp'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature name='arch-capabilities'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature name='ssbd'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature name='invtsc'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature name='rsba'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature name='skip-l1dfl-vmentry'/>
Apr 12 10:31:19 user nova-compute[71557]:       <pages unit='KiB' size='4'/>
Apr 12 10:31:19 user nova-compute[71557]:       <pages unit='KiB' size='2048'/>
Apr 12 10:31:19 user nova-compute[71557]:     </cpu>
Apr 12 10:31:19 user nova-compute[71557]:     <power_management>
Apr 12 10:31:19 user nova-compute[71557]:       <suspend_mem/>
Apr 12 10:31:19 user nova-compute[71557]:       <suspend_disk/>
Apr 12 10:31:19 user nova-compute[71557]:       <suspend_hybrid/>
Apr 12 10:31:19 user nova-compute[71557]:     </power_management>
Apr 12 10:31:19 user nova-compute[71557]:     <iommu support='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     <migration_features>
Apr 12 10:31:19 user nova-compute[71557]:       <live/>
Apr 12 10:31:19 user nova-compute[71557]:       <uri_transports>
Apr 12 10:31:19 user nova-compute[71557]:         <uri_transport>tcp</uri_transport>
Apr 12 10:31:19 user nova-compute[71557]:         <uri_transport>rdma</uri_transport>
Apr 12 10:31:19 user nova-compute[71557]:       </uri_transports>
Apr 12 10:31:19 user nova-compute[71557]:     </migration_features>
Apr 12 10:31:19 user nova-compute[71557]:     <topology>
Apr 12 10:31:19 user nova-compute[71557]:       <cells num='2'>
Apr 12 10:31:19 user nova-compute[71557]:         <cell id='0'>
Apr 12 10:31:19 user nova-compute[71557]:           <memory unit='KiB'>8189224</memory>
Apr 12 10:31:19 user nova-compute[71557]:           <pages unit='KiB' size='4'>2047306</pages>
Apr 12 10:31:19 user nova-compute[71557]:           <pages unit='KiB' size='2048'>0</pages>
Apr 12 10:31:19 user nova-compute[71557]:           <distances>
Apr 12 10:31:19 user nova-compute[71557]:             <sibling id='0' value='10'/>
Apr 12 10:31:19 user nova-compute[71557]:             <sibling id='1' value='20'/>
Apr 12 10:31:19 user nova-compute[71557]:           </distances>
Apr 12 10:31:19 user nova-compute[71557]:           <cpus num='6'>
Apr 12 10:31:19 user nova-compute[71557]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 12 10:31:19 user nova-compute[71557]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 12 10:31:19 user nova-compute[71557]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 12 10:31:19 user nova-compute[71557]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 12 10:31:19 user nova-compute[71557]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 12 10:31:19 user nova-compute[71557]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 12 10:31:19 user nova-compute[71557]:           </cpus>
Apr 12 10:31:19 user nova-compute[71557]:         </cell>
Apr 12 10:31:19 user nova-compute[71557]:         <cell id='1'>
Apr 12 10:31:19 user nova-compute[71557]:           <memory unit='KiB'>8218764</memory>
Apr 12 10:31:19 user nova-compute[71557]:           <pages unit='KiB' size='4'>2054691</pages>
Apr 12 10:31:19 user nova-compute[71557]:           <pages unit='KiB' size='2048'>0</pages>
Apr 12 10:31:19 user nova-compute[71557]:           <distances>
Apr 12 10:31:19 user nova-compute[71557]:             <sibling id='0' value='20'/>
Apr 12 10:31:19 user nova-compute[71557]:             <sibling id='1' value='10'/>
Apr 12 10:31:19 user nova-compute[71557]:           </distances>
Apr 12 10:31:19 user nova-compute[71557]:           <cpus num='6'>
Apr 12 10:31:19 user nova-compute[71557]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 12 10:31:19 user nova-compute[71557]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 12 10:31:19 user nova-compute[71557]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 12 10:31:19 user nova-compute[71557]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 12 10:31:19 user nova-compute[71557]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 12 10:31:19 user nova-compute[71557]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 12 10:31:19 user nova-compute[71557]:           </cpus>
Apr 12 10:31:19 user nova-compute[71557]:         </cell>
Apr 12 10:31:19 user nova-compute[71557]:       </cells>
Apr 12 10:31:19 user nova-compute[71557]:     </topology>
Apr 12 10:31:19 user nova-compute[71557]:     <cache>
Apr 12 10:31:19 user nova-compute[71557]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 12 10:31:19 user nova-compute[71557]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 12 10:31:19 user nova-compute[71557]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 12 10:31:19 user nova-compute[71557]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 12 10:31:19 user nova-compute[71557]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 12 10:31:19 user nova-compute[71557]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 12 10:31:19 user nova-compute[71557]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 12 10:31:19 user nova-compute[71557]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 12 10:31:19 user nova-compute[71557]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 12 10:31:19 user nova-compute[71557]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 12 10:31:19 user nova-compute[71557]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 12 10:31:19 user nova-compute[71557]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 12 10:31:19 user nova-compute[71557]:     </cache>
Apr 12 10:31:19 user nova-compute[71557]:     <secmodel>
Apr 12 10:31:19 user nova-compute[71557]:       <model>apparmor</model>
Apr 12 10:31:19 user nova-compute[71557]:       <doi>0</doi>
Apr 12 10:31:19 user nova-compute[71557]:     </secmodel>
Apr 12 10:31:19 user nova-compute[71557]:     <secmodel>
Apr 12 10:31:19 user nova-compute[71557]:       <model>dac</model>
Apr 12 10:31:19 user nova-compute[71557]:       <doi>0</doi>
Apr 12 10:31:19 user nova-compute[71557]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 12 10:31:19 user nova-compute[71557]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 12 10:31:19 user nova-compute[71557]:     </secmodel>
Apr 12 10:31:19 user nova-compute[71557]:   </host>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='alpha'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>64</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>clipper</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='armv6l'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>32</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>spitz</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>nuri</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>kzm</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>sx1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>z2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>tosa</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>n810</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>n800</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>terrier</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>midway</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>microbit</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>verdex</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>highbank</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>akita</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>connex</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>collie</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='armv7l'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>32</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>spitz</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>nuri</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>kzm</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>sx1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>z2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>tosa</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>n810</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>n800</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>terrier</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>midway</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>microbit</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>verdex</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>highbank</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>akita</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>connex</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>collie</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='aarch64'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>64</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>spitz</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>nuri</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>kzm</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>sx1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>z2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>tosa</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>n810</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>n800</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>terrier</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>midway</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>microbit</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>verdex</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>raspi3b</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>highbank</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>akita</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>connex</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>collie</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <acpi default='on' toggle='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='cris'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>32</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='i686'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>32</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>x-remote</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>isapc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>microvm</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='kvm'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <pae/>
Apr 12 10:31:19 user nova-compute[71557]:       <nonpae/>
Apr 12 10:31:19 user nova-compute[71557]:       <acpi default='on' toggle='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:       <apic default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='m68k'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>32</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>an5206</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>q800</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>next-cube</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='microblaze'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>32</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='microblazeel'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>32</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='mips'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>32</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='16'>malta</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='mipsel'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>32</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='16'>malta</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='mips64'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>64</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='16'>malta</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>pica61</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>magnum</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='mips64el'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>64</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='16'>malta</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>pica61</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>magnum</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='16'>boston</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='ppc'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>32</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mac99</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>40p</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>taihu</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='ppc64'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>64</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2048'>powernv9</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>taihu</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2048'>powernv10</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>40p</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mac99</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2048'>powernv8</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='ppc64le'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>64</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2048'>powernv9</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>taihu</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2048'>powernv10</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>40p</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>mac99</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2048'>powernv8</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='riscv32'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>32</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='8'>spike</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>opentitan</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='5'>sifive_u</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>sifive_e</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='8'>virt</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='riscv64'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>64</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='8'>spike</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='5'>sifive_u</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>shakti_c</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>sifive_e</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='8'>virt</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='s390x'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>64</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='sh4'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>32</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>shix</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>r2d</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='sh4eb'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>64</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>shix</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>r2d</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='sparc'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>32</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>SS-5</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>SS-20</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>LX</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>SS-4</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>SS-10</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>Voyager</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='sparc64'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>64</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>sun4u</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>niagara</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>sun4v</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='x86_64'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>64</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>x-remote</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='1'>isapc</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>microvm</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='kvm'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <acpi default='on' toggle='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:       <apic default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='xtensa'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>32</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>sim</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='32'>kc705</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='32'>ml605</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='32'>virt</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='32'>lx200</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='32'>lx60</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]:   <guest>
Apr 12 10:31:19 user nova-compute[71557]:     <os_type>hvm</os_type>
Apr 12 10:31:19 user nova-compute[71557]:     <arch name='xtensaeb'>
Apr 12 10:31:19 user nova-compute[71557]:       <wordsize>32</wordsize>
Apr 12 10:31:19 user nova-compute[71557]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='4'>sim</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='32'>kc705</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='32'>ml605</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='32'>virt</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='32'>lx200</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='32'>lx60</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 12 10:31:19 user nova-compute[71557]:       <domain type='qemu'/>
Apr 12 10:31:19 user nova-compute[71557]:     </arch>
Apr 12 10:31:19 user nova-compute[71557]:     <features>
Apr 12 10:31:19 user nova-compute[71557]:       <cpuselection/>
Apr 12 10:31:19 user nova-compute[71557]:       <deviceboot/>
Apr 12 10:31:19 user nova-compute[71557]:       <disksnapshot default='on' toggle='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     </features>
Apr 12 10:31:19 user nova-compute[71557]:   </guest>
Apr 12 10:31:19 user nova-compute[71557]: </capabilities>
Apr 12 10:31:19 user nova-compute[71557]: 
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 12 10:31:19 user nova-compute[71557]: <domainCapabilities>
Apr 12 10:31:19 user nova-compute[71557]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 10:31:19 user nova-compute[71557]:   <domain>kvm</domain>
Apr 12 10:31:19 user nova-compute[71557]:   <machine>pc-i440fx-6.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:   <arch>i686</arch>
Apr 12 10:31:19 user nova-compute[71557]:   <vcpu max='255'/>
Apr 12 10:31:19 user nova-compute[71557]:   <iothreads supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:   <os supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:     <enum name='firmware'/>
Apr 12 10:31:19 user nova-compute[71557]:     <loader supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='type'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>rom</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>pflash</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='readonly'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>yes</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>no</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='secure'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>no</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </loader>
Apr 12 10:31:19 user nova-compute[71557]:   </os>
Apr 12 10:31:19 user nova-compute[71557]:   <cpu>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='host-passthrough' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='hostPassthroughMigratable'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>off</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='maximum' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='maximumMigratable'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>on</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>off</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='host-model' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <vendor>Intel</vendor>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ss'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='vmx'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='pcid'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='hypervisor'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='arat'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='umip'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='md-clear'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='stibp'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ssbd'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ibpb'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ibrs'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='amd-stibp'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='disable' name='erms'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='disable' name='lm'/>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='custom' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>qemu64</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>qemu32</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>phenom</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium3</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium2</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>n270</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>kvm64</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>kvm32</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>coreduo</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>core2duo</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>athlon</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Westmere</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Snowridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>SandyBridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Penryn</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G5</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G4</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G3</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G2</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G1</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Nehalem</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>IvyBridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Icelake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-Rome</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-Milan</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Dhyana</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cooperlake</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Conroe</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>486</model>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:   </cpu>
Apr 12 10:31:19 user nova-compute[71557]:   <memoryBacking supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:     <enum name='sourceType'>
Apr 12 10:31:19 user nova-compute[71557]:       <value>file</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>anonymous</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>memfd</value>
Apr 12 10:31:19 user nova-compute[71557]:     </enum>
Apr 12 10:31:19 user nova-compute[71557]:   </memoryBacking>
Apr 12 10:31:19 user nova-compute[71557]:   <devices>
Apr 12 10:31:19 user nova-compute[71557]:     <disk supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='diskDevice'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>disk</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>cdrom</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>floppy</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>lun</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='bus'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>ide</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>fdc</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>scsi</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>usb</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>sata</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-non-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </disk>
Apr 12 10:31:19 user nova-compute[71557]:     <graphics supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='type'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>sdl</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vnc</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>spice</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>egl-headless</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </graphics>
Apr 12 10:31:19 user nova-compute[71557]:     <video supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='modelType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vga</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>cirrus</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vmvga</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>qxl</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>none</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>bochs</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>ramfb</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </video>
Apr 12 10:31:19 user nova-compute[71557]:     <hostdev supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='mode'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>subsystem</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='startupPolicy'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>default</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>mandatory</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>requisite</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>optional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='subsysType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>usb</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>pci</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>scsi</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='capsType'/>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='pciBackend'/>
Apr 12 10:31:19 user nova-compute[71557]:     </hostdev>
Apr 12 10:31:19 user nova-compute[71557]:     <rng supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-non-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='backendModel'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>random</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>egd</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>builtin</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </rng>
Apr 12 10:31:19 user nova-compute[71557]:     <filesystem supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='driverType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>path</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>handle</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtiofs</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </filesystem>
Apr 12 10:31:19 user nova-compute[71557]:     <tpm supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>tpm-tis</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>tpm-crb</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='backendModel'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>passthrough</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>emulator</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </tpm>
Apr 12 10:31:19 user nova-compute[71557]:   </devices>
Apr 12 10:31:19 user nova-compute[71557]:   <features>
Apr 12 10:31:19 user nova-compute[71557]:     <gic supported='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     <vmcoreinfo supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <genid supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <backingStoreInput supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <backup supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <sev supported='no'/>
Apr 12 10:31:19 user nova-compute[71557]:   </features>
Apr 12 10:31:19 user nova-compute[71557]: </domainCapabilities>
Apr 12 10:31:19 user nova-compute[71557]:  {{(pid=71557) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 12 10:31:19 user nova-compute[71557]: <domainCapabilities>
Apr 12 10:31:19 user nova-compute[71557]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 10:31:19 user nova-compute[71557]:   <domain>kvm</domain>
Apr 12 10:31:19 user nova-compute[71557]:   <machine>pc-q35-6.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:   <arch>i686</arch>
Apr 12 10:31:19 user nova-compute[71557]:   <vcpu max='288'/>
Apr 12 10:31:19 user nova-compute[71557]:   <iothreads supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:   <os supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:     <enum name='firmware'/>
Apr 12 10:31:19 user nova-compute[71557]:     <loader supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='type'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>rom</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>pflash</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='readonly'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>yes</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>no</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='secure'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>no</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </loader>
Apr 12 10:31:19 user nova-compute[71557]:   </os>
Apr 12 10:31:19 user nova-compute[71557]:   <cpu>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='host-passthrough' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='hostPassthroughMigratable'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>off</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='maximum' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='maximumMigratable'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>on</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>off</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='host-model' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <vendor>Intel</vendor>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ss'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='vmx'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='pcid'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='hypervisor'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='arat'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='umip'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='md-clear'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='stibp'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ssbd'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ibpb'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ibrs'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='amd-stibp'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='disable' name='erms'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='disable' name='lm'/>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='custom' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>qemu64</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>qemu32</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>phenom</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium3</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium2</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>n270</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>kvm64</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>kvm32</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>coreduo</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>core2duo</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>athlon</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Westmere</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Snowridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>SandyBridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Penryn</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G5</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G4</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G3</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G2</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G1</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Nehalem</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>IvyBridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Icelake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-Rome</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-Milan</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Dhyana</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cooperlake</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Conroe</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>486</model>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:   </cpu>
Apr 12 10:31:19 user nova-compute[71557]:   <memoryBacking supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:     <enum name='sourceType'>
Apr 12 10:31:19 user nova-compute[71557]:       <value>file</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>anonymous</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>memfd</value>
Apr 12 10:31:19 user nova-compute[71557]:     </enum>
Apr 12 10:31:19 user nova-compute[71557]:   </memoryBacking>
Apr 12 10:31:19 user nova-compute[71557]:   <devices>
Apr 12 10:31:19 user nova-compute[71557]:     <disk supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='diskDevice'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>disk</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>cdrom</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>floppy</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>lun</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='bus'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>fdc</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>scsi</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>usb</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>sata</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-non-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </disk>
Apr 12 10:31:19 user nova-compute[71557]:     <graphics supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='type'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>sdl</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vnc</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>spice</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>egl-headless</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </graphics>
Apr 12 10:31:19 user nova-compute[71557]:     <video supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='modelType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vga</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>cirrus</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vmvga</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>qxl</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>none</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>bochs</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>ramfb</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </video>
Apr 12 10:31:19 user nova-compute[71557]:     <hostdev supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='mode'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>subsystem</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='startupPolicy'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>default</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>mandatory</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>requisite</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>optional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='subsysType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>usb</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>pci</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>scsi</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='capsType'/>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='pciBackend'/>
Apr 12 10:31:19 user nova-compute[71557]:     </hostdev>
Apr 12 10:31:19 user nova-compute[71557]:     <rng supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-non-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='backendModel'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>random</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>egd</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>builtin</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </rng>
Apr 12 10:31:19 user nova-compute[71557]:     <filesystem supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='driverType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>path</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>handle</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtiofs</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </filesystem>
Apr 12 10:31:19 user nova-compute[71557]:     <tpm supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>tpm-tis</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>tpm-crb</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='backendModel'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>passthrough</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>emulator</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </tpm>
Apr 12 10:31:19 user nova-compute[71557]:   </devices>
Apr 12 10:31:19 user nova-compute[71557]:   <features>
Apr 12 10:31:19 user nova-compute[71557]:     <gic supported='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     <vmcoreinfo supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <genid supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <backingStoreInput supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <backup supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <sev supported='no'/>
Apr 12 10:31:19 user nova-compute[71557]:   </features>
Apr 12 10:31:19 user nova-compute[71557]: </domainCapabilities>
Apr 12 10:31:19 user nova-compute[71557]:  {{(pid=71557) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 12 10:31:19 user nova-compute[71557]: <domainCapabilities>
Apr 12 10:31:19 user nova-compute[71557]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 10:31:19 user nova-compute[71557]:   <domain>kvm</domain>
Apr 12 10:31:19 user nova-compute[71557]:   <machine>pc-i440fx-jammy</machine>
Apr 12 10:31:19 user nova-compute[71557]:   <arch>i686</arch>
Apr 12 10:31:19 user nova-compute[71557]:   <vcpu max='255'/>
Apr 12 10:31:19 user nova-compute[71557]:   <iothreads supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:   <os supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:     <enum name='firmware'/>
Apr 12 10:31:19 user nova-compute[71557]:     <loader supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='type'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>rom</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>pflash</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='readonly'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>yes</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>no</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='secure'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>no</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </loader>
Apr 12 10:31:19 user nova-compute[71557]:   </os>
Apr 12 10:31:19 user nova-compute[71557]:   <cpu>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='host-passthrough' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='hostPassthroughMigratable'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>off</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='maximum' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='maximumMigratable'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>on</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>off</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='host-model' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <vendor>Intel</vendor>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ss'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='vmx'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='pcid'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='hypervisor'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='arat'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='umip'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='md-clear'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='stibp'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ssbd'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ibpb'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ibrs'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='amd-stibp'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='disable' name='erms'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='disable' name='lm'/>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='custom' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>qemu64</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>qemu32</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>phenom</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium3</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium2</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>n270</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>kvm64</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>kvm32</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>coreduo</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>core2duo</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>athlon</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Westmere</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Snowridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>SandyBridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Penryn</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G5</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G4</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G3</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G2</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G1</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Nehalem</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>IvyBridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Icelake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-Rome</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-Milan</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Dhyana</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cooperlake</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Conroe</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>486</model>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:   </cpu>
Apr 12 10:31:19 user nova-compute[71557]:   <memoryBacking supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:     <enum name='sourceType'>
Apr 12 10:31:19 user nova-compute[71557]:       <value>file</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>anonymous</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>memfd</value>
Apr 12 10:31:19 user nova-compute[71557]:     </enum>
Apr 12 10:31:19 user nova-compute[71557]:   </memoryBacking>
Apr 12 10:31:19 user nova-compute[71557]:   <devices>
Apr 12 10:31:19 user nova-compute[71557]:     <disk supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='diskDevice'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>disk</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>cdrom</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>floppy</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>lun</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='bus'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>ide</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>fdc</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>scsi</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>usb</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>sata</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-non-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </disk>
Apr 12 10:31:19 user nova-compute[71557]:     <graphics supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='type'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>sdl</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vnc</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>spice</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>egl-headless</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </graphics>
Apr 12 10:31:19 user nova-compute[71557]:     <video supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='modelType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vga</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>cirrus</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vmvga</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>qxl</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>none</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>bochs</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>ramfb</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </video>
Apr 12 10:31:19 user nova-compute[71557]:     <hostdev supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='mode'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>subsystem</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='startupPolicy'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>default</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>mandatory</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>requisite</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>optional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='subsysType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>usb</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>pci</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>scsi</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='capsType'/>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='pciBackend'/>
Apr 12 10:31:19 user nova-compute[71557]:     </hostdev>
Apr 12 10:31:19 user nova-compute[71557]:     <rng supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-non-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='backendModel'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>random</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>egd</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>builtin</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </rng>
Apr 12 10:31:19 user nova-compute[71557]:     <filesystem supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='driverType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>path</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>handle</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtiofs</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </filesystem>
Apr 12 10:31:19 user nova-compute[71557]:     <tpm supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>tpm-tis</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>tpm-crb</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='backendModel'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>passthrough</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>emulator</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </tpm>
Apr 12 10:31:19 user nova-compute[71557]:   </devices>
Apr 12 10:31:19 user nova-compute[71557]:   <features>
Apr 12 10:31:19 user nova-compute[71557]:     <gic supported='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     <vmcoreinfo supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <genid supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <backingStoreInput supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <backup supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <sev supported='no'/>
Apr 12 10:31:19 user nova-compute[71557]:   </features>
Apr 12 10:31:19 user nova-compute[71557]: </domainCapabilities>
Apr 12 10:31:19 user nova-compute[71557]:  {{(pid=71557) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 12 10:31:19 user nova-compute[71557]: <domainCapabilities>
Apr 12 10:31:19 user nova-compute[71557]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 10:31:19 user nova-compute[71557]:   <domain>kvm</domain>
Apr 12 10:31:19 user nova-compute[71557]:   <machine>pc-q35-jammy</machine>
Apr 12 10:31:19 user nova-compute[71557]:   <arch>i686</arch>
Apr 12 10:31:19 user nova-compute[71557]:   <vcpu max='288'/>
Apr 12 10:31:19 user nova-compute[71557]:   <iothreads supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:   <os supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:     <enum name='firmware'/>
Apr 12 10:31:19 user nova-compute[71557]:     <loader supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='type'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>rom</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>pflash</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='readonly'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>yes</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>no</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='secure'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>no</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </loader>
Apr 12 10:31:19 user nova-compute[71557]:   </os>
Apr 12 10:31:19 user nova-compute[71557]:   <cpu>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='host-passthrough' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='hostPassthroughMigratable'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>off</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='maximum' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='maximumMigratable'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>on</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>off</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='host-model' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <vendor>Intel</vendor>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ss'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='vmx'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='pcid'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='hypervisor'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='arat'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='umip'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='md-clear'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='stibp'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ssbd'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ibpb'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ibrs'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='amd-stibp'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='disable' name='erms'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='disable' name='lm'/>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='custom' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>qemu64</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>qemu32</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>phenom</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium3</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium2</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>n270</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>kvm64</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>kvm32</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>coreduo</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>core2duo</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>athlon</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Westmere</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Snowridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>SandyBridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Penryn</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G5</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G4</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G3</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G2</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G1</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Nehalem</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>IvyBridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Icelake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-Rome</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-Milan</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Dhyana</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cooperlake</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Conroe</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>486</model>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:   </cpu>
Apr 12 10:31:19 user nova-compute[71557]:   <memoryBacking supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:     <enum name='sourceType'>
Apr 12 10:31:19 user nova-compute[71557]:       <value>file</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>anonymous</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>memfd</value>
Apr 12 10:31:19 user nova-compute[71557]:     </enum>
Apr 12 10:31:19 user nova-compute[71557]:   </memoryBacking>
Apr 12 10:31:19 user nova-compute[71557]:   <devices>
Apr 12 10:31:19 user nova-compute[71557]:     <disk supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='diskDevice'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>disk</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>cdrom</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>floppy</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>lun</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='bus'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>fdc</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>scsi</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>usb</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>sata</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-non-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </disk>
Apr 12 10:31:19 user nova-compute[71557]:     <graphics supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='type'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>sdl</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vnc</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>spice</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>egl-headless</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </graphics>
Apr 12 10:31:19 user nova-compute[71557]:     <video supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='modelType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vga</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>cirrus</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vmvga</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>qxl</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>none</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>bochs</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>ramfb</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </video>
Apr 12 10:31:19 user nova-compute[71557]:     <hostdev supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='mode'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>subsystem</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='startupPolicy'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>default</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>mandatory</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>requisite</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>optional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='subsysType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>usb</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>pci</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>scsi</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='capsType'/>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='pciBackend'/>
Apr 12 10:31:19 user nova-compute[71557]:     </hostdev>
Apr 12 10:31:19 user nova-compute[71557]:     <rng supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-non-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='backendModel'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>random</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>egd</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>builtin</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </rng>
Apr 12 10:31:19 user nova-compute[71557]:     <filesystem supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='driverType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>path</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>handle</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtiofs</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </filesystem>
Apr 12 10:31:19 user nova-compute[71557]:     <tpm supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>tpm-tis</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>tpm-crb</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='backendModel'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>passthrough</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>emulator</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </tpm>
Apr 12 10:31:19 user nova-compute[71557]:   </devices>
Apr 12 10:31:19 user nova-compute[71557]:   <features>
Apr 12 10:31:19 user nova-compute[71557]:     <gic supported='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     <vmcoreinfo supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <genid supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <backingStoreInput supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <backup supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <sev supported='no'/>
Apr 12 10:31:19 user nova-compute[71557]:   </features>
Apr 12 10:31:19 user nova-compute[71557]: </domainCapabilities>
Apr 12 10:31:19 user nova-compute[71557]:  {{(pid=71557) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 12 10:31:19 user nova-compute[71557]: <domainCapabilities>
Apr 12 10:31:19 user nova-compute[71557]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 10:31:19 user nova-compute[71557]:   <domain>kvm</domain>
Apr 12 10:31:19 user nova-compute[71557]:   <machine>pc-i440fx-6.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:   <arch>x86_64</arch>
Apr 12 10:31:19 user nova-compute[71557]:   <vcpu max='255'/>
Apr 12 10:31:19 user nova-compute[71557]:   <iothreads supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:   <os supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:     <enum name='firmware'>
Apr 12 10:31:19 user nova-compute[71557]:       <value>efi</value>
Apr 12 10:31:19 user nova-compute[71557]:     </enum>
Apr 12 10:31:19 user nova-compute[71557]:     <loader supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='type'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>rom</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>pflash</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='readonly'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>yes</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>no</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='secure'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>no</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </loader>
Apr 12 10:31:19 user nova-compute[71557]:   </os>
Apr 12 10:31:19 user nova-compute[71557]:   <cpu>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='host-passthrough' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='hostPassthroughMigratable'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>on</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>off</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='maximum' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='maximumMigratable'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>on</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>off</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='host-model' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <vendor>Intel</vendor>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ss'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='vmx'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='pcid'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='hypervisor'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='arat'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='umip'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='md-clear'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='stibp'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ssbd'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='invtsc'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ibpb'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ibrs'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='amd-stibp'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='rsba'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='disable' name='erms'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='custom' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>qemu64</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>qemu32</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>phenom</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium3</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium2</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>n270</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>kvm64</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>kvm32</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>coreduo</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>core2duo</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>athlon</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Westmere</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Snowridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>SandyBridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Penryn</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G5</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G4</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G3</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G2</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Opteron_G1</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Nehalem</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>IvyBridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Icelake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-Rome</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-Milan</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Dhyana</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cooperlake</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Conroe</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>486</model>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:   </cpu>
Apr 12 10:31:19 user nova-compute[71557]:   <memoryBacking supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:     <enum name='sourceType'>
Apr 12 10:31:19 user nova-compute[71557]:       <value>file</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>anonymous</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>memfd</value>
Apr 12 10:31:19 user nova-compute[71557]:     </enum>
Apr 12 10:31:19 user nova-compute[71557]:   </memoryBacking>
Apr 12 10:31:19 user nova-compute[71557]:   <devices>
Apr 12 10:31:19 user nova-compute[71557]:     <disk supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='diskDevice'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>disk</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>cdrom</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>floppy</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>lun</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='bus'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>ide</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>fdc</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>scsi</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>usb</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>sata</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-non-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </disk>
Apr 12 10:31:19 user nova-compute[71557]:     <graphics supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='type'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>sdl</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vnc</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>spice</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>egl-headless</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </graphics>
Apr 12 10:31:19 user nova-compute[71557]:     <video supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='modelType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vga</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>cirrus</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vmvga</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>qxl</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>none</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>bochs</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>ramfb</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </video>
Apr 12 10:31:19 user nova-compute[71557]:     <hostdev supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='mode'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>subsystem</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='startupPolicy'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>default</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>mandatory</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>requisite</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>optional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='subsysType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>usb</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>pci</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>scsi</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='capsType'/>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='pciBackend'/>
Apr 12 10:31:19 user nova-compute[71557]:     </hostdev>
Apr 12 10:31:19 user nova-compute[71557]:     <rng supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-non-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='backendModel'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>random</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>egd</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>builtin</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </rng>
Apr 12 10:31:19 user nova-compute[71557]:     <filesystem supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='driverType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>path</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>handle</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtiofs</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </filesystem>
Apr 12 10:31:19 user nova-compute[71557]:     <tpm supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>tpm-tis</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>tpm-crb</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='backendModel'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>passthrough</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>emulator</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </tpm>
Apr 12 10:31:19 user nova-compute[71557]:   </devices>
Apr 12 10:31:19 user nova-compute[71557]:   <features>
Apr 12 10:31:19 user nova-compute[71557]:     <gic supported='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     <vmcoreinfo supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <genid supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <backingStoreInput supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <backup supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <sev supported='no'/>
Apr 12 10:31:19 user nova-compute[71557]:   </features>
Apr 12 10:31:19 user nova-compute[71557]: </domainCapabilities>
Apr 12 10:31:19 user nova-compute[71557]:  {{(pid=71557) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 12 10:31:19 user nova-compute[71557]: <domainCapabilities>
Apr 12 10:31:19 user nova-compute[71557]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 10:31:19 user nova-compute[71557]:   <domain>kvm</domain>
Apr 12 10:31:19 user nova-compute[71557]:   <machine>pc-q35-6.2</machine>
Apr 12 10:31:19 user nova-compute[71557]:   <arch>x86_64</arch>
Apr 12 10:31:19 user nova-compute[71557]:   <vcpu max='288'/>
Apr 12 10:31:19 user nova-compute[71557]:   <iothreads supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:   <os supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:     <enum name='firmware'>
Apr 12 10:31:19 user nova-compute[71557]:       <value>efi</value>
Apr 12 10:31:19 user nova-compute[71557]:     </enum>
Apr 12 10:31:19 user nova-compute[71557]:     <loader supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='type'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>rom</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>pflash</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='readonly'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>yes</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>no</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='secure'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>yes</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>no</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </loader>
Apr 12 10:31:19 user nova-compute[71557]:   </os>
Apr 12 10:31:19 user nova-compute[71557]:   <cpu>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='host-passthrough' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='hostPassthroughMigratable'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>on</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>off</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='maximum' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='maximumMigratable'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>on</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>off</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='host-model' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <vendor>Intel</vendor>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ss'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='vmx'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='pcid'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='hypervisor'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='arat'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='umip'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='md-clear'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='stibp'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ssbd'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='invtsc'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ibpb'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ibrs'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='amd-stibp'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='rsba'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='disable' name='erms'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='custom' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>qemu64</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>qemu32</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>phenom</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium3</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium2</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>n270</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>kvm64</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>kvm32</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>coreduo</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>core2duo</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>athlon</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Westmere</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Snowridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>SandyBridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Penryn</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G5</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G4</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G3</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G2</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Opteron_G1</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Nehalem</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>IvyBridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Icelake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-Rome</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-Milan</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Dhyana</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cooperlake</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Conroe</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>486</model>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:   </cpu>
Apr 12 10:31:19 user nova-compute[71557]:   <memoryBacking supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:     <enum name='sourceType'>
Apr 12 10:31:19 user nova-compute[71557]:       <value>file</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>anonymous</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>memfd</value>
Apr 12 10:31:19 user nova-compute[71557]:     </enum>
Apr 12 10:31:19 user nova-compute[71557]:   </memoryBacking>
Apr 12 10:31:19 user nova-compute[71557]:   <devices>
Apr 12 10:31:19 user nova-compute[71557]:     <disk supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='diskDevice'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>disk</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>cdrom</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>floppy</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>lun</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='bus'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>fdc</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>scsi</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>usb</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>sata</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-non-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </disk>
Apr 12 10:31:19 user nova-compute[71557]:     <graphics supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='type'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>sdl</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vnc</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>spice</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>egl-headless</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </graphics>
Apr 12 10:31:19 user nova-compute[71557]:     <video supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='modelType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vga</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>cirrus</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vmvga</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>qxl</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>none</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>bochs</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>ramfb</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </video>
Apr 12 10:31:19 user nova-compute[71557]:     <hostdev supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='mode'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>subsystem</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='startupPolicy'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>default</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>mandatory</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>requisite</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>optional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='subsysType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>usb</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>pci</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>scsi</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='capsType'/>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='pciBackend'/>
Apr 12 10:31:19 user nova-compute[71557]:     </hostdev>
Apr 12 10:31:19 user nova-compute[71557]:     <rng supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-non-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='backendModel'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>random</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>egd</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>builtin</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </rng>
Apr 12 10:31:19 user nova-compute[71557]:     <filesystem supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='driverType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>path</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>handle</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtiofs</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </filesystem>
Apr 12 10:31:19 user nova-compute[71557]:     <tpm supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>tpm-tis</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>tpm-crb</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='backendModel'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>passthrough</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>emulator</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </tpm>
Apr 12 10:31:19 user nova-compute[71557]:   </devices>
Apr 12 10:31:19 user nova-compute[71557]:   <features>
Apr 12 10:31:19 user nova-compute[71557]:     <gic supported='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     <vmcoreinfo supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <genid supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <backingStoreInput supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <backup supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <sev supported='no'/>
Apr 12 10:31:19 user nova-compute[71557]:   </features>
Apr 12 10:31:19 user nova-compute[71557]: </domainCapabilities>
Apr 12 10:31:19 user nova-compute[71557]:  {{(pid=71557) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 12 10:31:19 user nova-compute[71557]: <domainCapabilities>
Apr 12 10:31:19 user nova-compute[71557]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 10:31:19 user nova-compute[71557]:   <domain>kvm</domain>
Apr 12 10:31:19 user nova-compute[71557]:   <machine>pc-i440fx-jammy</machine>
Apr 12 10:31:19 user nova-compute[71557]:   <arch>x86_64</arch>
Apr 12 10:31:19 user nova-compute[71557]:   <vcpu max='255'/>
Apr 12 10:31:19 user nova-compute[71557]:   <iothreads supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:   <os supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:     <enum name='firmware'>
Apr 12 10:31:19 user nova-compute[71557]:       <value>efi</value>
Apr 12 10:31:19 user nova-compute[71557]:     </enum>
Apr 12 10:31:19 user nova-compute[71557]:     <loader supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='type'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>rom</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>pflash</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='readonly'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>yes</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>no</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='secure'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>no</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </loader>
Apr 12 10:31:19 user nova-compute[71557]:   </os>
Apr 12 10:31:19 user nova-compute[71557]:   <cpu>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='host-passthrough' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='hostPassthroughMigratable'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>on</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>off</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='maximum' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='maximumMigratable'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>on</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>off</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='host-model' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <vendor>Intel</vendor>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ss'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='vmx'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='pcid'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='hypervisor'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='arat'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='umip'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='md-clear'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='stibp'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ssbd'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='invtsc'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ibpb'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ibrs'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='amd-stibp'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='rsba'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='disable' name='erms'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='custom' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>qemu64</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>qemu32</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>phenom</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium3</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium2</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>n270</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>kvm64</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>kvm32</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>coreduo</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>core2duo</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>athlon</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Westmere</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Snowridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>SandyBridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Penryn</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G5</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G4</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G3</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G2</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Opteron_G1</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Nehalem</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>IvyBridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Icelake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-Rome</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-Milan</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Dhyana</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cooperlake</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Conroe</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>486</model>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:   </cpu>
Apr 12 10:31:19 user nova-compute[71557]:   <memoryBacking supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:     <enum name='sourceType'>
Apr 12 10:31:19 user nova-compute[71557]:       <value>file</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>anonymous</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>memfd</value>
Apr 12 10:31:19 user nova-compute[71557]:     </enum>
Apr 12 10:31:19 user nova-compute[71557]:   </memoryBacking>
Apr 12 10:31:19 user nova-compute[71557]:   <devices>
Apr 12 10:31:19 user nova-compute[71557]:     <disk supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='diskDevice'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>disk</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>cdrom</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>floppy</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>lun</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='bus'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>ide</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>fdc</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>scsi</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>usb</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>sata</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-non-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </disk>
Apr 12 10:31:19 user nova-compute[71557]:     <graphics supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='type'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>sdl</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vnc</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>spice</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>egl-headless</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </graphics>
Apr 12 10:31:19 user nova-compute[71557]:     <video supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='modelType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vga</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>cirrus</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vmvga</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>qxl</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>none</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>bochs</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>ramfb</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </video>
Apr 12 10:31:19 user nova-compute[71557]:     <hostdev supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='mode'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>subsystem</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='startupPolicy'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>default</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>mandatory</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>requisite</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>optional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='subsysType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>usb</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>pci</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>scsi</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='capsType'/>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='pciBackend'/>
Apr 12 10:31:19 user nova-compute[71557]:     </hostdev>
Apr 12 10:31:19 user nova-compute[71557]:     <rng supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-non-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='backendModel'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>random</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>egd</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>builtin</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </rng>
Apr 12 10:31:19 user nova-compute[71557]:     <filesystem supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='driverType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>path</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>handle</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtiofs</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </filesystem>
Apr 12 10:31:19 user nova-compute[71557]:     <tpm supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>tpm-tis</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>tpm-crb</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='backendModel'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>passthrough</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>emulator</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </tpm>
Apr 12 10:31:19 user nova-compute[71557]:   </devices>
Apr 12 10:31:19 user nova-compute[71557]:   <features>
Apr 12 10:31:19 user nova-compute[71557]:     <gic supported='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     <vmcoreinfo supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <genid supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <backingStoreInput supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <backup supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <sev supported='no'/>
Apr 12 10:31:19 user nova-compute[71557]:   </features>
Apr 12 10:31:19 user nova-compute[71557]: </domainCapabilities>
Apr 12 10:31:19 user nova-compute[71557]:  {{(pid=71557) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 12 10:31:19 user nova-compute[71557]: <domainCapabilities>
Apr 12 10:31:19 user nova-compute[71557]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 10:31:19 user nova-compute[71557]:   <domain>kvm</domain>
Apr 12 10:31:19 user nova-compute[71557]:   <machine>pc-q35-jammy</machine>
Apr 12 10:31:19 user nova-compute[71557]:   <arch>x86_64</arch>
Apr 12 10:31:19 user nova-compute[71557]:   <vcpu max='288'/>
Apr 12 10:31:19 user nova-compute[71557]:   <iothreads supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:   <os supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:     <enum name='firmware'>
Apr 12 10:31:19 user nova-compute[71557]:       <value>efi</value>
Apr 12 10:31:19 user nova-compute[71557]:     </enum>
Apr 12 10:31:19 user nova-compute[71557]:     <loader supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='type'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>rom</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>pflash</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='readonly'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>yes</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>no</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='secure'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>yes</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>no</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </loader>
Apr 12 10:31:19 user nova-compute[71557]:   </os>
Apr 12 10:31:19 user nova-compute[71557]:   <cpu>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='host-passthrough' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='hostPassthroughMigratable'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>on</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>off</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='maximum' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='maximumMigratable'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>on</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>off</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='host-model' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <vendor>Intel</vendor>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ss'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='vmx'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='pcid'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='hypervisor'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='arat'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='umip'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='md-clear'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='stibp'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ssbd'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='invtsc'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ibpb'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='ibrs'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='amd-stibp'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='rsba'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='disable' name='erms'/>
Apr 12 10:31:19 user nova-compute[71557]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:     <mode name='custom' supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>qemu64</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>qemu32</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>phenom</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium3</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium2</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>pentium</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>n270</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>kvm64</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>kvm32</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>coreduo</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>core2duo</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>athlon</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Westmere</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Snowridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Skylake-Client</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>SandyBridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Penryn</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G5</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G4</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G3</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Opteron_G2</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Opteron_G1</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Nehalem</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>IvyBridge</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Icelake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Haswell</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-Rome</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-Milan</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>EPYC</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Dhyana</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cooperlake</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>Conroe</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='no'>Broadwell</model>
Apr 12 10:31:19 user nova-compute[71557]:       <model usable='yes'>486</model>
Apr 12 10:31:19 user nova-compute[71557]:     </mode>
Apr 12 10:31:19 user nova-compute[71557]:   </cpu>
Apr 12 10:31:19 user nova-compute[71557]:   <memoryBacking supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:     <enum name='sourceType'>
Apr 12 10:31:19 user nova-compute[71557]:       <value>file</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>anonymous</value>
Apr 12 10:31:19 user nova-compute[71557]:       <value>memfd</value>
Apr 12 10:31:19 user nova-compute[71557]:     </enum>
Apr 12 10:31:19 user nova-compute[71557]:   </memoryBacking>
Apr 12 10:31:19 user nova-compute[71557]:   <devices>
Apr 12 10:31:19 user nova-compute[71557]:     <disk supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='diskDevice'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>disk</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>cdrom</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>floppy</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>lun</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='bus'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>fdc</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>scsi</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>usb</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>sata</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-non-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </disk>
Apr 12 10:31:19 user nova-compute[71557]:     <graphics supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='type'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>sdl</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vnc</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>spice</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>egl-headless</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </graphics>
Apr 12 10:31:19 user nova-compute[71557]:     <video supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='modelType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vga</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>cirrus</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>vmvga</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>qxl</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>none</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>bochs</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>ramfb</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </video>
Apr 12 10:31:19 user nova-compute[71557]:     <hostdev supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='mode'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>subsystem</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='startupPolicy'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>default</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>mandatory</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>requisite</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>optional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='subsysType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>usb</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>pci</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>scsi</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='capsType'/>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='pciBackend'/>
Apr 12 10:31:19 user nova-compute[71557]:     </hostdev>
Apr 12 10:31:19 user nova-compute[71557]:     <rng supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtio-non-transitional</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='backendModel'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>random</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>egd</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>builtin</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </rng>
Apr 12 10:31:19 user nova-compute[71557]:     <filesystem supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='driverType'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>path</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>handle</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>virtiofs</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </filesystem>
Apr 12 10:31:19 user nova-compute[71557]:     <tpm supported='yes'>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='model'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>tpm-tis</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>tpm-crb</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:       <enum name='backendModel'>
Apr 12 10:31:19 user nova-compute[71557]:         <value>passthrough</value>
Apr 12 10:31:19 user nova-compute[71557]:         <value>emulator</value>
Apr 12 10:31:19 user nova-compute[71557]:       </enum>
Apr 12 10:31:19 user nova-compute[71557]:     </tpm>
Apr 12 10:31:19 user nova-compute[71557]:   </devices>
Apr 12 10:31:19 user nova-compute[71557]:   <features>
Apr 12 10:31:19 user nova-compute[71557]:     <gic supported='no'/>
Apr 12 10:31:19 user nova-compute[71557]:     <vmcoreinfo supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <genid supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <backingStoreInput supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <backup supported='yes'/>
Apr 12 10:31:19 user nova-compute[71557]:     <sev supported='no'/>
Apr 12 10:31:19 user nova-compute[71557]:   </features>
Apr 12 10:31:19 user nova-compute[71557]: </domainCapabilities>
Apr 12 10:31:19 user nova-compute[71557]:  {{(pid=71557) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71557) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71557) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Checking secure boot support for host arch (x86_64) {{(pid=71557) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Checking secure boot support for host arch (x86_64) {{(pid=71557) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Checking secure boot support for host arch (x86_64) {{(pid=71557) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 10:31:19 user nova-compute[71557]: INFO nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Secure Boot support detected
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] cpu compare xml: <cpu match="exact">
Apr 12 10:31:19 user nova-compute[71557]:   <model>Nehalem</model>
Apr 12 10:31:19 user nova-compute[71557]: </cpu>
Apr 12 10:31:19 user nova-compute[71557]:  {{(pid=71557) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 12 10:31:19 user nova-compute[71557]: INFO nova.virt.node [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Generated node identity 24299bcb-a671-492d-9d13-df83697a8f87
Apr 12 10:31:19 user nova-compute[71557]: INFO nova.virt.node [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Wrote node identity 24299bcb-a671-492d-9d13-df83697a8f87 to /opt/stack/data/nova/compute_id
Apr 12 10:31:19 user nova-compute[71557]: WARNING nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Compute nodes ['24299bcb-a671-492d-9d13-df83697a8f87'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 12 10:31:19 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 12 10:31:19 user nova-compute[71557]: WARNING nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 12 10:31:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:31:19 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:31:19 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Hypervisor/Node resource view: name=user free_ram=10800MB free_disk=27.101367950439453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:31:19 user nova-compute[71557]: WARNING nova.compute.resource_tracker [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] No compute node record for user:24299bcb-a671-492d-9d13-df83697a8f87: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 24299bcb-a671-492d-9d13-df83697a8f87 could not be found.
Apr 12 10:31:19 user nova-compute[71557]: INFO nova.compute.resource_tracker [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Compute node record created for user:user with uuid: 24299bcb-a671-492d-9d13-df83697a8f87
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:31:19 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:31:20 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [req-cef6ce2c-70b6-437a-83dc-6c484337d6b1] Created resource provider record via placement API for resource provider with UUID 24299bcb-a671-492d-9d13-df83697a8f87 and name user.
Apr 12 10:31:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71557) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 12 10:31:20 user nova-compute[71557]: INFO nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] kernel doesn't support AMD SEV
Apr 12 10:31:20 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Updating inventory in ProviderTree for provider 24299bcb-a671-492d-9d13-df83697a8f87 with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 10:31:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:31:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Libvirt baseline CPU <cpu>
Apr 12 10:31:20 user nova-compute[71557]:   <arch>x86_64</arch>
Apr 12 10:31:20 user nova-compute[71557]:   <model>Nehalem</model>
Apr 12 10:31:20 user nova-compute[71557]:   <vendor>Intel</vendor>
Apr 12 10:31:20 user nova-compute[71557]:   <topology sockets="6" cores="1" threads="1"/>
Apr 12 10:31:20 user nova-compute[71557]: </cpu>
Apr 12 10:31:20 user nova-compute[71557]:  {{(pid=71557) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 12 10:31:20 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Updated inventory for provider 24299bcb-a671-492d-9d13-df83697a8f87 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 12 10:31:20 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Updating resource provider 24299bcb-a671-492d-9d13-df83697a8f87 generation from 0 to 1 during operation: update_inventory {{(pid=71557) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 12 10:31:20 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Updating inventory in ProviderTree for provider 24299bcb-a671-492d-9d13-df83697a8f87 with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 10:31:20 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Updating resource provider 24299bcb-a671-492d-9d13-df83697a8f87 generation from 1 to 2 during operation: update_traits {{(pid=71557) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 12 10:31:20 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:31:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.618s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:31:20 user nova-compute[71557]: DEBUG nova.service [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Creating RPC server for service compute {{(pid=71557) start /opt/stack/nova/nova/service.py:182}}
Apr 12 10:31:20 user nova-compute[71557]: DEBUG nova.service [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Join ServiceGroup membership for this service compute {{(pid=71557) start /opt/stack/nova/nova/service.py:199}}
Apr 12 10:31:20 user nova-compute[71557]: DEBUG nova.servicegroup.drivers.db [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71557) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 12 10:31:40 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_power_states {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:31:40 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Rebuilding the list of instances to heal {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Didn't find any instances for network info cache update. {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:32:11 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:32:11 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:32:11 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=10158MB free_disk=27.015151977539062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:32:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:33:11 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:33:12 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:33:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:33:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Rebuilding the list of instances to heal {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 10:33:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Didn't find any instances for network info cache update. {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 10:33:12 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:33:12 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:33:12 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:33:12 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:33:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:33:12 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:33:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:33:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:33:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:33:12 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:33:12 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:33:12 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:33:12 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=10150MB free_disk=27.060386657714844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:33:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:33:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:33:12 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:33:12 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:33:12 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:33:12 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:33:12 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:33:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.098s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:33:13 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:33:13 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:33:13 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:34:12 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:34:13 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:34:13 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:34:13 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:34:13 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:34:13 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:34:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:34:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:34:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:34:13 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:34:13 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:34:13 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:34:13 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=10181MB free_disk=26.837257385253906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:34:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:34:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:34:13 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:34:13 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:34:13 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:34:13 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:34:13 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:34:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:34:14 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:34:14 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:34:14 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Rebuilding the list of instances to heal {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 10:34:14 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Didn't find any instances for network info cache update. {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 10:34:14 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:34:14 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:34:15 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:35:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Acquiring lock "270d5d4d-4df6-4ba5-9145-98f343fb3b0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "270d5d4d-4df6-4ba5-9145-98f343fb3b0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:35:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:10 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:35:10 user nova-compute[71557]: INFO nova.compute.claims [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Claim successful on node user
Apr 12 10:35:10 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:35:10 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:35:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:35:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:35:10 user nova-compute[71557]: DEBUG nova.network.neutron [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:35:10 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:35:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:35:11 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:35:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:35:11 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Creating image(s)
Apr 12 10:35:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Acquiring lock "/opt/stack/data/nova/instances/270d5d4d-4df6-4ba5-9145-98f343fb3b0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "/opt/stack/data/nova/instances/270d5d4d-4df6-4ba5-9145-98f343fb3b0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "/opt/stack/data/nova/instances/270d5d4d-4df6-4ba5-9145-98f343fb3b0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c.part --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:11 user nova-compute[71557]: DEBUG nova.policy [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '064f86e997904027aa9f086e3b137916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8cbfbed2c843f796e810c6cc8530ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:35:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c.part --force-share --output=json" returned: 0 in 0.122s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:11 user nova-compute[71557]: DEBUG nova.virt.images [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] 3dd4c04b-7ffb-4200-9900-d3e99c6da7a0 was qcow2, converting to raw {{(pid=71557) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 10:35:11 user nova-compute[71557]: DEBUG nova.privsep.utils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71557) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 10:35:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c.part /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c.converted {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c.part /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c.converted" returned: 0 in 0.150s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c.converted --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:12 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.038s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:12 user nova-compute[71557]: INFO oslo.privsep.daemon [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpyxvvcjij/privsep.sock']
Apr 12 10:35:12 user sudo[80265]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpyxvvcjij/privsep.sock
Apr 12 10:35:12 user sudo[80265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 10:35:12 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:35:12 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:35:13 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:35:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:13 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:35:13 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:35:13 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:35:13 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=9326MB free_disk=26.82910919189453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:35:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:13 user sudo[80265]: pam_unix(sudo:session): session closed for user root
Apr 12 10:35:13 user nova-compute[71557]: INFO oslo.privsep.daemon [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Spawned new privsep daemon via rootwrap
Apr 12 10:35:13 user nova-compute[71557]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 10:35:13 user nova-compute[71557]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 10:35:13 user nova-compute[71557]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 12 10:35:13 user nova-compute[71557]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80269
Apr 12 10:35:13 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 270d5d4d-4df6-4ba5-9145-98f343fb3b0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:35:13 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:35:13 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:35:13 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:35:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:13 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:35:13 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:35:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.311s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.115s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/270d5d4d-4df6-4ba5-9145-98f343fb3b0e/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/270d5d4d-4df6-4ba5-9145-98f343fb3b0e/disk 1073741824" returned: 0 in 0.043s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.181s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.174s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:14 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Checking if we can resize image /opt/stack/data/nova/instances/270d5d4d-4df6-4ba5-9145-98f343fb3b0e/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:35:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270d5d4d-4df6-4ba5-9145-98f343fb3b0e/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270d5d4d-4df6-4ba5-9145-98f343fb3b0e/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:14 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Cannot resize image /opt/stack/data/nova/instances/270d5d4d-4df6-4ba5-9145-98f343fb3b0e/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:35:14 user nova-compute[71557]: DEBUG nova.objects.instance [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lazy-loading 'migration_context' on Instance uuid 270d5d4d-4df6-4ba5-9145-98f343fb3b0e {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:35:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:35:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Ensure instance console log exists: /opt/stack/data/nova/instances/270d5d4d-4df6-4ba5-9145-98f343fb3b0e/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:35:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:14 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:35:14 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:35:14 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Rebuilding the list of instances to heal {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 10:35:15 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Skipping network cache update for instance because it is Building. {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 12 10:35:15 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Didn't find any instances for network info cache update. {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 10:35:15 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:35:15 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:35:15 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:35:15 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:35:15 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:35:15 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:35:15 user nova-compute[71557]: DEBUG nova.network.neutron [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Successfully created port: 42768d69-c7da-43fb-b092-c5b41ac2d55c {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:35:16 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:35:18 user nova-compute[71557]: DEBUG nova.network.neutron [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Successfully updated port: 42768d69-c7da-43fb-b092-c5b41ac2d55c {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:35:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Acquiring lock "refresh_cache-270d5d4d-4df6-4ba5-9145-98f343fb3b0e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:35:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Acquired lock "refresh_cache-270d5d4d-4df6-4ba5-9145-98f343fb3b0e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:35:18 user nova-compute[71557]: DEBUG nova.network.neutron [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:35:19 user nova-compute[71557]: DEBUG nova.network.neutron [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:35:19 user nova-compute[71557]: DEBUG nova.compute.manager [req-334bd9ba-333e-40d3-b499-162a68df07d8 req-2ae43a3c-39d0-4577-b473-b383bd3fbb1c service nova] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Received event network-changed-42768d69-c7da-43fb-b092-c5b41ac2d55c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:35:19 user nova-compute[71557]: DEBUG nova.compute.manager [req-334bd9ba-333e-40d3-b499-162a68df07d8 req-2ae43a3c-39d0-4577-b473-b383bd3fbb1c service nova] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Refreshing instance network info cache due to event network-changed-42768d69-c7da-43fb-b092-c5b41ac2d55c. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:35:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-334bd9ba-333e-40d3-b499-162a68df07d8 req-2ae43a3c-39d0-4577-b473-b383bd3fbb1c service nova] Acquiring lock "refresh_cache-270d5d4d-4df6-4ba5-9145-98f343fb3b0e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.network.neutron [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Updating instance_info_cache with network_info: [{"id": "42768d69-c7da-43fb-b092-c5b41ac2d55c", "address": "fa:16:3e:65:7d:3d", "network": {"id": "b5640ff6-6dc1-44c3-b04c-9e2d4ef8ecb3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fef1d0d3952d43e2be1c2b52c16966b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42768d69-c7", "ovs_interfaceid": "42768d69-c7da-43fb-b092-c5b41ac2d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Releasing lock "refresh_cache-270d5d4d-4df6-4ba5-9145-98f343fb3b0e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Instance network_info: |[{"id": "42768d69-c7da-43fb-b092-c5b41ac2d55c", "address": "fa:16:3e:65:7d:3d", "network": {"id": "b5640ff6-6dc1-44c3-b04c-9e2d4ef8ecb3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fef1d0d3952d43e2be1c2b52c16966b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42768d69-c7", "ovs_interfaceid": "42768d69-c7da-43fb-b092-c5b41ac2d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-334bd9ba-333e-40d3-b499-162a68df07d8 req-2ae43a3c-39d0-4577-b473-b383bd3fbb1c service nova] Acquired lock "refresh_cache-270d5d4d-4df6-4ba5-9145-98f343fb3b0e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.network.neutron [req-334bd9ba-333e-40d3-b499-162a68df07d8 req-2ae43a3c-39d0-4577-b473-b383bd3fbb1c service nova] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Refreshing network info cache for port 42768d69-c7da-43fb-b092-c5b41ac2d55c {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Start _get_guest_xml network_info=[{"id": "42768d69-c7da-43fb-b092-c5b41ac2d55c", "address": "fa:16:3e:65:7d:3d", "network": {"id": "b5640ff6-6dc1-44c3-b04c-9e2d4ef8ecb3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fef1d0d3952d43e2be1c2b52c16966b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42768d69-c7", "ovs_interfaceid": "42768d69-c7da-43fb-b092-c5b41ac2d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:35:20 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:35:20 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.privsep.utils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71557) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-772245965',display_name='tempest-VolumesNegativeTest-instance-772245965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-772245965',id=1,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d8cbfbed2c843f796e810c6cc8530ba',ramdisk_id='',reservation_id='r-4mgik8wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-452512257',owner_user_name='tempest-VolumesNegativeTest-452512257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:35:11Z,user_data=None,user_id='064f86e997904027aa9f086e3b137916',uuid=270d5d4d-4df6-4ba5-9145-98f343fb3b0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42768d69-c7da-43fb-b092-c5b41ac2d55c", "address": "fa:16:3e:65:7d:3d", "network": {"id": "b5640ff6-6dc1-44c3-b04c-9e2d4ef8ecb3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fef1d0d3952d43e2be1c2b52c16966b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42768d69-c7", "ovs_interfaceid": "42768d69-c7da-43fb-b092-c5b41ac2d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Converting VIF {"id": "42768d69-c7da-43fb-b092-c5b41ac2d55c", "address": "fa:16:3e:65:7d:3d", "network": {"id": "b5640ff6-6dc1-44c3-b04c-9e2d4ef8ecb3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fef1d0d3952d43e2be1c2b52c16966b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42768d69-c7", "ovs_interfaceid": "42768d69-c7da-43fb-b092-c5b41ac2d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:7d:3d,bridge_name='br-int',has_traffic_filtering=True,id=42768d69-c7da-43fb-b092-c5b41ac2d55c,network=Network(b5640ff6-6dc1-44c3-b04c-9e2d4ef8ecb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42768d69-c7') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.objects.instance [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lazy-loading 'pci_devices' on Instance uuid 270d5d4d-4df6-4ba5-9145-98f343fb3b0e {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:35:20 user nova-compute[71557]:   <uuid>270d5d4d-4df6-4ba5-9145-98f343fb3b0e</uuid>
Apr 12 10:35:20 user nova-compute[71557]:   <name>instance-00000001</name>
Apr 12 10:35:20 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:35:20 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:35:20 user nova-compute[71557]:   <metadata>
Apr 12 10:35:20 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:35:20 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:35:20 user nova-compute[71557]:       <nova:name>tempest-VolumesNegativeTest-instance-772245965</nova:name>
Apr 12 10:35:20 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:35:20</nova:creationTime>
Apr 12 10:35:20 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:35:20 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:35:20 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:35:20 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:35:20 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:35:20 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:35:20 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:35:20 user nova-compute[71557]:       <nova:owner>
Apr 12 10:35:20 user nova-compute[71557]:         <nova:user uuid="064f86e997904027aa9f086e3b137916">tempest-VolumesNegativeTest-452512257-project-member</nova:user>
Apr 12 10:35:20 user nova-compute[71557]:         <nova:project uuid="3d8cbfbed2c843f796e810c6cc8530ba">tempest-VolumesNegativeTest-452512257</nova:project>
Apr 12 10:35:20 user nova-compute[71557]:       </nova:owner>
Apr 12 10:35:20 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:35:20 user nova-compute[71557]:       <nova:ports>
Apr 12 10:35:20 user nova-compute[71557]:         <nova:port uuid="42768d69-c7da-43fb-b092-c5b41ac2d55c">
Apr 12 10:35:20 user nova-compute[71557]:           <nova:ip type="fixed" address="192.168.233.200" ipVersion="4"/>
Apr 12 10:35:20 user nova-compute[71557]:         </nova:port>
Apr 12 10:35:20 user nova-compute[71557]:       </nova:ports>
Apr 12 10:35:20 user nova-compute[71557]:     </nova:instance>
Apr 12 10:35:20 user nova-compute[71557]:   </metadata>
Apr 12 10:35:20 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:35:20 user nova-compute[71557]:     <system>
Apr 12 10:35:20 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:35:20 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:35:20 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:35:20 user nova-compute[71557]:       <entry name="serial">270d5d4d-4df6-4ba5-9145-98f343fb3b0e</entry>
Apr 12 10:35:20 user nova-compute[71557]:       <entry name="uuid">270d5d4d-4df6-4ba5-9145-98f343fb3b0e</entry>
Apr 12 10:35:20 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:35:20 user nova-compute[71557]:     </system>
Apr 12 10:35:20 user nova-compute[71557]:   </sysinfo>
Apr 12 10:35:20 user nova-compute[71557]:   <os>
Apr 12 10:35:20 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:35:20 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:35:20 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:35:20 user nova-compute[71557]:   </os>
Apr 12 10:35:20 user nova-compute[71557]:   <features>
Apr 12 10:35:20 user nova-compute[71557]:     <acpi/>
Apr 12 10:35:20 user nova-compute[71557]:     <apic/>
Apr 12 10:35:20 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:35:20 user nova-compute[71557]:   </features>
Apr 12 10:35:20 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:35:20 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:35:20 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:35:20 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:35:20 user nova-compute[71557]:   </clock>
Apr 12 10:35:20 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:35:20 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:35:20 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:35:20 user nova-compute[71557]:   </cpu>
Apr 12 10:35:20 user nova-compute[71557]:   <devices>
Apr 12 10:35:20 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:35:20 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:35:20 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/270d5d4d-4df6-4ba5-9145-98f343fb3b0e/disk"/>
Apr 12 10:35:20 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:35:20 user nova-compute[71557]:     </disk>
Apr 12 10:35:20 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:35:20 user nova-compute[71557]:       <mac address="fa:16:3e:65:7d:3d"/>
Apr 12 10:35:20 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:35:20 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:35:20 user nova-compute[71557]:       <target dev="tap42768d69-c7"/>
Apr 12 10:35:20 user nova-compute[71557]:     </interface>
Apr 12 10:35:20 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:35:20 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/270d5d4d-4df6-4ba5-9145-98f343fb3b0e/console.log" append="off"/>
Apr 12 10:35:20 user nova-compute[71557]:     </serial>
Apr 12 10:35:20 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:35:20 user nova-compute[71557]:     <video>
Apr 12 10:35:20 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:35:20 user nova-compute[71557]:     </video>
Apr 12 10:35:20 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:35:20 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:35:20 user nova-compute[71557]:     </rng>
Apr 12 10:35:20 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:35:20 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:35:20 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:35:20 user nova-compute[71557]:     </memballoon>
Apr 12 10:35:20 user nova-compute[71557]:   </devices>
Apr 12 10:35:20 user nova-compute[71557]: </domain>
Apr 12 10:35:20 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-772245965',display_name='tempest-VolumesNegativeTest-instance-772245965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-772245965',id=1,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d8cbfbed2c843f796e810c6cc8530ba',ramdisk_id='',reservation_id='r-4mgik8wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-452512257',owner_user_name='tempest-VolumesNegativeTest-452512257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:35:11Z,user_data=None,user_id='064f86e997904027aa9f086e3b137916',uuid=270d5d4d-4df6-4ba5-9145-98f343fb3b0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42768d69-c7da-43fb-b092-c5b41ac2d55c", "address": "fa:16:3e:65:7d:3d", "network": {"id": "b5640ff6-6dc1-44c3-b04c-9e2d4ef8ecb3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fef1d0d3952d43e2be1c2b52c16966b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42768d69-c7", "ovs_interfaceid": "42768d69-c7da-43fb-b092-c5b41ac2d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Converting VIF {"id": "42768d69-c7da-43fb-b092-c5b41ac2d55c", "address": "fa:16:3e:65:7d:3d", "network": {"id": "b5640ff6-6dc1-44c3-b04c-9e2d4ef8ecb3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fef1d0d3952d43e2be1c2b52c16966b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42768d69-c7", "ovs_interfaceid": "42768d69-c7da-43fb-b092-c5b41ac2d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:7d:3d,bridge_name='br-int',has_traffic_filtering=True,id=42768d69-c7da-43fb-b092-c5b41ac2d55c,network=Network(b5640ff6-6dc1-44c3-b04c-9e2d4ef8ecb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42768d69-c7') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG os_vif [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:7d:3d,bridge_name='br-int',has_traffic_filtering=True,id=42768d69-c7da-43fb-b092-c5b41ac2d55c,network=Network(b5640ff6-6dc1-44c3-b04c-9e2d4ef8ecb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42768d69-c7') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Created schema index Interface.name {{(pid=71557) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Created schema index Port.name {{(pid=71557) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Created schema index Bridge.name {{(pid=71557) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [POLLOUT] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:35:20 user nova-compute[71557]: INFO oslo.privsep.daemon [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpxplsw9p7/privsep.sock']
Apr 12 10:35:20 user sudo[80295]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpxplsw9p7/privsep.sock
Apr 12 10:35:20 user sudo[80295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 10:35:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:22 user sudo[80295]: pam_unix(sudo:session): session closed for user root
Apr 12 10:35:22 user nova-compute[71557]: INFO oslo.privsep.daemon [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Spawned new privsep daemon via rootwrap
Apr 12 10:35:22 user nova-compute[71557]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 10:35:22 user nova-compute[71557]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 10:35:22 user nova-compute[71557]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 12 10:35:22 user nova-compute[71557]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80298
Apr 12 10:35:22 user nova-compute[71557]: DEBUG nova.network.neutron [req-334bd9ba-333e-40d3-b499-162a68df07d8 req-2ae43a3c-39d0-4577-b473-b383bd3fbb1c service nova] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Updated VIF entry in instance network info cache for port 42768d69-c7da-43fb-b092-c5b41ac2d55c. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:35:22 user nova-compute[71557]: DEBUG nova.network.neutron [req-334bd9ba-333e-40d3-b499-162a68df07d8 req-2ae43a3c-39d0-4577-b473-b383bd3fbb1c service nova] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Updating instance_info_cache with network_info: [{"id": "42768d69-c7da-43fb-b092-c5b41ac2d55c", "address": "fa:16:3e:65:7d:3d", "network": {"id": "b5640ff6-6dc1-44c3-b04c-9e2d4ef8ecb3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fef1d0d3952d43e2be1c2b52c16966b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42768d69-c7", "ovs_interfaceid": "42768d69-c7da-43fb-b092-c5b41ac2d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:35:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-334bd9ba-333e-40d3-b499-162a68df07d8 req-2ae43a3c-39d0-4577-b473-b383bd3fbb1c service nova] Releasing lock "refresh_cache-270d5d4d-4df6-4ba5-9145-98f343fb3b0e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:35:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42768d69-c7, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap42768d69-c7, col_values=(('external_ids', {'iface-id': '42768d69-c7da-43fb-b092-c5b41ac2d55c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:7d:3d', 'vm-uuid': '270d5d4d-4df6-4ba5-9145-98f343fb3b0e'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:35:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:22 user nova-compute[71557]: INFO os_vif [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:7d:3d,bridge_name='br-int',has_traffic_filtering=True,id=42768d69-c7da-43fb-b092-c5b41ac2d55c,network=Network(b5640ff6-6dc1-44c3-b04c-9e2d4ef8ecb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42768d69-c7')
Apr 12 10:35:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:35:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] No VIF found with MAC fa:16:3e:65:7d:3d, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:35:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:25 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295725.9684408, 270d5d4d-4df6-4ba5-9145-98f343fb3b0e => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:35:25 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] VM Resumed (Lifecycle Event)
Apr 12 10:35:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:35:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:35:25 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Instance spawned successfully.
Apr 12 10:35:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:35:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:26 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:35:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "0f55cab4-8530-4be0-a91d-65671f0dccd9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "0f55cab4-8530-4be0-a91d-65671f0dccd9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:26 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:35:26 user nova-compute[71557]: DEBUG nova.compute.manager [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:35:26 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:35:26 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295725.9722748, 270d5d4d-4df6-4ba5-9145-98f343fb3b0e => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:35:26 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] VM Started (Lifecycle Event)
Apr 12 10:35:26 user nova-compute[71557]: INFO nova.compute.manager [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Took 15.19 seconds to spawn the instance on the hypervisor.
Apr 12 10:35:26 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:35:26 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:35:26 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:35:26 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:35:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:26 user nova-compute[71557]: INFO nova.compute.manager [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Took 16.10 seconds to build instance.
Apr 12 10:35:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:35:26 user nova-compute[71557]: INFO nova.compute.claims [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Claim successful on node user
Apr 12 10:35:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0c8350b2-c0d7-47c9-8d6c-5b701b38bc94 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "270d5d4d-4df6-4ba5-9145-98f343fb3b0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.359s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:26 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:35:26 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:35:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:26 user nova-compute[71557]: DEBUG nova.compute.manager [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:35:26 user nova-compute[71557]: DEBUG nova.compute.manager [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:35:26 user nova-compute[71557]: DEBUG nova.network.neutron [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:35:26 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:35:26 user nova-compute[71557]: DEBUG nova.compute.manager [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG nova.compute.manager [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:35:27 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Creating image(s)
Apr 12 10:35:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "/opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "/opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.156s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG nova.policy [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.201s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk 1073741824" returned: 0 in 0.092s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.172s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Cannot resize image /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG nova.objects.instance [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'migration_context' on Instance uuid 0f55cab4-8530-4be0-a91d-65671f0dccd9 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Ensure instance console log exists: /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "f47d368e-3870-49d0-8522-a94991ec4ba5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:28 user nova-compute[71557]: DEBUG nova.compute.manager [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:35:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:35:28 user nova-compute[71557]: INFO nova.compute.claims [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Claim successful on node user
Apr 12 10:35:28 user nova-compute[71557]: DEBUG nova.network.neutron [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Successfully created port: e1506948-cd44-4d78-a019-853199016229 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG nova.compute.manager [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG nova.compute.manager [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG nova.network.neutron [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:35:29 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:35:29 user nova-compute[71557]: DEBUG nova.compute.manager [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG nova.compute.manager [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:35:29 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Creating image(s)
Apr 12 10:35:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "/opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "/opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "/opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.184s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG nova.policy [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c757f04065b9488ba75739e59d7be377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce2a3bde13e464f8df0a41f30c240ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.171s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk 1073741824" returned: 0 in 0.074s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:29 user nova-compute[71557]: DEBUG nova.compute.manager [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:35:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.174s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:30 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:35:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:35:30 user nova-compute[71557]: INFO nova.compute.claims [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Claim successful on node user
Apr 12 10:35:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:30 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Cannot resize image /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:35:30 user nova-compute[71557]: DEBUG nova.objects.instance [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lazy-loading 'migration_context' on Instance uuid f47d368e-3870-49d0-8522-a94991ec4ba5 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:35:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:35:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Ensure instance console log exists: /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:35:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:30 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:35:30 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:35:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:35:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:35:30 user nova-compute[71557]: DEBUG nova.network.neutron [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:35:30 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:35:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG nova.compute.manager [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:35:31 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Creating image(s)
Apr 12 10:35:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "/opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "/opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.163s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.186s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG nova.policy [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk 1073741824" returned: 0 in 0.056s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.167s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Cannot resize image /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG nova.objects.instance [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'migration_context' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Ensure instance console log exists: /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG nova.compute.manager [req-45580f68-6091-4380-94ca-46114181b02e req-9a0f2109-b145-4f86-8fd9-8929fc66631c service nova] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Received event network-vif-plugged-42768d69-c7da-43fb-b092-c5b41ac2d55c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-45580f68-6091-4380-94ca-46114181b02e req-9a0f2109-b145-4f86-8fd9-8929fc66631c service nova] Acquiring lock "270d5d4d-4df6-4ba5-9145-98f343fb3b0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-45580f68-6091-4380-94ca-46114181b02e req-9a0f2109-b145-4f86-8fd9-8929fc66631c service nova] Lock "270d5d4d-4df6-4ba5-9145-98f343fb3b0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-45580f68-6091-4380-94ca-46114181b02e req-9a0f2109-b145-4f86-8fd9-8929fc66631c service nova] Lock "270d5d4d-4df6-4ba5-9145-98f343fb3b0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:31 user nova-compute[71557]: DEBUG nova.compute.manager [req-45580f68-6091-4380-94ca-46114181b02e req-9a0f2109-b145-4f86-8fd9-8929fc66631c service nova] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] No waiting events found dispatching network-vif-plugged-42768d69-c7da-43fb-b092-c5b41ac2d55c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:35:31 user nova-compute[71557]: WARNING nova.compute.manager [req-45580f68-6091-4380-94ca-46114181b02e req-9a0f2109-b145-4f86-8fd9-8929fc66631c service nova] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Received unexpected event network-vif-plugged-42768d69-c7da-43fb-b092-c5b41ac2d55c for instance with vm_state active and task_state None.
Apr 12 10:35:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:32 user nova-compute[71557]: DEBUG nova.network.neutron [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Successfully updated port: e1506948-cd44-4d78-a019-853199016229 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:35:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "refresh_cache-0f55cab4-8530-4be0-a91d-65671f0dccd9" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:35:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquired lock "refresh_cache-0f55cab4-8530-4be0-a91d-65671f0dccd9" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:35:32 user nova-compute[71557]: DEBUG nova.network.neutron [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:35:32 user nova-compute[71557]: DEBUG nova.compute.manager [req-8b0c428b-ef2e-46a2-b9dd-680875e3549a req-a9adb239-4e09-481d-8b5a-1901c272c8b6 service nova] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Received event network-changed-e1506948-cd44-4d78-a019-853199016229 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:35:32 user nova-compute[71557]: DEBUG nova.compute.manager [req-8b0c428b-ef2e-46a2-b9dd-680875e3549a req-a9adb239-4e09-481d-8b5a-1901c272c8b6 service nova] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Refreshing instance network info cache due to event network-changed-e1506948-cd44-4d78-a019-853199016229. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:35:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8b0c428b-ef2e-46a2-b9dd-680875e3549a req-a9adb239-4e09-481d-8b5a-1901c272c8b6 service nova] Acquiring lock "refresh_cache-0f55cab4-8530-4be0-a91d-65671f0dccd9" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:35:32 user nova-compute[71557]: DEBUG nova.network.neutron [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:35:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:32 user nova-compute[71557]: DEBUG nova.network.neutron [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Successfully created port: 7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:35:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "dc6eb5d4-d415-4459-a95b-5a470ec66586" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "dc6eb5d4-d415-4459-a95b-5a470ec66586" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:33 user nova-compute[71557]: DEBUG nova.compute.manager [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:35:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:33 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:35:33 user nova-compute[71557]: INFO nova.compute.claims [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Claim successful on node user
Apr 12 10:35:33 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:35:33 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:35:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:33 user nova-compute[71557]: DEBUG nova.compute.manager [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:35:33 user nova-compute[71557]: DEBUG nova.compute.manager [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:35:33 user nova-compute[71557]: DEBUG nova.network.neutron [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:35:33 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:35:33 user nova-compute[71557]: DEBUG nova.compute.manager [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:35:33 user nova-compute[71557]: DEBUG nova.compute.manager [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:35:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:35:33 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Creating image(s)
Apr 12 10:35:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "/opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "/opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.policy [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33d19bfc4894401cb664521438338b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '024682bfda5548b8b9b404c85dd55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.network.neutron [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Updating instance_info_cache with network_info: [{"id": "e1506948-cd44-4d78-a019-853199016229", "address": "fa:16:3e:a5:75:17", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1506948-cd", "ovs_interfaceid": "e1506948-cd44-4d78-a019-853199016229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.160s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Releasing lock "refresh_cache-0f55cab4-8530-4be0-a91d-65671f0dccd9" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.compute.manager [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Instance network_info: |[{"id": "e1506948-cd44-4d78-a019-853199016229", "address": "fa:16:3e:a5:75:17", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1506948-cd", "ovs_interfaceid": "e1506948-cd44-4d78-a019-853199016229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8b0c428b-ef2e-46a2-b9dd-680875e3549a req-a9adb239-4e09-481d-8b5a-1901c272c8b6 service nova] Acquired lock "refresh_cache-0f55cab4-8530-4be0-a91d-65671f0dccd9" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.network.neutron [req-8b0c428b-ef2e-46a2-b9dd-680875e3549a req-a9adb239-4e09-481d-8b5a-1901c272c8b6 service nova] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Refreshing network info cache for port e1506948-cd44-4d78-a019-853199016229 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Start _get_guest_xml network_info=[{"id": "e1506948-cd44-4d78-a019-853199016229", "address": "fa:16:3e:a5:75:17", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1506948-cd", "ovs_interfaceid": "e1506948-cd44-4d78-a019-853199016229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.compute.manager [req-bd7750f6-06b0-4e8e-9fef-959bd4d38354 req-3616d486-2f24-499f-b503-22ecc4b294db service nova] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Received event network-vif-plugged-42768d69-c7da-43fb-b092-c5b41ac2d55c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bd7750f6-06b0-4e8e-9fef-959bd4d38354 req-3616d486-2f24-499f-b503-22ecc4b294db service nova] Acquiring lock "270d5d4d-4df6-4ba5-9145-98f343fb3b0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bd7750f6-06b0-4e8e-9fef-959bd4d38354 req-3616d486-2f24-499f-b503-22ecc4b294db service nova] Lock "270d5d4d-4df6-4ba5-9145-98f343fb3b0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bd7750f6-06b0-4e8e-9fef-959bd4d38354 req-3616d486-2f24-499f-b503-22ecc4b294db service nova] Lock "270d5d4d-4df6-4ba5-9145-98f343fb3b0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.compute.manager [req-bd7750f6-06b0-4e8e-9fef-959bd4d38354 req-3616d486-2f24-499f-b503-22ecc4b294db service nova] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] No waiting events found dispatching network-vif-plugged-42768d69-c7da-43fb-b092-c5b41ac2d55c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:35:34 user nova-compute[71557]: WARNING nova.compute.manager [req-bd7750f6-06b0-4e8e-9fef-959bd4d38354 req-3616d486-2f24-499f-b503-22ecc4b294db service nova] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Received unexpected event network-vif-plugged-42768d69-c7da-43fb-b092-c5b41ac2d55c for instance with vm_state active and task_state None.
Apr 12 10:35:34 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:35:34 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-386378272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-386378272',id=2,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3789b59ccc704f86afac83af21fd84f9',ramdisk_id='',reservation_id='r-1nfkrdoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:35:27Z,user_data=None,user_id='ba49b947c74e48f3b161b6f9fce8b1c5',uuid=0f55cab4-8530-4be0-a91d-65671f0dccd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1506948-cd44-4d78-a019-853199016229", "address": "fa:16:3e:a5:75:17", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1506948-cd", "ovs_interfaceid": "e1506948-cd44-4d78-a019-853199016229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converting VIF {"id": "e1506948-cd44-4d78-a019-853199016229", "address": "fa:16:3e:a5:75:17", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1506948-cd", "ovs_interfaceid": "e1506948-cd44-4d78-a019-853199016229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:75:17,bridge_name='br-int',has_traffic_filtering=True,id=e1506948-cd44-4d78-a019-853199016229,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1506948-cd') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.objects.instance [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f55cab4-8530-4be0-a91d-65671f0dccd9 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.146s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:35:34 user nova-compute[71557]:   <uuid>0f55cab4-8530-4be0-a91d-65671f0dccd9</uuid>
Apr 12 10:35:34 user nova-compute[71557]:   <name>instance-00000002</name>
Apr 12 10:35:34 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:35:34 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:35:34 user nova-compute[71557]:   <metadata>
Apr 12 10:35:34 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:35:34 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:35:34 user nova-compute[71557]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-386378272</nova:name>
Apr 12 10:35:34 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:35:34</nova:creationTime>
Apr 12 10:35:34 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:35:34 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:35:34 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:35:34 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:35:34 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:35:34 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:35:34 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:35:34 user nova-compute[71557]:       <nova:owner>
Apr 12 10:35:34 user nova-compute[71557]:         <nova:user uuid="ba49b947c74e48f3b161b6f9fce8b1c5">tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member</nova:user>
Apr 12 10:35:34 user nova-compute[71557]:         <nova:project uuid="3789b59ccc704f86afac83af21fd84f9">tempest-ServerBootFromVolumeStableRescueTest-1826285115</nova:project>
Apr 12 10:35:34 user nova-compute[71557]:       </nova:owner>
Apr 12 10:35:34 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:35:34 user nova-compute[71557]:       <nova:ports>
Apr 12 10:35:34 user nova-compute[71557]:         <nova:port uuid="e1506948-cd44-4d78-a019-853199016229">
Apr 12 10:35:34 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 10:35:34 user nova-compute[71557]:         </nova:port>
Apr 12 10:35:34 user nova-compute[71557]:       </nova:ports>
Apr 12 10:35:34 user nova-compute[71557]:     </nova:instance>
Apr 12 10:35:34 user nova-compute[71557]:   </metadata>
Apr 12 10:35:34 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:35:34 user nova-compute[71557]:     <system>
Apr 12 10:35:34 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:35:34 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:35:34 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:35:34 user nova-compute[71557]:       <entry name="serial">0f55cab4-8530-4be0-a91d-65671f0dccd9</entry>
Apr 12 10:35:34 user nova-compute[71557]:       <entry name="uuid">0f55cab4-8530-4be0-a91d-65671f0dccd9</entry>
Apr 12 10:35:34 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:35:34 user nova-compute[71557]:     </system>
Apr 12 10:35:34 user nova-compute[71557]:   </sysinfo>
Apr 12 10:35:34 user nova-compute[71557]:   <os>
Apr 12 10:35:34 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:35:34 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:35:34 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:35:34 user nova-compute[71557]:   </os>
Apr 12 10:35:34 user nova-compute[71557]:   <features>
Apr 12 10:35:34 user nova-compute[71557]:     <acpi/>
Apr 12 10:35:34 user nova-compute[71557]:     <apic/>
Apr 12 10:35:34 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:35:34 user nova-compute[71557]:   </features>
Apr 12 10:35:34 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:35:34 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:35:34 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:35:34 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:35:34 user nova-compute[71557]:   </clock>
Apr 12 10:35:34 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:35:34 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:35:34 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:35:34 user nova-compute[71557]:   </cpu>
Apr 12 10:35:34 user nova-compute[71557]:   <devices>
Apr 12 10:35:34 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:35:34 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:35:34 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk"/>
Apr 12 10:35:34 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:35:34 user nova-compute[71557]:     </disk>
Apr 12 10:35:34 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:35:34 user nova-compute[71557]:       <mac address="fa:16:3e:a5:75:17"/>
Apr 12 10:35:34 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:35:34 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:35:34 user nova-compute[71557]:       <target dev="tape1506948-cd"/>
Apr 12 10:35:34 user nova-compute[71557]:     </interface>
Apr 12 10:35:34 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:35:34 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/console.log" append="off"/>
Apr 12 10:35:34 user nova-compute[71557]:     </serial>
Apr 12 10:35:34 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:35:34 user nova-compute[71557]:     <video>
Apr 12 10:35:34 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:35:34 user nova-compute[71557]:     </video>
Apr 12 10:35:34 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:35:34 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:35:34 user nova-compute[71557]:     </rng>
Apr 12 10:35:34 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:35:34 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:35:34 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:35:34 user nova-compute[71557]:     </memballoon>
Apr 12 10:35:34 user nova-compute[71557]:   </devices>
Apr 12 10:35:34 user nova-compute[71557]: </domain>
Apr 12 10:35:34 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-386378272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-386378272',id=2,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3789b59ccc704f86afac83af21fd84f9',ramdisk_id='',reservation_id='r-1nfkrdoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:35:27Z,user_data=None,user_id='ba49b947c74e48f3b161b6f9fce8b1c5',uuid=0f55cab4-8530-4be0-a91d-65671f0dccd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1506948-cd44-4d78-a019-853199016229", "address": "fa:16:3e:a5:75:17", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1506948-cd", "ovs_interfaceid": "e1506948-cd44-4d78-a019-853199016229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converting VIF {"id": "e1506948-cd44-4d78-a019-853199016229", "address": "fa:16:3e:a5:75:17", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1506948-cd", "ovs_interfaceid": "e1506948-cd44-4d78-a019-853199016229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:75:17,bridge_name='br-int',has_traffic_filtering=True,id=e1506948-cd44-4d78-a019-853199016229,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1506948-cd') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG os_vif [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:75:17,bridge_name='br-int',has_traffic_filtering=True,id=e1506948-cd44-4d78-a019-853199016229,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1506948-cd') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk 1073741824" returned: 0 in 0.067s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1506948-cd, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape1506948-cd, col_values=(('external_ids', {'iface-id': 'e1506948-cd44-4d78-a019-853199016229', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:75:17', 'vm-uuid': '0f55cab4-8530-4be0-a91d-65671f0dccd9'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:34 user nova-compute[71557]: INFO os_vif [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:75:17,bridge_name='br-int',has_traffic_filtering=True,id=e1506948-cd44-4d78-a019-853199016229,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1506948-cd')
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] No VIF found with MAC fa:16:3e:a5:75:17, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.148s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Cannot resize image /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.objects.instance [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lazy-loading 'migration_context' on Instance uuid dc6eb5d4-d415-4459-a95b-5a470ec66586 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Ensure instance console log exists: /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:35 user nova-compute[71557]: DEBUG nova.network.neutron [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Successfully created port: fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:35:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "c4d49077-b100-4630-b4f8-00c3daffb9e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "c4d49077-b100-4630-b4f8-00c3daffb9e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:35 user nova-compute[71557]: DEBUG nova.compute.manager [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:35:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:35 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:35:35 user nova-compute[71557]: INFO nova.compute.claims [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Claim successful on node user
Apr 12 10:35:35 user nova-compute[71557]: DEBUG nova.network.neutron [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Successfully updated port: 7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:35:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:35:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquired lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:35:35 user nova-compute[71557]: DEBUG nova.network.neutron [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:35:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:35 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:35:35 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:35:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:35 user nova-compute[71557]: DEBUG nova.compute.manager [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG nova.network.neutron [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG nova.compute.manager [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG nova.network.neutron [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:35:36 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:35:36 user nova-compute[71557]: DEBUG nova.compute.manager [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-67a8f498-0359-425d-8111-8e003089eff1 req-ad7b09f3-21ae-4fbf-8468-fb06b8b3242a service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received event network-changed-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-67a8f498-0359-425d-8111-8e003089eff1 req-ad7b09f3-21ae-4fbf-8468-fb06b8b3242a service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Refreshing instance network info cache due to event network-changed-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-67a8f498-0359-425d-8111-8e003089eff1 req-ad7b09f3-21ae-4fbf-8468-fb06b8b3242a service nova] Acquiring lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG nova.network.neutron [req-8b0c428b-ef2e-46a2-b9dd-680875e3549a req-a9adb239-4e09-481d-8b5a-1901c272c8b6 service nova] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Updated VIF entry in instance network info cache for port e1506948-cd44-4d78-a019-853199016229. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG nova.network.neutron [req-8b0c428b-ef2e-46a2-b9dd-680875e3549a req-a9adb239-4e09-481d-8b5a-1901c272c8b6 service nova] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Updating instance_info_cache with network_info: [{"id": "e1506948-cd44-4d78-a019-853199016229", "address": "fa:16:3e:a5:75:17", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1506948-cd", "ovs_interfaceid": "e1506948-cd44-4d78-a019-853199016229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8b0c428b-ef2e-46a2-b9dd-680875e3549a req-a9adb239-4e09-481d-8b5a-1901c272c8b6 service nova] Releasing lock "refresh_cache-0f55cab4-8530-4be0-a91d-65671f0dccd9" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG nova.compute.manager [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:35:36 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Creating image(s)
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4d49077-b100-4630-b4f8-00c3daffb9e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "/opt/stack/data/nova/instances/c4d49077-b100-4630-b4f8-00c3daffb9e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "/opt/stack/data/nova/instances/c4d49077-b100-4630-b4f8-00c3daffb9e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG nova.policy [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3766c8ddd6ae4fdd9d4aa6929cc080cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3dbf247dab94f6eb32e7808314d420a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.175s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.174s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/c4d49077-b100-4630-b4f8-00c3daffb9e3/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/c4d49077-b100-4630-b4f8-00c3daffb9e3/disk 1073741824" returned: 0 in 0.047s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-3b738a4f-54db-45a8-bba8-e396e739643c req-a63f6363-803e-4c32-8e9b-fe88abe91c22 service nova] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Received event network-vif-plugged-e1506948-cd44-4d78-a019-853199016229 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3b738a4f-54db-45a8-bba8-e396e739643c req-a63f6363-803e-4c32-8e9b-fe88abe91c22 service nova] Acquiring lock "0f55cab4-8530-4be0-a91d-65671f0dccd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3b738a4f-54db-45a8-bba8-e396e739643c req-a63f6363-803e-4c32-8e9b-fe88abe91c22 service nova] Lock "0f55cab4-8530-4be0-a91d-65671f0dccd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3b738a4f-54db-45a8-bba8-e396e739643c req-a63f6363-803e-4c32-8e9b-fe88abe91c22 service nova] Lock "0f55cab4-8530-4be0-a91d-65671f0dccd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-3b738a4f-54db-45a8-bba8-e396e739643c req-a63f6363-803e-4c32-8e9b-fe88abe91c22 service nova] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] No waiting events found dispatching network-vif-plugged-e1506948-cd44-4d78-a019-853199016229 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:35:36 user nova-compute[71557]: WARNING nova.compute.manager [req-3b738a4f-54db-45a8-bba8-e396e739643c req-a63f6363-803e-4c32-8e9b-fe88abe91c22 service nova] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Received unexpected event network-vif-plugged-e1506948-cd44-4d78-a019-853199016229 for instance with vm_state building and task_state spawning.
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.154s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c4d49077-b100-4630-b4f8-00c3daffb9e3/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d49077-b100-4630-b4f8-00c3daffb9e3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG nova.network.neutron [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Successfully created port: 54a35da3-7130-4116-a695-1d7da8f0afc8 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d49077-b100-4630-b4f8-00c3daffb9e3/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Cannot resize image /opt/stack/data/nova/instances/c4d49077-b100-4630-b4f8-00c3daffb9e3/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lazy-loading 'migration_context' on Instance uuid c4d49077-b100-4630-b4f8-00c3daffb9e3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Ensure instance console log exists: /opt/stack/data/nova/instances/c4d49077-b100-4630-b4f8-00c3daffb9e3/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.network.neutron [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Updating instance_info_cache with network_info: [{"id": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "address": "fa:16:3e:97:77:c8", "network": {"id": "4d3f7dc3-82bc-43ab-be83-29e8f16f99de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-970702209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce2a3bde13e464f8df0a41f30c240ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5c1f1e-a7", "ovs_interfaceid": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Releasing lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.compute.manager [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Instance network_info: |[{"id": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "address": "fa:16:3e:97:77:c8", "network": {"id": "4d3f7dc3-82bc-43ab-be83-29e8f16f99de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-970702209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce2a3bde13e464f8df0a41f30c240ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5c1f1e-a7", "ovs_interfaceid": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-67a8f498-0359-425d-8111-8e003089eff1 req-ad7b09f3-21ae-4fbf-8468-fb06b8b3242a service nova] Acquired lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.network.neutron [req-67a8f498-0359-425d-8111-8e003089eff1 req-ad7b09f3-21ae-4fbf-8468-fb06b8b3242a service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Refreshing network info cache for port 7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Start _get_guest_xml network_info=[{"id": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "address": "fa:16:3e:97:77:c8", "network": {"id": "4d3f7dc3-82bc-43ab-be83-29e8f16f99de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-970702209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce2a3bde13e464f8df0a41f30c240ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5c1f1e-a7", "ovs_interfaceid": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:35:37 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:35:37 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1850921758',display_name='tempest-ServerStableDeviceRescueTest-server-1850921758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1850921758',id=3,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6J/cK5G69Rc1hFnFymuRzf/sxnh8tJeZCIsgDUrpU33tRNE8M9FW28e93IetT70vO+0CYZlhg4APAc6iRcEFv6hlCiC5vyIOseX+/85okbnJjZIoECICRAjLKoMj3fbA==',key_name='tempest-keypair-1741756118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ce2a3bde13e464f8df0a41f30c240ab',ramdisk_id='',reservation_id='r-fqkamg1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1030861486',owner_user_name='tempest-ServerStableDeviceRescueTest-1030861486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:35:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c757f04065b9488ba75739e59d7be377',uuid=f47d368e-3870-49d0-8522-a94991ec4ba5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "address": "fa:16:3e:97:77:c8", "network": {"id": "4d3f7dc3-82bc-43ab-be83-29e8f16f99de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-970702209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce2a3bde13e464f8df0a41f30c240ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5c1f1e-a7", "ovs_interfaceid": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Converting VIF {"id": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "address": "fa:16:3e:97:77:c8", "network": {"id": "4d3f7dc3-82bc-43ab-be83-29e8f16f99de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-970702209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce2a3bde13e464f8df0a41f30c240ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5c1f1e-a7", "ovs_interfaceid": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:77:c8,bridge_name='br-int',has_traffic_filtering=True,id=7b5c1f1e-a739-4317-a7b5-d6d884d32f7c,network=Network(4d3f7dc3-82bc-43ab-be83-29e8f16f99de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b5c1f1e-a7') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.objects.instance [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lazy-loading 'pci_devices' on Instance uuid f47d368e-3870-49d0-8522-a94991ec4ba5 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:35:37 user nova-compute[71557]:   <uuid>f47d368e-3870-49d0-8522-a94991ec4ba5</uuid>
Apr 12 10:35:37 user nova-compute[71557]:   <name>instance-00000003</name>
Apr 12 10:35:37 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:35:37 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:35:37 user nova-compute[71557]:   <metadata>
Apr 12 10:35:37 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:35:37 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:35:37 user nova-compute[71557]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1850921758</nova:name>
Apr 12 10:35:37 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:35:37</nova:creationTime>
Apr 12 10:35:37 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:35:37 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:35:37 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:35:37 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:35:37 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:35:37 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:35:37 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:35:37 user nova-compute[71557]:       <nova:owner>
Apr 12 10:35:37 user nova-compute[71557]:         <nova:user uuid="c757f04065b9488ba75739e59d7be377">tempest-ServerStableDeviceRescueTest-1030861486-project-member</nova:user>
Apr 12 10:35:37 user nova-compute[71557]:         <nova:project uuid="8ce2a3bde13e464f8df0a41f30c240ab">tempest-ServerStableDeviceRescueTest-1030861486</nova:project>
Apr 12 10:35:37 user nova-compute[71557]:       </nova:owner>
Apr 12 10:35:37 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:35:37 user nova-compute[71557]:       <nova:ports>
Apr 12 10:35:37 user nova-compute[71557]:         <nova:port uuid="7b5c1f1e-a739-4317-a7b5-d6d884d32f7c">
Apr 12 10:35:37 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 10:35:37 user nova-compute[71557]:         </nova:port>
Apr 12 10:35:37 user nova-compute[71557]:       </nova:ports>
Apr 12 10:35:37 user nova-compute[71557]:     </nova:instance>
Apr 12 10:35:37 user nova-compute[71557]:   </metadata>
Apr 12 10:35:37 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:35:37 user nova-compute[71557]:     <system>
Apr 12 10:35:37 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:35:37 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:35:37 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:35:37 user nova-compute[71557]:       <entry name="serial">f47d368e-3870-49d0-8522-a94991ec4ba5</entry>
Apr 12 10:35:37 user nova-compute[71557]:       <entry name="uuid">f47d368e-3870-49d0-8522-a94991ec4ba5</entry>
Apr 12 10:35:37 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:35:37 user nova-compute[71557]:     </system>
Apr 12 10:35:37 user nova-compute[71557]:   </sysinfo>
Apr 12 10:35:37 user nova-compute[71557]:   <os>
Apr 12 10:35:37 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:35:37 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:35:37 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:35:37 user nova-compute[71557]:   </os>
Apr 12 10:35:37 user nova-compute[71557]:   <features>
Apr 12 10:35:37 user nova-compute[71557]:     <acpi/>
Apr 12 10:35:37 user nova-compute[71557]:     <apic/>
Apr 12 10:35:37 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:35:37 user nova-compute[71557]:   </features>
Apr 12 10:35:37 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:35:37 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:35:37 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:35:37 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:35:37 user nova-compute[71557]:   </clock>
Apr 12 10:35:37 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:35:37 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:35:37 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:35:37 user nova-compute[71557]:   </cpu>
Apr 12 10:35:37 user nova-compute[71557]:   <devices>
Apr 12 10:35:37 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:35:37 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:35:37 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk"/>
Apr 12 10:35:37 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:35:37 user nova-compute[71557]:     </disk>
Apr 12 10:35:37 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:35:37 user nova-compute[71557]:       <mac address="fa:16:3e:97:77:c8"/>
Apr 12 10:35:37 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:35:37 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:35:37 user nova-compute[71557]:       <target dev="tap7b5c1f1e-a7"/>
Apr 12 10:35:37 user nova-compute[71557]:     </interface>
Apr 12 10:35:37 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:35:37 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/console.log" append="off"/>
Apr 12 10:35:37 user nova-compute[71557]:     </serial>
Apr 12 10:35:37 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:35:37 user nova-compute[71557]:     <video>
Apr 12 10:35:37 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:35:37 user nova-compute[71557]:     </video>
Apr 12 10:35:37 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:35:37 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:35:37 user nova-compute[71557]:     </rng>
Apr 12 10:35:37 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:35:37 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:35:37 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:35:37 user nova-compute[71557]:     </memballoon>
Apr 12 10:35:37 user nova-compute[71557]:   </devices>
Apr 12 10:35:37 user nova-compute[71557]: </domain>
Apr 12 10:35:37 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1850921758',display_name='tempest-ServerStableDeviceRescueTest-server-1850921758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1850921758',id=3,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6J/cK5G69Rc1hFnFymuRzf/sxnh8tJeZCIsgDUrpU33tRNE8M9FW28e93IetT70vO+0CYZlhg4APAc6iRcEFv6hlCiC5vyIOseX+/85okbnJjZIoECICRAjLKoMj3fbA==',key_name='tempest-keypair-1741756118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ce2a3bde13e464f8df0a41f30c240ab',ramdisk_id='',reservation_id='r-fqkamg1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1030861486',owner_user_name='tempest-ServerStableDeviceRescueTest-1030861486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:35:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c757f04065b9488ba75739e59d7be377',uuid=f47d368e-3870-49d0-8522-a94991ec4ba5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "address": "fa:16:3e:97:77:c8", "network": {"id": "4d3f7dc3-82bc-43ab-be83-29e8f16f99de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-970702209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce2a3bde13e464f8df0a41f30c240ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5c1f1e-a7", "ovs_interfaceid": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Converting VIF {"id": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "address": "fa:16:3e:97:77:c8", "network": {"id": "4d3f7dc3-82bc-43ab-be83-29e8f16f99de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-970702209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce2a3bde13e464f8df0a41f30c240ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5c1f1e-a7", "ovs_interfaceid": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:77:c8,bridge_name='br-int',has_traffic_filtering=True,id=7b5c1f1e-a739-4317-a7b5-d6d884d32f7c,network=Network(4d3f7dc3-82bc-43ab-be83-29e8f16f99de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b5c1f1e-a7') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG os_vif [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:77:c8,bridge_name='br-int',has_traffic_filtering=True,id=7b5c1f1e-a739-4317-a7b5-d6d884d32f7c,network=Network(4d3f7dc3-82bc-43ab-be83-29e8f16f99de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b5c1f1e-a7') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b5c1f1e-a7, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7b5c1f1e-a7, col_values=(('external_ids', {'iface-id': '7b5c1f1e-a739-4317-a7b5-d6d884d32f7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:77:c8', 'vm-uuid': 'f47d368e-3870-49d0-8522-a94991ec4ba5'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:37 user nova-compute[71557]: INFO os_vif [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:77:c8,bridge_name='br-int',has_traffic_filtering=True,id=7b5c1f1e-a739-4317-a7b5-d6d884d32f7c,network=Network(4d3f7dc3-82bc-43ab-be83-29e8f16f99de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b5c1f1e-a7')
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] No VIF found with MAC fa:16:3e:97:77:c8, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:35:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.network.neutron [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Successfully updated port: fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquired lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.network.neutron [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.compute.manager [req-73983e20-7e6c-432c-9501-8410d8b72b34 req-1f6058f1-62d7-434e-8044-7830039c963c service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-changed-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.compute.manager [req-73983e20-7e6c-432c-9501-8410d8b72b34 req-1f6058f1-62d7-434e-8044-7830039c963c service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Refreshing instance network info cache due to event network-changed-fa1878d2-9c1a-4fda-bdbf-b226839d56c4. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-73983e20-7e6c-432c-9501-8410d8b72b34 req-1f6058f1-62d7-434e-8044-7830039c963c service nova] Acquiring lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295738.119313, 0f55cab4-8530-4be0-a91d-65671f0dccd9 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:35:38 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] VM Resumed (Lifecycle Event)
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.compute.manager [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:35:38 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Instance spawned successfully.
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:38 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295738.1231112, 0f55cab4-8530-4be0-a91d-65671f0dccd9 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:35:38 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] VM Started (Lifecycle Event)
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.network.neutron [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:35:38 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:35:38 user nova-compute[71557]: INFO nova.compute.manager [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Took 11.21 seconds to spawn the instance on the hypervisor.
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.compute.manager [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:35:38 user nova-compute[71557]: INFO nova.compute.manager [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Took 12.04 seconds to build instance.
Apr 12 10:35:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-57dd6651-562e-456a-ab7a-693474da01d9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "0f55cab4-8530-4be0-a91d-65671f0dccd9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.305s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.compute.manager [req-b6edd93a-0dbf-482f-b818-a4c41ebb4b41 req-539a17b5-84a9-4c10-bff5-574dfaaaf9d6 service nova] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Received event network-vif-plugged-e1506948-cd44-4d78-a019-853199016229 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b6edd93a-0dbf-482f-b818-a4c41ebb4b41 req-539a17b5-84a9-4c10-bff5-574dfaaaf9d6 service nova] Acquiring lock "0f55cab4-8530-4be0-a91d-65671f0dccd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b6edd93a-0dbf-482f-b818-a4c41ebb4b41 req-539a17b5-84a9-4c10-bff5-574dfaaaf9d6 service nova] Lock "0f55cab4-8530-4be0-a91d-65671f0dccd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b6edd93a-0dbf-482f-b818-a4c41ebb4b41 req-539a17b5-84a9-4c10-bff5-574dfaaaf9d6 service nova] Lock "0f55cab4-8530-4be0-a91d-65671f0dccd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.compute.manager [req-b6edd93a-0dbf-482f-b818-a4c41ebb4b41 req-539a17b5-84a9-4c10-bff5-574dfaaaf9d6 service nova] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] No waiting events found dispatching network-vif-plugged-e1506948-cd44-4d78-a019-853199016229 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:35:38 user nova-compute[71557]: WARNING nova.compute.manager [req-b6edd93a-0dbf-482f-b818-a4c41ebb4b41 req-539a17b5-84a9-4c10-bff5-574dfaaaf9d6 service nova] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Received unexpected event network-vif-plugged-e1506948-cd44-4d78-a019-853199016229 for instance with vm_state active and task_state None.
Apr 12 10:35:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.network.neutron [req-67a8f498-0359-425d-8111-8e003089eff1 req-ad7b09f3-21ae-4fbf-8468-fb06b8b3242a service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Updated VIF entry in instance network info cache for port 7b5c1f1e-a739-4317-a7b5-d6d884d32f7c. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG nova.network.neutron [req-67a8f498-0359-425d-8111-8e003089eff1 req-ad7b09f3-21ae-4fbf-8468-fb06b8b3242a service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Updating instance_info_cache with network_info: [{"id": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "address": "fa:16:3e:97:77:c8", "network": {"id": "4d3f7dc3-82bc-43ab-be83-29e8f16f99de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-970702209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce2a3bde13e464f8df0a41f30c240ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5c1f1e-a7", "ovs_interfaceid": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:35:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-67a8f498-0359-425d-8111-8e003089eff1 req-ad7b09f3-21ae-4fbf-8468-fb06b8b3242a service nova] Releasing lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.network.neutron [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Updating instance_info_cache with network_info: [{"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Releasing lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Instance network_info: |[{"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-73983e20-7e6c-432c-9501-8410d8b72b34 req-1f6058f1-62d7-434e-8044-7830039c963c service nova] Acquired lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.network.neutron [req-73983e20-7e6c-432c-9501-8410d8b72b34 req-1f6058f1-62d7-434e-8044-7830039c963c service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Refreshing network info cache for port fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Start _get_guest_xml network_info=[{"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:35:39 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:35:39 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1895953867',display_name='tempest-ServerActionsTestJSON-server-1895953867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1895953867',id=4,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSPzZAK4K6WfKgZv6ul+nJ2Lzppw5IMfK0+f9KuGByC6XjA59WQJmgMTCh01/yWlwW8qMjnx6gjYen9tQKzYmdVo3Z1KGqS/wGYHKKDRVeNNONzm9HfPYp2EDH6xyugDA==',key_name='tempest-keypair-1241183546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32235c67d269474b879a58269c1bfb28',ramdisk_id='',reservation_id='r-m0f2y2eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2042231427',owner_user_name='tempest-ServerActionsTestJSON-2042231427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:35:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0059d31539304ffcb5214b408751cd4f',uuid=bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converting VIF {"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.objects.instance [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'pci_devices' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:35:39 user nova-compute[71557]:   <uuid>bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b</uuid>
Apr 12 10:35:39 user nova-compute[71557]:   <name>instance-00000004</name>
Apr 12 10:35:39 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:35:39 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:35:39 user nova-compute[71557]:   <metadata>
Apr 12 10:35:39 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:35:39 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:35:39 user nova-compute[71557]:       <nova:name>tempest-ServerActionsTestJSON-server-1895953867</nova:name>
Apr 12 10:35:39 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:35:39</nova:creationTime>
Apr 12 10:35:39 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:35:39 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:35:39 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:35:39 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:35:39 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:35:39 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:35:39 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:35:39 user nova-compute[71557]:       <nova:owner>
Apr 12 10:35:39 user nova-compute[71557]:         <nova:user uuid="0059d31539304ffcb5214b408751cd4f">tempest-ServerActionsTestJSON-2042231427-project-member</nova:user>
Apr 12 10:35:39 user nova-compute[71557]:         <nova:project uuid="32235c67d269474b879a58269c1bfb28">tempest-ServerActionsTestJSON-2042231427</nova:project>
Apr 12 10:35:39 user nova-compute[71557]:       </nova:owner>
Apr 12 10:35:39 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:35:39 user nova-compute[71557]:       <nova:ports>
Apr 12 10:35:39 user nova-compute[71557]:         <nova:port uuid="fa1878d2-9c1a-4fda-bdbf-b226839d56c4">
Apr 12 10:35:39 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 10:35:39 user nova-compute[71557]:         </nova:port>
Apr 12 10:35:39 user nova-compute[71557]:       </nova:ports>
Apr 12 10:35:39 user nova-compute[71557]:     </nova:instance>
Apr 12 10:35:39 user nova-compute[71557]:   </metadata>
Apr 12 10:35:39 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:35:39 user nova-compute[71557]:     <system>
Apr 12 10:35:39 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:35:39 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:35:39 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:35:39 user nova-compute[71557]:       <entry name="serial">bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b</entry>
Apr 12 10:35:39 user nova-compute[71557]:       <entry name="uuid">bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b</entry>
Apr 12 10:35:39 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:35:39 user nova-compute[71557]:     </system>
Apr 12 10:35:39 user nova-compute[71557]:   </sysinfo>
Apr 12 10:35:39 user nova-compute[71557]:   <os>
Apr 12 10:35:39 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:35:39 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:35:39 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:35:39 user nova-compute[71557]:   </os>
Apr 12 10:35:39 user nova-compute[71557]:   <features>
Apr 12 10:35:39 user nova-compute[71557]:     <acpi/>
Apr 12 10:35:39 user nova-compute[71557]:     <apic/>
Apr 12 10:35:39 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:35:39 user nova-compute[71557]:   </features>
Apr 12 10:35:39 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:35:39 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:35:39 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:35:39 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:35:39 user nova-compute[71557]:   </clock>
Apr 12 10:35:39 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:35:39 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:35:39 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:35:39 user nova-compute[71557]:   </cpu>
Apr 12 10:35:39 user nova-compute[71557]:   <devices>
Apr 12 10:35:39 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:35:39 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:35:39 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk"/>
Apr 12 10:35:39 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:35:39 user nova-compute[71557]:     </disk>
Apr 12 10:35:39 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:35:39 user nova-compute[71557]:       <mac address="fa:16:3e:fe:65:45"/>
Apr 12 10:35:39 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:35:39 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:35:39 user nova-compute[71557]:       <target dev="tapfa1878d2-9c"/>
Apr 12 10:35:39 user nova-compute[71557]:     </interface>
Apr 12 10:35:39 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:35:39 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/console.log" append="off"/>
Apr 12 10:35:39 user nova-compute[71557]:     </serial>
Apr 12 10:35:39 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:35:39 user nova-compute[71557]:     <video>
Apr 12 10:35:39 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:35:39 user nova-compute[71557]:     </video>
Apr 12 10:35:39 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:35:39 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:35:39 user nova-compute[71557]:     </rng>
Apr 12 10:35:39 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:35:39 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:35:39 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:35:39 user nova-compute[71557]:     </memballoon>
Apr 12 10:35:39 user nova-compute[71557]:   </devices>
Apr 12 10:35:39 user nova-compute[71557]: </domain>
Apr 12 10:35:39 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1895953867',display_name='tempest-ServerActionsTestJSON-server-1895953867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1895953867',id=4,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSPzZAK4K6WfKgZv6ul+nJ2Lzppw5IMfK0+f9KuGByC6XjA59WQJmgMTCh01/yWlwW8qMjnx6gjYen9tQKzYmdVo3Z1KGqS/wGYHKKDRVeNNONzm9HfPYp2EDH6xyugDA==',key_name='tempest-keypair-1241183546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32235c67d269474b879a58269c1bfb28',ramdisk_id='',reservation_id='r-m0f2y2eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2042231427',owner_user_name='tempest-ServerActionsTestJSON-2042231427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:35:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0059d31539304ffcb5214b408751cd4f',uuid=bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converting VIF {"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG os_vif [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa1878d2-9c, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfa1878d2-9c, col_values=(('external_ids', {'iface-id': 'fa1878d2-9c1a-4fda-bdbf-b226839d56c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:65:45', 'vm-uuid': 'bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:39 user nova-compute[71557]: INFO os_vif [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c')
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.network.neutron [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Successfully created port: 74fb6084-85b5-4bc1-9933-5886e90483fd {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] No VIF found with MAC fa:16:3e:fe:65:45, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-4d4c775c-cc23-4483-b03c-3b5009ab36b1 req-cea3566a-433a-4711-9158-e90ec05fd4e2 service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received event network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4d4c775c-cc23-4483-b03c-3b5009ab36b1 req-cea3566a-433a-4711-9158-e90ec05fd4e2 service nova] Acquiring lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4d4c775c-cc23-4483-b03c-3b5009ab36b1 req-cea3566a-433a-4711-9158-e90ec05fd4e2 service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4d4c775c-cc23-4483-b03c-3b5009ab36b1 req-cea3566a-433a-4711-9158-e90ec05fd4e2 service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-4d4c775c-cc23-4483-b03c-3b5009ab36b1 req-cea3566a-433a-4711-9158-e90ec05fd4e2 service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] No waiting events found dispatching network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:35:39 user nova-compute[71557]: WARNING nova.compute.manager [req-4d4c775c-cc23-4483-b03c-3b5009ab36b1 req-cea3566a-433a-4711-9158-e90ec05fd4e2 service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received unexpected event network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance with vm_state building and task_state spawning.
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.network.neutron [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Successfully updated port: 54a35da3-7130-4116-a695-1d7da8f0afc8 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "refresh_cache-dc6eb5d4-d415-4459-a95b-5a470ec66586" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquired lock "refresh_cache-dc6eb5d4-d415-4459-a95b-5a470ec66586" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:35:39 user nova-compute[71557]: DEBUG nova.network.neutron [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:35:40 user nova-compute[71557]: DEBUG nova.network.neutron [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:35:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.network.neutron [req-73983e20-7e6c-432c-9501-8410d8b72b34 req-1f6058f1-62d7-434e-8044-7830039c963c service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Updated VIF entry in instance network info cache for port fa1878d2-9c1a-4fda-bdbf-b226839d56c4. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.network.neutron [req-73983e20-7e6c-432c-9501-8410d8b72b34 req-1f6058f1-62d7-434e-8044-7830039c963c service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Updating instance_info_cache with network_info: [{"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-73983e20-7e6c-432c-9501-8410d8b72b34 req-1f6058f1-62d7-434e-8044-7830039c963c service nova] Releasing lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.network.neutron [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Updating instance_info_cache with network_info: [{"id": "54a35da3-7130-4116-a695-1d7da8f0afc8", "address": "fa:16:3e:0a:f4:49", "network": {"id": "092e35b9-633d-403b-a777-df3e8c018327", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667523639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "024682bfda5548b8b9b404c85dd55b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a35da3-71", "ovs_interfaceid": "54a35da3-7130-4116-a695-1d7da8f0afc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Releasing lock "refresh_cache-dc6eb5d4-d415-4459-a95b-5a470ec66586" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Instance network_info: |[{"id": "54a35da3-7130-4116-a695-1d7da8f0afc8", "address": "fa:16:3e:0a:f4:49", "network": {"id": "092e35b9-633d-403b-a777-df3e8c018327", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667523639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "024682bfda5548b8b9b404c85dd55b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a35da3-71", "ovs_interfaceid": "54a35da3-7130-4116-a695-1d7da8f0afc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Start _get_guest_xml network_info=[{"id": "54a35da3-7130-4116-a695-1d7da8f0afc8", "address": "fa:16:3e:0a:f4:49", "network": {"id": "092e35b9-633d-403b-a777-df3e8c018327", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667523639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "024682bfda5548b8b9b404c85dd55b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a35da3-71", "ovs_interfaceid": "54a35da3-7130-4116-a695-1d7da8f0afc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295741.485624, f47d368e-3870-49d0-8522-a94991ec4ba5 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:35:41 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] VM Resumed (Lifecycle Event)
Apr 12 10:35:41 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:35:41 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-620034952',display_name='tempest-ServersNegativeTestJSON-server-620034952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-620034952',id=5,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='024682bfda5548b8b9b404c85dd55b34',ramdisk_id='',reservation_id='r-nyhjshj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-563292074',owner_user_name='tempest-ServersNegativeTestJSON-563292074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:35:34Z,user_data=None,user_id='33d19bfc4894401cb664521438338b9a',uuid=dc6eb5d4-d415-4459-a95b-5a470ec66586,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54a35da3-7130-4116-a695-1d7da8f0afc8", "address": "fa:16:3e:0a:f4:49", "network": {"id": "092e35b9-633d-403b-a777-df3e8c018327", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667523639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "024682bfda5548b8b9b404c85dd55b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a35da3-71", "ovs_interfaceid": "54a35da3-7130-4116-a695-1d7da8f0afc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Converting VIF {"id": "54a35da3-7130-4116-a695-1d7da8f0afc8", "address": "fa:16:3e:0a:f4:49", "network": {"id": "092e35b9-633d-403b-a777-df3e8c018327", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667523639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "024682bfda5548b8b9b404c85dd55b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a35da3-71", "ovs_interfaceid": "54a35da3-7130-4116-a695-1d7da8f0afc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:f4:49,bridge_name='br-int',has_traffic_filtering=True,id=54a35da3-7130-4116-a695-1d7da8f0afc8,network=Network(092e35b9-633d-403b-a777-df3e8c018327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a35da3-71') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.objects.instance [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lazy-loading 'pci_devices' on Instance uuid dc6eb5d4-d415-4459-a95b-5a470ec66586 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:35:41 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Instance spawned successfully.
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:35:41 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295741.490164, f47d368e-3870-49d0-8522-a94991ec4ba5 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:35:41 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] VM Started (Lifecycle Event)
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:35:41 user nova-compute[71557]:   <uuid>dc6eb5d4-d415-4459-a95b-5a470ec66586</uuid>
Apr 12 10:35:41 user nova-compute[71557]:   <name>instance-00000005</name>
Apr 12 10:35:41 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:35:41 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:35:41 user nova-compute[71557]:   <metadata>
Apr 12 10:35:41 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:35:41 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:35:41 user nova-compute[71557]:       <nova:name>tempest-ServersNegativeTestJSON-server-620034952</nova:name>
Apr 12 10:35:41 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:35:41</nova:creationTime>
Apr 12 10:35:41 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:35:41 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:35:41 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:35:41 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:35:41 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:35:41 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:35:41 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:35:41 user nova-compute[71557]:       <nova:owner>
Apr 12 10:35:41 user nova-compute[71557]:         <nova:user uuid="33d19bfc4894401cb664521438338b9a">tempest-ServersNegativeTestJSON-563292074-project-member</nova:user>
Apr 12 10:35:41 user nova-compute[71557]:         <nova:project uuid="024682bfda5548b8b9b404c85dd55b34">tempest-ServersNegativeTestJSON-563292074</nova:project>
Apr 12 10:35:41 user nova-compute[71557]:       </nova:owner>
Apr 12 10:35:41 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:35:41 user nova-compute[71557]:       <nova:ports>
Apr 12 10:35:41 user nova-compute[71557]:         <nova:port uuid="54a35da3-7130-4116-a695-1d7da8f0afc8">
Apr 12 10:35:41 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 10:35:41 user nova-compute[71557]:         </nova:port>
Apr 12 10:35:41 user nova-compute[71557]:       </nova:ports>
Apr 12 10:35:41 user nova-compute[71557]:     </nova:instance>
Apr 12 10:35:41 user nova-compute[71557]:   </metadata>
Apr 12 10:35:41 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:35:41 user nova-compute[71557]:     <system>
Apr 12 10:35:41 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:35:41 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:35:41 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:35:41 user nova-compute[71557]:       <entry name="serial">dc6eb5d4-d415-4459-a95b-5a470ec66586</entry>
Apr 12 10:35:41 user nova-compute[71557]:       <entry name="uuid">dc6eb5d4-d415-4459-a95b-5a470ec66586</entry>
Apr 12 10:35:41 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:35:41 user nova-compute[71557]:     </system>
Apr 12 10:35:41 user nova-compute[71557]:   </sysinfo>
Apr 12 10:35:41 user nova-compute[71557]:   <os>
Apr 12 10:35:41 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:35:41 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:35:41 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:35:41 user nova-compute[71557]:   </os>
Apr 12 10:35:41 user nova-compute[71557]:   <features>
Apr 12 10:35:41 user nova-compute[71557]:     <acpi/>
Apr 12 10:35:41 user nova-compute[71557]:     <apic/>
Apr 12 10:35:41 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:35:41 user nova-compute[71557]:   </features>
Apr 12 10:35:41 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:35:41 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:35:41 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:35:41 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:35:41 user nova-compute[71557]:   </clock>
Apr 12 10:35:41 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:35:41 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:35:41 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:35:41 user nova-compute[71557]:   </cpu>
Apr 12 10:35:41 user nova-compute[71557]:   <devices>
Apr 12 10:35:41 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:35:41 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:35:41 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk"/>
Apr 12 10:35:41 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:35:41 user nova-compute[71557]:     </disk>
Apr 12 10:35:41 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:35:41 user nova-compute[71557]:       <mac address="fa:16:3e:0a:f4:49"/>
Apr 12 10:35:41 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:35:41 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:35:41 user nova-compute[71557]:       <target dev="tap54a35da3-71"/>
Apr 12 10:35:41 user nova-compute[71557]:     </interface>
Apr 12 10:35:41 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:35:41 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/console.log" append="off"/>
Apr 12 10:35:41 user nova-compute[71557]:     </serial>
Apr 12 10:35:41 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:35:41 user nova-compute[71557]:     <video>
Apr 12 10:35:41 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:35:41 user nova-compute[71557]:     </video>
Apr 12 10:35:41 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:35:41 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:35:41 user nova-compute[71557]:     </rng>
Apr 12 10:35:41 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:35:41 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:35:41 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:35:41 user nova-compute[71557]:     </memballoon>
Apr 12 10:35:41 user nova-compute[71557]:   </devices>
Apr 12 10:35:41 user nova-compute[71557]: </domain>
Apr 12 10:35:41 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-620034952',display_name='tempest-ServersNegativeTestJSON-server-620034952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-620034952',id=5,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='024682bfda5548b8b9b404c85dd55b34',ramdisk_id='',reservation_id='r-nyhjshj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-563292074',owner_user_name='tempest-ServersNegativeTestJSON-563292074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:35:34Z,user_data=None,user_id='33d19bfc4894401cb664521438338b9a',uuid=dc6eb5d4-d415-4459-a95b-5a470ec66586,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54a35da3-7130-4116-a695-1d7da8f0afc8", "address": "fa:16:3e:0a:f4:49", "network": {"id": "092e35b9-633d-403b-a777-df3e8c018327", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667523639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "024682bfda5548b8b9b404c85dd55b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a35da3-71", "ovs_interfaceid": "54a35da3-7130-4116-a695-1d7da8f0afc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Converting VIF {"id": "54a35da3-7130-4116-a695-1d7da8f0afc8", "address": "fa:16:3e:0a:f4:49", "network": {"id": "092e35b9-633d-403b-a777-df3e8c018327", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667523639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "024682bfda5548b8b9b404c85dd55b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a35da3-71", "ovs_interfaceid": "54a35da3-7130-4116-a695-1d7da8f0afc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:f4:49,bridge_name='br-int',has_traffic_filtering=True,id=54a35da3-7130-4116-a695-1d7da8f0afc8,network=Network(092e35b9-633d-403b-a777-df3e8c018327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a35da3-71') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG os_vif [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:f4:49,bridge_name='br-int',has_traffic_filtering=True,id=54a35da3-7130-4116-a695-1d7da8f0afc8,network=Network(092e35b9-633d-403b-a777-df3e8c018327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a35da3-71') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54a35da3-71, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap54a35da3-71, col_values=(('external_ids', {'iface-id': '54a35da3-7130-4116-a695-1d7da8f0afc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:f4:49', 'vm-uuid': 'dc6eb5d4-d415-4459-a95b-5a470ec66586'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:35:41 user nova-compute[71557]: INFO os_vif [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:f4:49,bridge_name='br-int',has_traffic_filtering=True,id=54a35da3-7130-4116-a695-1d7da8f0afc8,network=Network(092e35b9-633d-403b-a777-df3e8c018327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a35da3-71')
Apr 12 10:35:41 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] No VIF found with MAC fa:16:3e:0a:f4:49, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-080792fe-5b27-462f-9611-91c00d8d8405 req-3ec603cd-1ac2-4f64-86aa-cd28e7e51245 service nova] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Received event network-changed-54a35da3-7130-4116-a695-1d7da8f0afc8 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-080792fe-5b27-462f-9611-91c00d8d8405 req-3ec603cd-1ac2-4f64-86aa-cd28e7e51245 service nova] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Refreshing instance network info cache due to event network-changed-54a35da3-7130-4116-a695-1d7da8f0afc8. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-080792fe-5b27-462f-9611-91c00d8d8405 req-3ec603cd-1ac2-4f64-86aa-cd28e7e51245 service nova] Acquiring lock "refresh_cache-dc6eb5d4-d415-4459-a95b-5a470ec66586" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-080792fe-5b27-462f-9611-91c00d8d8405 req-3ec603cd-1ac2-4f64-86aa-cd28e7e51245 service nova] Acquired lock "refresh_cache-dc6eb5d4-d415-4459-a95b-5a470ec66586" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.network.neutron [req-080792fe-5b27-462f-9611-91c00d8d8405 req-3ec603cd-1ac2-4f64-86aa-cd28e7e51245 service nova] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Refreshing network info cache for port 54a35da3-7130-4116-a695-1d7da8f0afc8 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:35:41 user nova-compute[71557]: INFO nova.compute.manager [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Took 12.46 seconds to spawn the instance on the hypervisor.
Apr 12 10:35:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:35:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:42 user nova-compute[71557]: INFO nova.compute.manager [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Took 13.26 seconds to build instance.
Apr 12 10:35:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1e64b4f0-dcc3-42e0-854e-3b2a233f812a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.419s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:42 user nova-compute[71557]: DEBUG nova.network.neutron [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Successfully updated port: 74fb6084-85b5-4bc1-9933-5886e90483fd {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:35:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "refresh_cache-c4d49077-b100-4630-b4f8-00c3daffb9e3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:35:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquired lock "refresh_cache-c4d49077-b100-4630-b4f8-00c3daffb9e3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:35:42 user nova-compute[71557]: DEBUG nova.network.neutron [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-a991313a-6416-4f65-ace7-89408c08db3b req-e9fa2483-d88b-4497-a287-f7a3f85c14e6 service nova] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Received event network-changed-74fb6084-85b5-4bc1-9933-5886e90483fd {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-a991313a-6416-4f65-ace7-89408c08db3b req-e9fa2483-d88b-4497-a287-f7a3f85c14e6 service nova] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Refreshing instance network info cache due to event network-changed-74fb6084-85b5-4bc1-9933-5886e90483fd. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a991313a-6416-4f65-ace7-89408c08db3b req-e9fa2483-d88b-4497-a287-f7a3f85c14e6 service nova] Acquiring lock "refresh_cache-c4d49077-b100-4630-b4f8-00c3daffb9e3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.network.neutron [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.compute.manager [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295743.4892628, bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:35:43 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] VM Resumed (Lifecycle Event)
Apr 12 10:35:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:43 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Instance spawned successfully.
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:43 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295743.4896245, bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:35:43 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] VM Started (Lifecycle Event)
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:35:43 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:35:43 user nova-compute[71557]: INFO nova.compute.manager [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Took 12.66 seconds to spawn the instance on the hypervisor.
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.compute.manager [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:35:43 user nova-compute[71557]: INFO nova.compute.manager [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Took 13.75 seconds to build instance.
Apr 12 10:35:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-eae302ae-45f2-4c65-ba48-acc5fe219ab1 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.921s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-adad66c0-8d87-4854-9ae2-7a817f4fbc47 req-cc03ba97-1e50-4c84-aef1-fbcd0bcc3c5c service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-adad66c0-8d87-4854-9ae2-7a817f4fbc47 req-cc03ba97-1e50-4c84-aef1-fbcd0bcc3c5c service nova] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-adad66c0-8d87-4854-9ae2-7a817f4fbc47 req-cc03ba97-1e50-4c84-aef1-fbcd0bcc3c5c service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-adad66c0-8d87-4854-9ae2-7a817f4fbc47 req-cc03ba97-1e50-4c84-aef1-fbcd0bcc3c5c service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-adad66c0-8d87-4854-9ae2-7a817f4fbc47 req-cc03ba97-1e50-4c84-aef1-fbcd0bcc3c5c service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] No waiting events found dispatching network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:35:43 user nova-compute[71557]: WARNING nova.compute.manager [req-adad66c0-8d87-4854-9ae2-7a817f4fbc47 req-cc03ba97-1e50-4c84-aef1-fbcd0bcc3c5c service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received unexpected event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance with vm_state active and task_state None.
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.network.neutron [req-080792fe-5b27-462f-9611-91c00d8d8405 req-3ec603cd-1ac2-4f64-86aa-cd28e7e51245 service nova] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Updated VIF entry in instance network info cache for port 54a35da3-7130-4116-a695-1d7da8f0afc8. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:35:43 user nova-compute[71557]: DEBUG nova.network.neutron [req-080792fe-5b27-462f-9611-91c00d8d8405 req-3ec603cd-1ac2-4f64-86aa-cd28e7e51245 service nova] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Updating instance_info_cache with network_info: [{"id": "54a35da3-7130-4116-a695-1d7da8f0afc8", "address": "fa:16:3e:0a:f4:49", "network": {"id": "092e35b9-633d-403b-a777-df3e8c018327", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667523639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "024682bfda5548b8b9b404c85dd55b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a35da3-71", "ovs_interfaceid": "54a35da3-7130-4116-a695-1d7da8f0afc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-080792fe-5b27-462f-9611-91c00d8d8405 req-3ec603cd-1ac2-4f64-86aa-cd28e7e51245 service nova] Releasing lock "refresh_cache-dc6eb5d4-d415-4459-a95b-5a470ec66586" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-080792fe-5b27-462f-9611-91c00d8d8405 req-3ec603cd-1ac2-4f64-86aa-cd28e7e51245 service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received event network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-080792fe-5b27-462f-9611-91c00d8d8405 req-3ec603cd-1ac2-4f64-86aa-cd28e7e51245 service nova] Acquiring lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-080792fe-5b27-462f-9611-91c00d8d8405 req-3ec603cd-1ac2-4f64-86aa-cd28e7e51245 service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-080792fe-5b27-462f-9611-91c00d8d8405 req-3ec603cd-1ac2-4f64-86aa-cd28e7e51245 service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-080792fe-5b27-462f-9611-91c00d8d8405 req-3ec603cd-1ac2-4f64-86aa-cd28e7e51245 service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] No waiting events found dispatching network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:35:44 user nova-compute[71557]: WARNING nova.compute.manager [req-080792fe-5b27-462f-9611-91c00d8d8405 req-3ec603cd-1ac2-4f64-86aa-cd28e7e51245 service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received unexpected event network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance with vm_state building and task_state spawning.
Apr 12 10:35:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.network.neutron [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Updating instance_info_cache with network_info: [{"id": "74fb6084-85b5-4bc1-9933-5886e90483fd", "address": "fa:16:3e:b3:a3:5b", "network": {"id": "46ccc4d2-269b-4c92-bee1-2846e0d47bd3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1788525491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3dbf247dab94f6eb32e7808314d420a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fb6084-85", "ovs_interfaceid": "74fb6084-85b5-4bc1-9933-5886e90483fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Releasing lock "refresh_cache-c4d49077-b100-4630-b4f8-00c3daffb9e3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.compute.manager [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Instance network_info: |[{"id": "74fb6084-85b5-4bc1-9933-5886e90483fd", "address": "fa:16:3e:b3:a3:5b", "network": {"id": "46ccc4d2-269b-4c92-bee1-2846e0d47bd3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1788525491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3dbf247dab94f6eb32e7808314d420a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fb6084-85", "ovs_interfaceid": "74fb6084-85b5-4bc1-9933-5886e90483fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a991313a-6416-4f65-ace7-89408c08db3b req-e9fa2483-d88b-4497-a287-f7a3f85c14e6 service nova] Acquired lock "refresh_cache-c4d49077-b100-4630-b4f8-00c3daffb9e3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.network.neutron [req-a991313a-6416-4f65-ace7-89408c08db3b req-e9fa2483-d88b-4497-a287-f7a3f85c14e6 service nova] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Refreshing network info cache for port 74fb6084-85b5-4bc1-9933-5886e90483fd {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Start _get_guest_xml network_info=[{"id": "74fb6084-85b5-4bc1-9933-5886e90483fd", "address": "fa:16:3e:b3:a3:5b", "network": {"id": "46ccc4d2-269b-4c92-bee1-2846e0d47bd3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1788525491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3dbf247dab94f6eb32e7808314d420a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fb6084-85", "ovs_interfaceid": "74fb6084-85b5-4bc1-9933-5886e90483fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:35:44 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:35:44 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1259808068',display_name='tempest-DeleteServersTestJSON-server-1259808068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1259808068',id=6,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3dbf247dab94f6eb32e7808314d420a',ramdisk_id='',reservation_id='r-h5k2a1zx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1147850030',owner_user_name='tempest-DeleteServersTestJSON-1147850030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:35:36Z,user_data=None,user_id='3766c8ddd6ae4fdd9d4aa6929cc080cf',uuid=c4d49077-b100-4630-b4f8-00c3daffb9e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74fb6084-85b5-4bc1-9933-5886e90483fd", "address": "fa:16:3e:b3:a3:5b", "network": {"id": "46ccc4d2-269b-4c92-bee1-2846e0d47bd3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1788525491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3dbf247dab94f6eb32e7808314d420a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fb6084-85", "ovs_interfaceid": "74fb6084-85b5-4bc1-9933-5886e90483fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Converting VIF {"id": "74fb6084-85b5-4bc1-9933-5886e90483fd", "address": "fa:16:3e:b3:a3:5b", "network": {"id": "46ccc4d2-269b-4c92-bee1-2846e0d47bd3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1788525491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3dbf247dab94f6eb32e7808314d420a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fb6084-85", "ovs_interfaceid": "74fb6084-85b5-4bc1-9933-5886e90483fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a3:5b,bridge_name='br-int',has_traffic_filtering=True,id=74fb6084-85b5-4bc1-9933-5886e90483fd,network=Network(46ccc4d2-269b-4c92-bee1-2846e0d47bd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fb6084-85') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lazy-loading 'pci_devices' on Instance uuid c4d49077-b100-4630-b4f8-00c3daffb9e3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:35:44 user nova-compute[71557]:   <uuid>c4d49077-b100-4630-b4f8-00c3daffb9e3</uuid>
Apr 12 10:35:44 user nova-compute[71557]:   <name>instance-00000006</name>
Apr 12 10:35:44 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:35:44 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:35:44 user nova-compute[71557]:   <metadata>
Apr 12 10:35:44 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:35:44 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:35:44 user nova-compute[71557]:       <nova:name>tempest-DeleteServersTestJSON-server-1259808068</nova:name>
Apr 12 10:35:44 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:35:44</nova:creationTime>
Apr 12 10:35:44 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:35:44 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:35:44 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:35:44 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:35:44 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:35:44 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:35:44 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:35:44 user nova-compute[71557]:       <nova:owner>
Apr 12 10:35:44 user nova-compute[71557]:         <nova:user uuid="3766c8ddd6ae4fdd9d4aa6929cc080cf">tempest-DeleteServersTestJSON-1147850030-project-member</nova:user>
Apr 12 10:35:44 user nova-compute[71557]:         <nova:project uuid="d3dbf247dab94f6eb32e7808314d420a">tempest-DeleteServersTestJSON-1147850030</nova:project>
Apr 12 10:35:44 user nova-compute[71557]:       </nova:owner>
Apr 12 10:35:44 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:35:44 user nova-compute[71557]:       <nova:ports>
Apr 12 10:35:44 user nova-compute[71557]:         <nova:port uuid="74fb6084-85b5-4bc1-9933-5886e90483fd">
Apr 12 10:35:44 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 10:35:44 user nova-compute[71557]:         </nova:port>
Apr 12 10:35:44 user nova-compute[71557]:       </nova:ports>
Apr 12 10:35:44 user nova-compute[71557]:     </nova:instance>
Apr 12 10:35:44 user nova-compute[71557]:   </metadata>
Apr 12 10:35:44 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:35:44 user nova-compute[71557]:     <system>
Apr 12 10:35:44 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:35:44 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:35:44 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:35:44 user nova-compute[71557]:       <entry name="serial">c4d49077-b100-4630-b4f8-00c3daffb9e3</entry>
Apr 12 10:35:44 user nova-compute[71557]:       <entry name="uuid">c4d49077-b100-4630-b4f8-00c3daffb9e3</entry>
Apr 12 10:35:44 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:35:44 user nova-compute[71557]:     </system>
Apr 12 10:35:44 user nova-compute[71557]:   </sysinfo>
Apr 12 10:35:44 user nova-compute[71557]:   <os>
Apr 12 10:35:44 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:35:44 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:35:44 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:35:44 user nova-compute[71557]:   </os>
Apr 12 10:35:44 user nova-compute[71557]:   <features>
Apr 12 10:35:44 user nova-compute[71557]:     <acpi/>
Apr 12 10:35:44 user nova-compute[71557]:     <apic/>
Apr 12 10:35:44 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:35:44 user nova-compute[71557]:   </features>
Apr 12 10:35:44 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:35:44 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:35:44 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:35:44 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:35:44 user nova-compute[71557]:   </clock>
Apr 12 10:35:44 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:35:44 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:35:44 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:35:44 user nova-compute[71557]:   </cpu>
Apr 12 10:35:44 user nova-compute[71557]:   <devices>
Apr 12 10:35:44 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:35:44 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:35:44 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/c4d49077-b100-4630-b4f8-00c3daffb9e3/disk"/>
Apr 12 10:35:44 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:35:44 user nova-compute[71557]:     </disk>
Apr 12 10:35:44 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:35:44 user nova-compute[71557]:       <mac address="fa:16:3e:b3:a3:5b"/>
Apr 12 10:35:44 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:35:44 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:35:44 user nova-compute[71557]:       <target dev="tap74fb6084-85"/>
Apr 12 10:35:44 user nova-compute[71557]:     </interface>
Apr 12 10:35:44 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:35:44 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/c4d49077-b100-4630-b4f8-00c3daffb9e3/console.log" append="off"/>
Apr 12 10:35:44 user nova-compute[71557]:     </serial>
Apr 12 10:35:44 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:35:44 user nova-compute[71557]:     <video>
Apr 12 10:35:44 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:35:44 user nova-compute[71557]:     </video>
Apr 12 10:35:44 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:35:44 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:35:44 user nova-compute[71557]:     </rng>
Apr 12 10:35:44 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:35:44 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:35:44 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:35:44 user nova-compute[71557]:     </memballoon>
Apr 12 10:35:44 user nova-compute[71557]:   </devices>
Apr 12 10:35:44 user nova-compute[71557]: </domain>
Apr 12 10:35:44 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1259808068',display_name='tempest-DeleteServersTestJSON-server-1259808068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1259808068',id=6,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3dbf247dab94f6eb32e7808314d420a',ramdisk_id='',reservation_id='r-h5k2a1zx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1147850030',owner_user_name='tempest-DeleteServersTestJSON-1147850030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:35:36Z,user_data=None,user_id='3766c8ddd6ae4fdd9d4aa6929cc080cf',uuid=c4d49077-b100-4630-b4f8-00c3daffb9e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74fb6084-85b5-4bc1-9933-5886e90483fd", "address": "fa:16:3e:b3:a3:5b", "network": {"id": "46ccc4d2-269b-4c92-bee1-2846e0d47bd3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1788525491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3dbf247dab94f6eb32e7808314d420a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fb6084-85", "ovs_interfaceid": "74fb6084-85b5-4bc1-9933-5886e90483fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Converting VIF {"id": "74fb6084-85b5-4bc1-9933-5886e90483fd", "address": "fa:16:3e:b3:a3:5b", "network": {"id": "46ccc4d2-269b-4c92-bee1-2846e0d47bd3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1788525491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3dbf247dab94f6eb32e7808314d420a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fb6084-85", "ovs_interfaceid": "74fb6084-85b5-4bc1-9933-5886e90483fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a3:5b,bridge_name='br-int',has_traffic_filtering=True,id=74fb6084-85b5-4bc1-9933-5886e90483fd,network=Network(46ccc4d2-269b-4c92-bee1-2846e0d47bd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fb6084-85') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG os_vif [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a3:5b,bridge_name='br-int',has_traffic_filtering=True,id=74fb6084-85b5-4bc1-9933-5886e90483fd,network=Network(46ccc4d2-269b-4c92-bee1-2846e0d47bd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fb6084-85') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74fb6084-85, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74fb6084-85, col_values=(('external_ids', {'iface-id': '74fb6084-85b5-4bc1-9933-5886e90483fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:a3:5b', 'vm-uuid': 'c4d49077-b100-4630-b4f8-00c3daffb9e3'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:44 user nova-compute[71557]: INFO os_vif [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a3:5b,bridge_name='br-int',has_traffic_filtering=True,id=74fb6084-85b5-4bc1-9933-5886e90483fd,network=Network(46ccc4d2-269b-4c92-bee1-2846e0d47bd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fb6084-85')
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] No VIF found with MAC fa:16:3e:b3:a3:5b, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:35:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:45 user nova-compute[71557]: DEBUG nova.compute.manager [req-5900b30f-c26a-4e2c-85b3-27a6c4addca0 req-74219c4f-b98d-499e-958e-6cfa283ccd2d service nova] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Received event network-vif-plugged-54a35da3-7130-4116-a695-1d7da8f0afc8 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:35:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5900b30f-c26a-4e2c-85b3-27a6c4addca0 req-74219c4f-b98d-499e-958e-6cfa283ccd2d service nova] Acquiring lock "dc6eb5d4-d415-4459-a95b-5a470ec66586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5900b30f-c26a-4e2c-85b3-27a6c4addca0 req-74219c4f-b98d-499e-958e-6cfa283ccd2d service nova] Lock "dc6eb5d4-d415-4459-a95b-5a470ec66586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5900b30f-c26a-4e2c-85b3-27a6c4addca0 req-74219c4f-b98d-499e-958e-6cfa283ccd2d service nova] Lock "dc6eb5d4-d415-4459-a95b-5a470ec66586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:45 user nova-compute[71557]: DEBUG nova.compute.manager [req-5900b30f-c26a-4e2c-85b3-27a6c4addca0 req-74219c4f-b98d-499e-958e-6cfa283ccd2d service nova] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] No waiting events found dispatching network-vif-plugged-54a35da3-7130-4116-a695-1d7da8f0afc8 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:35:45 user nova-compute[71557]: WARNING nova.compute.manager [req-5900b30f-c26a-4e2c-85b3-27a6c4addca0 req-74219c4f-b98d-499e-958e-6cfa283ccd2d service nova] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Received unexpected event network-vif-plugged-54a35da3-7130-4116-a695-1d7da8f0afc8 for instance with vm_state building and task_state spawning.
Apr 12 10:35:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-11d33eea-7296-4dc4-9c57-abdc2e5c59e5 req-9f02a93e-c744-42cf-85df-f9625cd9c5f0 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:35:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-11d33eea-7296-4dc4-9c57-abdc2e5c59e5 req-9f02a93e-c744-42cf-85df-f9625cd9c5f0 service nova] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-11d33eea-7296-4dc4-9c57-abdc2e5c59e5 req-9f02a93e-c744-42cf-85df-f9625cd9c5f0 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-11d33eea-7296-4dc4-9c57-abdc2e5c59e5 req-9f02a93e-c744-42cf-85df-f9625cd9c5f0 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-11d33eea-7296-4dc4-9c57-abdc2e5c59e5 req-9f02a93e-c744-42cf-85df-f9625cd9c5f0 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] No waiting events found dispatching network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:35:46 user nova-compute[71557]: WARNING nova.compute.manager [req-11d33eea-7296-4dc4-9c57-abdc2e5c59e5 req-9f02a93e-c744-42cf-85df-f9625cd9c5f0 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received unexpected event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance with vm_state active and task_state None.
Apr 12 10:35:46 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295746.183685, dc6eb5d4-d415-4459-a95b-5a470ec66586 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:35:46 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] VM Resumed (Lifecycle Event)
Apr 12 10:35:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:35:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:35:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:35:46 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Instance spawned successfully.
Apr 12 10:35:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:35:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:35:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:46 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:35:46 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295746.1843164, dc6eb5d4-d415-4459-a95b-5a470ec66586 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:35:46 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] VM Started (Lifecycle Event)
Apr 12 10:35:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:35:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:35:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:46 user nova-compute[71557]: INFO nova.compute.manager [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Took 12.53 seconds to spawn the instance on the hypervisor.
Apr 12 10:35:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:35:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:46 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:35:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:46 user nova-compute[71557]: INFO nova.compute.manager [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Took 13.39 seconds to build instance.
Apr 12 10:35:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bf42c150-4720-43be-81fa-33cb9af8e962 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "dc6eb5d4-d415-4459-a95b-5a470ec66586" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.539s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:47 user nova-compute[71557]: DEBUG nova.network.neutron [req-a991313a-6416-4f65-ace7-89408c08db3b req-e9fa2483-d88b-4497-a287-f7a3f85c14e6 service nova] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Updated VIF entry in instance network info cache for port 74fb6084-85b5-4bc1-9933-5886e90483fd. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:35:47 user nova-compute[71557]: DEBUG nova.network.neutron [req-a991313a-6416-4f65-ace7-89408c08db3b req-e9fa2483-d88b-4497-a287-f7a3f85c14e6 service nova] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Updating instance_info_cache with network_info: [{"id": "74fb6084-85b5-4bc1-9933-5886e90483fd", "address": "fa:16:3e:b3:a3:5b", "network": {"id": "46ccc4d2-269b-4c92-bee1-2846e0d47bd3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1788525491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3dbf247dab94f6eb32e7808314d420a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fb6084-85", "ovs_interfaceid": "74fb6084-85b5-4bc1-9933-5886e90483fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:35:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a991313a-6416-4f65-ace7-89408c08db3b req-e9fa2483-d88b-4497-a287-f7a3f85c14e6 service nova] Releasing lock "refresh_cache-c4d49077-b100-4630-b4f8-00c3daffb9e3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:35:47 user nova-compute[71557]: DEBUG nova.compute.manager [req-f4766914-4d9e-43ab-97b5-61cd76dbd83e req-91a2866d-5912-47e5-b6ff-e1e0203ee8af service nova] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Received event network-vif-plugged-54a35da3-7130-4116-a695-1d7da8f0afc8 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:35:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f4766914-4d9e-43ab-97b5-61cd76dbd83e req-91a2866d-5912-47e5-b6ff-e1e0203ee8af service nova] Acquiring lock "dc6eb5d4-d415-4459-a95b-5a470ec66586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f4766914-4d9e-43ab-97b5-61cd76dbd83e req-91a2866d-5912-47e5-b6ff-e1e0203ee8af service nova] Lock "dc6eb5d4-d415-4459-a95b-5a470ec66586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f4766914-4d9e-43ab-97b5-61cd76dbd83e req-91a2866d-5912-47e5-b6ff-e1e0203ee8af service nova] Lock "dc6eb5d4-d415-4459-a95b-5a470ec66586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:47 user nova-compute[71557]: DEBUG nova.compute.manager [req-f4766914-4d9e-43ab-97b5-61cd76dbd83e req-91a2866d-5912-47e5-b6ff-e1e0203ee8af service nova] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] No waiting events found dispatching network-vif-plugged-54a35da3-7130-4116-a695-1d7da8f0afc8 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:35:47 user nova-compute[71557]: WARNING nova.compute.manager [req-f4766914-4d9e-43ab-97b5-61cd76dbd83e req-91a2866d-5912-47e5-b6ff-e1e0203ee8af service nova] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Received unexpected event network-vif-plugged-54a35da3-7130-4116-a695-1d7da8f0afc8 for instance with vm_state active and task_state None.
Apr 12 10:35:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:48 user nova-compute[71557]: DEBUG nova.compute.manager [req-bfa0d765-e758-4b71-80e5-560e9ba7a539 req-95d30c6b-e801-49c4-9175-f7e8d2a56619 service nova] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Received event network-vif-plugged-74fb6084-85b5-4bc1-9933-5886e90483fd {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:35:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bfa0d765-e758-4b71-80e5-560e9ba7a539 req-95d30c6b-e801-49c4-9175-f7e8d2a56619 service nova] Acquiring lock "c4d49077-b100-4630-b4f8-00c3daffb9e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bfa0d765-e758-4b71-80e5-560e9ba7a539 req-95d30c6b-e801-49c4-9175-f7e8d2a56619 service nova] Lock "c4d49077-b100-4630-b4f8-00c3daffb9e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bfa0d765-e758-4b71-80e5-560e9ba7a539 req-95d30c6b-e801-49c4-9175-f7e8d2a56619 service nova] Lock "c4d49077-b100-4630-b4f8-00c3daffb9e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:48 user nova-compute[71557]: DEBUG nova.compute.manager [req-bfa0d765-e758-4b71-80e5-560e9ba7a539 req-95d30c6b-e801-49c4-9175-f7e8d2a56619 service nova] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] No waiting events found dispatching network-vif-plugged-74fb6084-85b5-4bc1-9933-5886e90483fd {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:35:48 user nova-compute[71557]: WARNING nova.compute.manager [req-bfa0d765-e758-4b71-80e5-560e9ba7a539 req-95d30c6b-e801-49c4-9175-f7e8d2a56619 service nova] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Received unexpected event network-vif-plugged-74fb6084-85b5-4bc1-9933-5886e90483fd for instance with vm_state building and task_state spawning.
Apr 12 10:35:48 user nova-compute[71557]: DEBUG nova.compute.manager [req-bfa0d765-e758-4b71-80e5-560e9ba7a539 req-95d30c6b-e801-49c4-9175-f7e8d2a56619 service nova] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Received event network-vif-plugged-74fb6084-85b5-4bc1-9933-5886e90483fd {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:35:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bfa0d765-e758-4b71-80e5-560e9ba7a539 req-95d30c6b-e801-49c4-9175-f7e8d2a56619 service nova] Acquiring lock "c4d49077-b100-4630-b4f8-00c3daffb9e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bfa0d765-e758-4b71-80e5-560e9ba7a539 req-95d30c6b-e801-49c4-9175-f7e8d2a56619 service nova] Lock "c4d49077-b100-4630-b4f8-00c3daffb9e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bfa0d765-e758-4b71-80e5-560e9ba7a539 req-95d30c6b-e801-49c4-9175-f7e8d2a56619 service nova] Lock "c4d49077-b100-4630-b4f8-00c3daffb9e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:48 user nova-compute[71557]: DEBUG nova.compute.manager [req-bfa0d765-e758-4b71-80e5-560e9ba7a539 req-95d30c6b-e801-49c4-9175-f7e8d2a56619 service nova] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] No waiting events found dispatching network-vif-plugged-74fb6084-85b5-4bc1-9933-5886e90483fd {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:35:48 user nova-compute[71557]: WARNING nova.compute.manager [req-bfa0d765-e758-4b71-80e5-560e9ba7a539 req-95d30c6b-e801-49c4-9175-f7e8d2a56619 service nova] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Received unexpected event network-vif-plugged-74fb6084-85b5-4bc1-9933-5886e90483fd for instance with vm_state building and task_state spawning.
Apr 12 10:35:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:49 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295749.213793, c4d49077-b100-4630-b4f8-00c3daffb9e3 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:35:49 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] VM Resumed (Lifecycle Event)
Apr 12 10:35:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:35:49 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:35:49 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Instance spawned successfully.
Apr 12 10:35:49 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:35:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:35:49 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:49 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:49 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:49 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:49 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:49 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:35:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:35:49 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:35:49 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295749.2195463, c4d49077-b100-4630-b4f8-00c3daffb9e3 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:35:49 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] VM Started (Lifecycle Event)
Apr 12 10:35:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:35:49 user nova-compute[71557]: INFO nova.compute.manager [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Took 13.31 seconds to spawn the instance on the hypervisor.
Apr 12 10:35:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:35:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:35:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:49 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:35:49 user nova-compute[71557]: INFO nova.compute.manager [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Took 14.31 seconds to build instance.
Apr 12 10:35:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a32aea17-8cf7-4bcc-bd12-7833db74fdd7 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "c4d49077-b100-4630-b4f8-00c3daffb9e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.426s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "d04cb526-f77a-457c-90b1-3e5c202c0c30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "d04cb526-f77a-457c-90b1-3e5c202c0c30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:53 user nova-compute[71557]: DEBUG nova.compute.manager [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:35:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:53 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:35:53 user nova-compute[71557]: INFO nova.compute.claims [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Claim successful on node user
Apr 12 10:35:54 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:35:54 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:35:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.887s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:54 user nova-compute[71557]: DEBUG nova.compute.manager [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:35:54 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:35:54 user nova-compute[71557]: DEBUG nova.compute.manager [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:35:54 user nova-compute[71557]: DEBUG nova.network.neutron [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:35:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:54 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:35:54 user nova-compute[71557]: INFO nova.compute.claims [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Claim successful on node user
Apr 12 10:35:54 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:35:54 user nova-compute[71557]: DEBUG nova.compute.manager [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:35:54 user nova-compute[71557]: DEBUG nova.policy [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0a2243c6c9f431da846cc54ec181fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb8217b1544db384bebe1059848bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG nova.compute.manager [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:35:55 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Creating image(s)
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "/opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "/opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "/opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.222s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG nova.network.neutron [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:35:55 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:35:55 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.168s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk 1073741824" returned: 0 in 0.068s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG nova.policy [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80dbdeaccf84466286a6d85921e15a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b7b715cc24490ebd04d5469b6e07ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:35:55 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Creating image(s)
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "/opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "/opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.216s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.187s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Cannot resize image /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG nova.objects.instance [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lazy-loading 'migration_context' on Instance uuid d04cb526-f77a-457c-90b1-3e5c202c0c30 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Ensure instance console log exists: /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:56 user nova-compute[71557]: DEBUG nova.network.neutron [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Successfully created port: d6cd169f-f736-45da-96ea-c0b933c882a0 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:35:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.176s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/disk 1073741824" returned: 0 in 0.048s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.156s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:56 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:35:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:56 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Cannot resize image /opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:35:56 user nova-compute[71557]: DEBUG nova.objects.instance [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lazy-loading 'migration_context' on Instance uuid ea55f551-968e-4ece-a37a-c4128ce5e8cb {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:35:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:35:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Ensure instance console log exists: /opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:35:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:56 user nova-compute[71557]: DEBUG nova.network.neutron [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Successfully created port: 9d4bc0b7-4a2b-4354-a609-c673f6235cc7 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.network.neutron [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Successfully updated port: d6cd169f-f736-45da-96ea-c0b933c882a0 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "refresh_cache-d04cb526-f77a-457c-90b1-3e5c202c0c30" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquired lock "refresh_cache-d04cb526-f77a-457c-90b1-3e5c202c0c30" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.network.neutron [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.compute.manager [req-bc6c53c8-b38c-4356-a2b3-d8484e1976fe req-2c9b3f88-aeeb-45ab-ba9e-479cf07f4c5e service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Received event network-changed-d6cd169f-f736-45da-96ea-c0b933c882a0 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.compute.manager [req-bc6c53c8-b38c-4356-a2b3-d8484e1976fe req-2c9b3f88-aeeb-45ab-ba9e-479cf07f4c5e service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Refreshing instance network info cache due to event network-changed-d6cd169f-f736-45da-96ea-c0b933c882a0. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bc6c53c8-b38c-4356-a2b3-d8484e1976fe req-2c9b3f88-aeeb-45ab-ba9e-479cf07f4c5e service nova] Acquiring lock "refresh_cache-d04cb526-f77a-457c-90b1-3e5c202c0c30" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.network.neutron [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "3d261c30-0c6f-4d1b-8965-448dc019728e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "3d261c30-0c6f-4d1b-8965-448dc019728e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.compute.manager [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.network.neutron [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Successfully updated port: 9d4bc0b7-4a2b-4354-a609-c673f6235cc7 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "refresh_cache-ea55f551-968e-4ece-a37a-c4128ce5e8cb" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquired lock "refresh_cache-ea55f551-968e-4ece-a37a-c4128ce5e8cb" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.network.neutron [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.compute.manager [req-c4d65105-56e2-404e-81af-247198553065 req-828a4024-2386-47f1-9cef-4dfda7de9c68 service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Received event network-changed-9d4bc0b7-4a2b-4354-a609-c673f6235cc7 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.compute.manager [req-c4d65105-56e2-404e-81af-247198553065 req-828a4024-2386-47f1-9cef-4dfda7de9c68 service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Refreshing instance network info cache due to event network-changed-9d4bc0b7-4a2b-4354-a609-c673f6235cc7. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c4d65105-56e2-404e-81af-247198553065 req-828a4024-2386-47f1-9cef-4dfda7de9c68 service nova] Acquiring lock "refresh_cache-ea55f551-968e-4ece-a37a-c4128ce5e8cb" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.network.neutron [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:35:57 user nova-compute[71557]: INFO nova.compute.claims [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Claim successful on node user
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.network.neutron [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Updating instance_info_cache with network_info: [{"id": "d6cd169f-f736-45da-96ea-c0b933c882a0", "address": "fa:16:3e:ab:9d:90", "network": {"id": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-80273954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdb8217b1544db384bebe1059848bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6cd169f-f7", "ovs_interfaceid": "d6cd169f-f736-45da-96ea-c0b933c882a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Releasing lock "refresh_cache-d04cb526-f77a-457c-90b1-3e5c202c0c30" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.compute.manager [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Instance network_info: |[{"id": "d6cd169f-f736-45da-96ea-c0b933c882a0", "address": "fa:16:3e:ab:9d:90", "network": {"id": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-80273954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdb8217b1544db384bebe1059848bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6cd169f-f7", "ovs_interfaceid": "d6cd169f-f736-45da-96ea-c0b933c882a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bc6c53c8-b38c-4356-a2b3-d8484e1976fe req-2c9b3f88-aeeb-45ab-ba9e-479cf07f4c5e service nova] Acquired lock "refresh_cache-d04cb526-f77a-457c-90b1-3e5c202c0c30" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.network.neutron [req-bc6c53c8-b38c-4356-a2b3-d8484e1976fe req-2c9b3f88-aeeb-45ab-ba9e-479cf07f4c5e service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Refreshing network info cache for port d6cd169f-f736-45da-96ea-c0b933c882a0 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Start _get_guest_xml network_info=[{"id": "d6cd169f-f736-45da-96ea-c0b933c882a0", "address": "fa:16:3e:ab:9d:90", "network": {"id": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-80273954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdb8217b1544db384bebe1059848bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6cd169f-f7", "ovs_interfaceid": "d6cd169f-f736-45da-96ea-c0b933c882a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:35:57 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:35:57 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1739620818',display_name='tempest-VolumesAdminNegativeTest-server-1739620818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1739620818',id=7,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMgsXxSbNHsheROx1BN0FtpB7qh5cv6vGRZHqITyCcIMFeCSyHdp/zIeAbEJot43g3Qpc0b2rVShkKAnaPuRxIo8TB/FzjRPcSXAtyG2n+PHfMt7nLlc2G1KtiPlyKvOQ==',key_name='tempest-keypair-1653078636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cdb8217b1544db384bebe1059848bb6',ramdisk_id='',reservation_id='r-0z68g5tv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-375460860',owner_user_name='tempest-VolumesAdminNegativeTest-375460860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:35:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0a2243c6c9f431da846cc54ec181fcc',uuid=d04cb526-f77a-457c-90b1-3e5c202c0c30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6cd169f-f736-45da-96ea-c0b933c882a0", "address": "fa:16:3e:ab:9d:90", "network": {"id": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-80273954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdb8217b1544db384bebe1059848bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6cd169f-f7", "ovs_interfaceid": "d6cd169f-f736-45da-96ea-c0b933c882a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Converting VIF {"id": "d6cd169f-f736-45da-96ea-c0b933c882a0", "address": "fa:16:3e:ab:9d:90", "network": {"id": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-80273954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdb8217b1544db384bebe1059848bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6cd169f-f7", "ovs_interfaceid": "d6cd169f-f736-45da-96ea-c0b933c882a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=d6cd169f-f736-45da-96ea-c0b933c882a0,network=Network(66f6d7b6-8980-47a3-a7b6-f62db8264cd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6cd169f-f7') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.objects.instance [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lazy-loading 'pci_devices' on Instance uuid d04cb526-f77a-457c-90b1-3e5c202c0c30 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:35:57 user nova-compute[71557]:   <uuid>d04cb526-f77a-457c-90b1-3e5c202c0c30</uuid>
Apr 12 10:35:57 user nova-compute[71557]:   <name>instance-00000007</name>
Apr 12 10:35:57 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:35:57 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:35:57 user nova-compute[71557]:   <metadata>
Apr 12 10:35:57 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:35:57 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:35:57 user nova-compute[71557]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1739620818</nova:name>
Apr 12 10:35:57 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:35:57</nova:creationTime>
Apr 12 10:35:57 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:35:57 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:35:57 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:35:57 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:35:57 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:35:57 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:35:57 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:35:57 user nova-compute[71557]:       <nova:owner>
Apr 12 10:35:57 user nova-compute[71557]:         <nova:user uuid="a0a2243c6c9f431da846cc54ec181fcc">tempest-VolumesAdminNegativeTest-375460860-project-member</nova:user>
Apr 12 10:35:57 user nova-compute[71557]:         <nova:project uuid="0cdb8217b1544db384bebe1059848bb6">tempest-VolumesAdminNegativeTest-375460860</nova:project>
Apr 12 10:35:57 user nova-compute[71557]:       </nova:owner>
Apr 12 10:35:57 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:35:57 user nova-compute[71557]:       <nova:ports>
Apr 12 10:35:57 user nova-compute[71557]:         <nova:port uuid="d6cd169f-f736-45da-96ea-c0b933c882a0">
Apr 12 10:35:57 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 10:35:57 user nova-compute[71557]:         </nova:port>
Apr 12 10:35:57 user nova-compute[71557]:       </nova:ports>
Apr 12 10:35:57 user nova-compute[71557]:     </nova:instance>
Apr 12 10:35:57 user nova-compute[71557]:   </metadata>
Apr 12 10:35:57 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:35:57 user nova-compute[71557]:     <system>
Apr 12 10:35:57 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:35:57 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:35:57 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:35:57 user nova-compute[71557]:       <entry name="serial">d04cb526-f77a-457c-90b1-3e5c202c0c30</entry>
Apr 12 10:35:57 user nova-compute[71557]:       <entry name="uuid">d04cb526-f77a-457c-90b1-3e5c202c0c30</entry>
Apr 12 10:35:57 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:35:57 user nova-compute[71557]:     </system>
Apr 12 10:35:57 user nova-compute[71557]:   </sysinfo>
Apr 12 10:35:57 user nova-compute[71557]:   <os>
Apr 12 10:35:57 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:35:57 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:35:57 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:35:57 user nova-compute[71557]:   </os>
Apr 12 10:35:57 user nova-compute[71557]:   <features>
Apr 12 10:35:57 user nova-compute[71557]:     <acpi/>
Apr 12 10:35:57 user nova-compute[71557]:     <apic/>
Apr 12 10:35:57 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:35:57 user nova-compute[71557]:   </features>
Apr 12 10:35:57 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:35:57 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:35:57 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:35:57 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:35:57 user nova-compute[71557]:   </clock>
Apr 12 10:35:57 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:35:57 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:35:57 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:35:57 user nova-compute[71557]:   </cpu>
Apr 12 10:35:57 user nova-compute[71557]:   <devices>
Apr 12 10:35:57 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:35:57 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:35:57 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk"/>
Apr 12 10:35:57 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:35:57 user nova-compute[71557]:     </disk>
Apr 12 10:35:57 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:35:57 user nova-compute[71557]:       <mac address="fa:16:3e:ab:9d:90"/>
Apr 12 10:35:57 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:35:57 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:35:57 user nova-compute[71557]:       <target dev="tapd6cd169f-f7"/>
Apr 12 10:35:57 user nova-compute[71557]:     </interface>
Apr 12 10:35:57 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:35:57 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/console.log" append="off"/>
Apr 12 10:35:57 user nova-compute[71557]:     </serial>
Apr 12 10:35:57 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:35:57 user nova-compute[71557]:     <video>
Apr 12 10:35:57 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:35:57 user nova-compute[71557]:     </video>
Apr 12 10:35:57 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:35:57 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:35:57 user nova-compute[71557]:     </rng>
Apr 12 10:35:57 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:35:57 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:35:57 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:35:57 user nova-compute[71557]:     </memballoon>
Apr 12 10:35:57 user nova-compute[71557]:   </devices>
Apr 12 10:35:57 user nova-compute[71557]: </domain>
Apr 12 10:35:57 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1739620818',display_name='tempest-VolumesAdminNegativeTest-server-1739620818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1739620818',id=7,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMgsXxSbNHsheROx1BN0FtpB7qh5cv6vGRZHqITyCcIMFeCSyHdp/zIeAbEJot43g3Qpc0b2rVShkKAnaPuRxIo8TB/FzjRPcSXAtyG2n+PHfMt7nLlc2G1KtiPlyKvOQ==',key_name='tempest-keypair-1653078636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cdb8217b1544db384bebe1059848bb6',ramdisk_id='',reservation_id='r-0z68g5tv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-375460860',owner_user_name='tempest-VolumesAdminNegativeTest-375460860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:35:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0a2243c6c9f431da846cc54ec181fcc',uuid=d04cb526-f77a-457c-90b1-3e5c202c0c30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6cd169f-f736-45da-96ea-c0b933c882a0", "address": "fa:16:3e:ab:9d:90", "network": {"id": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-80273954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdb8217b1544db384bebe1059848bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6cd169f-f7", "ovs_interfaceid": "d6cd169f-f736-45da-96ea-c0b933c882a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Converting VIF {"id": "d6cd169f-f736-45da-96ea-c0b933c882a0", "address": "fa:16:3e:ab:9d:90", "network": {"id": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-80273954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdb8217b1544db384bebe1059848bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6cd169f-f7", "ovs_interfaceid": "d6cd169f-f736-45da-96ea-c0b933c882a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=d6cd169f-f736-45da-96ea-c0b933c882a0,network=Network(66f6d7b6-8980-47a3-a7b6-f62db8264cd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6cd169f-f7') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG os_vif [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=d6cd169f-f736-45da-96ea-c0b933c882a0,network=Network(66f6d7b6-8980-47a3-a7b6-f62db8264cd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6cd169f-f7') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6cd169f-f7, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6cd169f-f7, col_values=(('external_ids', {'iface-id': 'd6cd169f-f736-45da-96ea-c0b933c882a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:9d:90', 'vm-uuid': 'd04cb526-f77a-457c-90b1-3e5c202c0c30'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:57 user nova-compute[71557]: INFO os_vif [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=d6cd169f-f736-45da-96ea-c0b933c882a0,network=Network(66f6d7b6-8980-47a3-a7b6-f62db8264cd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6cd169f-f7')
Apr 12 10:35:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.network.neutron [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Updating instance_info_cache with network_info: [{"id": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7", "address": "fa:16:3e:e1:68:2b", "network": {"id": "d823a4e6-ea4f-426a-8afe-49a806172180", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1926857283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91b7b715cc24490ebd04d5469b6e07ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d4bc0b7-4a", "ovs_interfaceid": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Releasing lock "refresh_cache-ea55f551-968e-4ece-a37a-c4128ce5e8cb" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Instance network_info: |[{"id": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7", "address": "fa:16:3e:e1:68:2b", "network": {"id": "d823a4e6-ea4f-426a-8afe-49a806172180", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1926857283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91b7b715cc24490ebd04d5469b6e07ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d4bc0b7-4a", "ovs_interfaceid": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c4d65105-56e2-404e-81af-247198553065 req-828a4024-2386-47f1-9cef-4dfda7de9c68 service nova] Acquired lock "refresh_cache-ea55f551-968e-4ece-a37a-c4128ce5e8cb" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.network.neutron [req-c4d65105-56e2-404e-81af-247198553065 req-828a4024-2386-47f1-9cef-4dfda7de9c68 service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Refreshing network info cache for port 9d4bc0b7-4a2b-4354-a609-c673f6235cc7 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Start _get_guest_xml network_info=[{"id": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7", "address": "fa:16:3e:e1:68:2b", "network": {"id": "d823a4e6-ea4f-426a-8afe-49a806172180", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1926857283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91b7b715cc24490ebd04d5469b6e07ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d4bc0b7-4a", "ovs_interfaceid": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] No VIF found with MAC fa:16:3e:ab:9d:90, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:35:57 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:35:57 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1772353252',display_name='tempest-TestVolumeSwap-server-1772353252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1772353252',id=8,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjYthrvQaeO5iRkpOme8wd9BXslJ7+bH9c2pwqGtw4ONI6Nky7fjGEhK/7wi0cE/C4qW3/+u5Kcz2ZNhnlwfyEfLgpJZMopCh6eIMANDCmV2ciSVUgehPex6h7+lEIbHQ==',key_name='tempest-keypair-1030522827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91b7b715cc24490ebd04d5469b6e07ce',ramdisk_id='',reservation_id='r-t4jzxex9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1349998885',owner_user_name='tempest-TestVolumeSwap-1349998885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:35:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80dbdeaccf84466286a6d85921e15a3f',uuid=ea55f551-968e-4ece-a37a-c4128ce5e8cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7", "address": "fa:16:3e:e1:68:2b", "network": {"id": "d823a4e6-ea4f-426a-8afe-49a806172180", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1926857283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91b7b715cc24490ebd04d5469b6e07ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d4bc0b7-4a", "ovs_interfaceid": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Converting VIF {"id": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7", "address": "fa:16:3e:e1:68:2b", "network": {"id": "d823a4e6-ea4f-426a-8afe-49a806172180", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1926857283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91b7b715cc24490ebd04d5469b6e07ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d4bc0b7-4a", "ovs_interfaceid": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:68:2b,bridge_name='br-int',has_traffic_filtering=True,id=9d4bc0b7-4a2b-4354-a609-c673f6235cc7,network=Network(d823a4e6-ea4f-426a-8afe-49a806172180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d4bc0b7-4a') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:35:57 user nova-compute[71557]: DEBUG nova.objects.instance [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lazy-loading 'pci_devices' on Instance uuid ea55f551-968e-4ece-a37a-c4128ce5e8cb {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:35:58 user nova-compute[71557]:   <uuid>ea55f551-968e-4ece-a37a-c4128ce5e8cb</uuid>
Apr 12 10:35:58 user nova-compute[71557]:   <name>instance-00000008</name>
Apr 12 10:35:58 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:35:58 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:35:58 user nova-compute[71557]:   <metadata>
Apr 12 10:35:58 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:35:58 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:35:58 user nova-compute[71557]:       <nova:name>tempest-TestVolumeSwap-server-1772353252</nova:name>
Apr 12 10:35:58 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:35:57</nova:creationTime>
Apr 12 10:35:58 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:35:58 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:35:58 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:35:58 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:35:58 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:35:58 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:35:58 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:35:58 user nova-compute[71557]:       <nova:owner>
Apr 12 10:35:58 user nova-compute[71557]:         <nova:user uuid="80dbdeaccf84466286a6d85921e15a3f">tempest-TestVolumeSwap-1349998885-project-member</nova:user>
Apr 12 10:35:58 user nova-compute[71557]:         <nova:project uuid="91b7b715cc24490ebd04d5469b6e07ce">tempest-TestVolumeSwap-1349998885</nova:project>
Apr 12 10:35:58 user nova-compute[71557]:       </nova:owner>
Apr 12 10:35:58 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:35:58 user nova-compute[71557]:       <nova:ports>
Apr 12 10:35:58 user nova-compute[71557]:         <nova:port uuid="9d4bc0b7-4a2b-4354-a609-c673f6235cc7">
Apr 12 10:35:58 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 10:35:58 user nova-compute[71557]:         </nova:port>
Apr 12 10:35:58 user nova-compute[71557]:       </nova:ports>
Apr 12 10:35:58 user nova-compute[71557]:     </nova:instance>
Apr 12 10:35:58 user nova-compute[71557]:   </metadata>
Apr 12 10:35:58 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:35:58 user nova-compute[71557]:     <system>
Apr 12 10:35:58 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:35:58 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:35:58 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:35:58 user nova-compute[71557]:       <entry name="serial">ea55f551-968e-4ece-a37a-c4128ce5e8cb</entry>
Apr 12 10:35:58 user nova-compute[71557]:       <entry name="uuid">ea55f551-968e-4ece-a37a-c4128ce5e8cb</entry>
Apr 12 10:35:58 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:35:58 user nova-compute[71557]:     </system>
Apr 12 10:35:58 user nova-compute[71557]:   </sysinfo>
Apr 12 10:35:58 user nova-compute[71557]:   <os>
Apr 12 10:35:58 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:35:58 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:35:58 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:35:58 user nova-compute[71557]:   </os>
Apr 12 10:35:58 user nova-compute[71557]:   <features>
Apr 12 10:35:58 user nova-compute[71557]:     <acpi/>
Apr 12 10:35:58 user nova-compute[71557]:     <apic/>
Apr 12 10:35:58 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:35:58 user nova-compute[71557]:   </features>
Apr 12 10:35:58 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:35:58 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:35:58 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:35:58 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:35:58 user nova-compute[71557]:   </clock>
Apr 12 10:35:58 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:35:58 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:35:58 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:35:58 user nova-compute[71557]:   </cpu>
Apr 12 10:35:58 user nova-compute[71557]:   <devices>
Apr 12 10:35:58 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:35:58 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:35:58 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/disk"/>
Apr 12 10:35:58 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:35:58 user nova-compute[71557]:     </disk>
Apr 12 10:35:58 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:35:58 user nova-compute[71557]:       <mac address="fa:16:3e:e1:68:2b"/>
Apr 12 10:35:58 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:35:58 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:35:58 user nova-compute[71557]:       <target dev="tap9d4bc0b7-4a"/>
Apr 12 10:35:58 user nova-compute[71557]:     </interface>
Apr 12 10:35:58 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:35:58 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/console.log" append="off"/>
Apr 12 10:35:58 user nova-compute[71557]:     </serial>
Apr 12 10:35:58 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:35:58 user nova-compute[71557]:     <video>
Apr 12 10:35:58 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:35:58 user nova-compute[71557]:     </video>
Apr 12 10:35:58 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:35:58 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:35:58 user nova-compute[71557]:     </rng>
Apr 12 10:35:58 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:35:58 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:35:58 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:35:58 user nova-compute[71557]:     </memballoon>
Apr 12 10:35:58 user nova-compute[71557]:   </devices>
Apr 12 10:35:58 user nova-compute[71557]: </domain>
Apr 12 10:35:58 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1772353252',display_name='tempest-TestVolumeSwap-server-1772353252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1772353252',id=8,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjYthrvQaeO5iRkpOme8wd9BXslJ7+bH9c2pwqGtw4ONI6Nky7fjGEhK/7wi0cE/C4qW3/+u5Kcz2ZNhnlwfyEfLgpJZMopCh6eIMANDCmV2ciSVUgehPex6h7+lEIbHQ==',key_name='tempest-keypair-1030522827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91b7b715cc24490ebd04d5469b6e07ce',ramdisk_id='',reservation_id='r-t4jzxex9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1349998885',owner_user_name='tempest-TestVolumeSwap-1349998885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:35:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80dbdeaccf84466286a6d85921e15a3f',uuid=ea55f551-968e-4ece-a37a-c4128ce5e8cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7", "address": "fa:16:3e:e1:68:2b", "network": {"id": "d823a4e6-ea4f-426a-8afe-49a806172180", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1926857283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91b7b715cc24490ebd04d5469b6e07ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d4bc0b7-4a", "ovs_interfaceid": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Converting VIF {"id": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7", "address": "fa:16:3e:e1:68:2b", "network": {"id": "d823a4e6-ea4f-426a-8afe-49a806172180", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1926857283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91b7b715cc24490ebd04d5469b6e07ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d4bc0b7-4a", "ovs_interfaceid": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:68:2b,bridge_name='br-int',has_traffic_filtering=True,id=9d4bc0b7-4a2b-4354-a609-c673f6235cc7,network=Network(d823a4e6-ea4f-426a-8afe-49a806172180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d4bc0b7-4a') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG os_vif [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:68:2b,bridge_name='br-int',has_traffic_filtering=True,id=9d4bc0b7-4a2b-4354-a609-c673f6235cc7,network=Network(d823a4e6-ea4f-426a-8afe-49a806172180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d4bc0b7-4a') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d4bc0b7-4a, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9d4bc0b7-4a, col_values=(('external_ids', {'iface-id': '9d4bc0b7-4a2b-4354-a609-c673f6235cc7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:68:2b', 'vm-uuid': 'ea55f551-968e-4ece-a37a-c4128ce5e8cb'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:35:58 user nova-compute[71557]: INFO os_vif [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:68:2b,bridge_name='br-int',has_traffic_filtering=True,id=9d4bc0b7-4a2b-4354-a609-c673f6235cc7,network=Network(d823a4e6-ea4f-426a-8afe-49a806172180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d4bc0b7-4a')
Apr 12 10:35:58 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] No VIF found with MAC fa:16:3e:e1:68:2b, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.650s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG nova.compute.manager [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG nova.compute.manager [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG nova.network.neutron [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:35:58 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 12 10:35:58 user nova-compute[71557]: DEBUG nova.network.neutron [req-bc6c53c8-b38c-4356-a2b3-d8484e1976fe req-2c9b3f88-aeeb-45ab-ba9e-479cf07f4c5e service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Updated VIF entry in instance network info cache for port d6cd169f-f736-45da-96ea-c0b933c882a0. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG nova.network.neutron [req-bc6c53c8-b38c-4356-a2b3-d8484e1976fe req-2c9b3f88-aeeb-45ab-ba9e-479cf07f4c5e service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Updating instance_info_cache with network_info: [{"id": "d6cd169f-f736-45da-96ea-c0b933c882a0", "address": "fa:16:3e:ab:9d:90", "network": {"id": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-80273954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdb8217b1544db384bebe1059848bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6cd169f-f7", "ovs_interfaceid": "d6cd169f-f736-45da-96ea-c0b933c882a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG nova.compute.manager [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bc6c53c8-b38c-4356-a2b3-d8484e1976fe req-2c9b3f88-aeeb-45ab-ba9e-479cf07f4c5e service nova] Releasing lock "refresh_cache-d04cb526-f77a-457c-90b1-3e5c202c0c30" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG nova.policy [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2f1517aae734c8aa5b0acbc906af9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cede3351295e451283a0414aefea1de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG nova.compute.manager [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:35:58 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Creating image(s)
Apr 12 10:35:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "/opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "/opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "a268b5e47757c95f2ae0b3990cb7e372cee5726c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "a268b5e47757c95f2ae0b3990cb7e372cee5726c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG nova.network.neutron [req-c4d65105-56e2-404e-81af-247198553065 req-828a4024-2386-47f1-9cef-4dfda7de9c68 service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Updated VIF entry in instance network info cache for port 9d4bc0b7-4a2b-4354-a609-c673f6235cc7. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG nova.network.neutron [req-c4d65105-56e2-404e-81af-247198553065 req-828a4024-2386-47f1-9cef-4dfda7de9c68 service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Updating instance_info_cache with network_info: [{"id": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7", "address": "fa:16:3e:e1:68:2b", "network": {"id": "d823a4e6-ea4f-426a-8afe-49a806172180", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1926857283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91b7b715cc24490ebd04d5469b6e07ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d4bc0b7-4a", "ovs_interfaceid": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c4d65105-56e2-404e-81af-247198553065 req-828a4024-2386-47f1-9cef-4dfda7de9c68 service nova] Releasing lock "refresh_cache-ea55f551-968e-4ece-a37a-c4128ce5e8cb" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:35:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a268b5e47757c95f2ae0b3990cb7e372cee5726c.part --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a268b5e47757c95f2ae0b3990cb7e372cee5726c.part --force-share --output=json" returned: 0 in 0.138s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:59 user nova-compute[71557]: DEBUG nova.virt.images [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] 635d50f2-49f4-4589-b08b-3bd3f2f32a2e was qcow2, converting to raw {{(pid=71557) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 10:35:59 user nova-compute[71557]: DEBUG nova.privsep.utils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71557) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 10:35:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a268b5e47757c95f2ae0b3990cb7e372cee5726c.part /opt/stack/data/nova/instances/_base/a268b5e47757c95f2ae0b3990cb7e372cee5726c.converted {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a268b5e47757c95f2ae0b3990cb7e372cee5726c.part /opt/stack/data/nova/instances/_base/a268b5e47757c95f2ae0b3990cb7e372cee5726c.converted" returned: 0 in 0.145s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a268b5e47757c95f2ae0b3990cb7e372cee5726c.converted --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a268b5e47757c95f2ae0b3990cb7e372cee5726c.converted --force-share --output=json" returned: 0 in 0.160s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "a268b5e47757c95f2ae0b3990cb7e372cee5726c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.867s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a268b5e47757c95f2ae0b3990cb7e372cee5726c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:59 user nova-compute[71557]: DEBUG nova.network.neutron [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Successfully created port: 166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:35:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a268b5e47757c95f2ae0b3990cb7e372cee5726c --force-share --output=json" returned: 0 in 0.162s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "a268b5e47757c95f2ae0b3990cb7e372cee5726c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:35:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "a268b5e47757c95f2ae0b3990cb7e372cee5726c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:35:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a268b5e47757c95f2ae0b3990cb7e372cee5726c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a268b5e47757c95f2ae0b3990cb7e372cee5726c --force-share --output=json" returned: 0 in 0.152s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a268b5e47757c95f2ae0b3990cb7e372cee5726c,backing_fmt=raw /opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a268b5e47757c95f2ae0b3990cb7e372cee5726c,backing_fmt=raw /opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/disk 1073741824" returned: 0 in 0.071s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "a268b5e47757c95f2ae0b3990cb7e372cee5726c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:35:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a268b5e47757c95f2ae0b3990cb7e372cee5726c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:35:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a268b5e47757c95f2ae0b3990cb7e372cee5726c --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:35:59 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:35:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Cannot resize image /opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG nova.objects.instance [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lazy-loading 'migration_context' on Instance uuid 3d261c30-0c6f-4d1b-8965-448dc019728e {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Ensure instance console log exists: /opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-e6056bf8-0bba-4178-b9d1-97c3a021299f req-c70ed30d-22db-4b57-b25d-a3203e72141c service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Received event network-vif-plugged-d6cd169f-f736-45da-96ea-c0b933c882a0 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e6056bf8-0bba-4178-b9d1-97c3a021299f req-c70ed30d-22db-4b57-b25d-a3203e72141c service nova] Acquiring lock "d04cb526-f77a-457c-90b1-3e5c202c0c30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e6056bf8-0bba-4178-b9d1-97c3a021299f req-c70ed30d-22db-4b57-b25d-a3203e72141c service nova] Lock "d04cb526-f77a-457c-90b1-3e5c202c0c30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e6056bf8-0bba-4178-b9d1-97c3a021299f req-c70ed30d-22db-4b57-b25d-a3203e72141c service nova] Lock "d04cb526-f77a-457c-90b1-3e5c202c0c30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-e6056bf8-0bba-4178-b9d1-97c3a021299f req-c70ed30d-22db-4b57-b25d-a3203e72141c service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] No waiting events found dispatching network-vif-plugged-d6cd169f-f736-45da-96ea-c0b933c882a0 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:36:00 user nova-compute[71557]: WARNING nova.compute.manager [req-e6056bf8-0bba-4178-b9d1-97c3a021299f req-c70ed30d-22db-4b57-b25d-a3203e72141c service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Received unexpected event network-vif-plugged-d6cd169f-f736-45da-96ea-c0b933c882a0 for instance with vm_state building and task_state spawning.
Apr 12 10:36:00 user nova-compute[71557]: DEBUG nova.network.neutron [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Successfully updated port: 166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "refresh_cache-3d261c30-0c6f-4d1b-8965-448dc019728e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquired lock "refresh_cache-3d261c30-0c6f-4d1b-8965-448dc019728e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG nova.network.neutron [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-d90b2069-2c02-4671-9700-3ced10fb21a0 req-8232c9fc-91f2-4677-b240-13f5b075060c service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Received event network-changed-166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-d90b2069-2c02-4671-9700-3ced10fb21a0 req-8232c9fc-91f2-4677-b240-13f5b075060c service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Refreshing instance network info cache due to event network-changed-166c8bd6-ec3c-46f1-ad64-9efb6e21ad38. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d90b2069-2c02-4671-9700-3ced10fb21a0 req-8232c9fc-91f2-4677-b240-13f5b075060c service nova] Acquiring lock "refresh_cache-3d261c30-0c6f-4d1b-8965-448dc019728e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG nova.network.neutron [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.network.neutron [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Updating instance_info_cache with network_info: [{"id": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38", "address": "fa:16:3e:37:c9:7a", "network": {"id": "38b15083-7fc7-4136-940b-ac6f8ce892a7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-827628896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cede3351295e451283a0414aefea1de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c8bd6-ec", "ovs_interfaceid": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Releasing lock "refresh_cache-3d261c30-0c6f-4d1b-8965-448dc019728e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.compute.manager [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Instance network_info: |[{"id": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38", "address": "fa:16:3e:37:c9:7a", "network": {"id": "38b15083-7fc7-4136-940b-ac6f8ce892a7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-827628896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cede3351295e451283a0414aefea1de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c8bd6-ec", "ovs_interfaceid": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d90b2069-2c02-4671-9700-3ced10fb21a0 req-8232c9fc-91f2-4677-b240-13f5b075060c service nova] Acquired lock "refresh_cache-3d261c30-0c6f-4d1b-8965-448dc019728e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.network.neutron [req-d90b2069-2c02-4671-9700-3ced10fb21a0 req-8232c9fc-91f2-4677-b240-13f5b075060c service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Refreshing network info cache for port 166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Start _get_guest_xml network_info=[{"id": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38", "address": "fa:16:3e:37:c9:7a", "network": {"id": "38b15083-7fc7-4136-940b-ac6f8ce892a7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-827628896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cede3351295e451283a0414aefea1de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c8bd6-ec", "ovs_interfaceid": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:35:51Z,direct_url=<?>,disk_format='qcow2',id=635d50f2-49f4-4589-b08b-3bd3f2f32a2e,min_disk=0,min_ram=0,name='',owner='f75da019d7f74226827be43780c5fac5',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:35:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'image_id': '635d50f2-49f4-4589-b08b-3bd3f2f32a2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:36:01 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:36:01 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:35:51Z,direct_url=<?>,disk_format='qcow2',id=635d50f2-49f4-4589-b08b-3bd3f2f32a2e,min_disk=0,min_ram=0,name='',owner='f75da019d7f74226827be43780c5fac5',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:35:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:35:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-328020930',display_name='tempest-AttachSCSIVolumeTestJSON-server-328020930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-328020930',id=9,image_ref='635d50f2-49f4-4589-b08b-3bd3f2f32a2e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzQawsEeqCly4GrkNJAA9BBwNnMJnPgKodH8mU0eVkzeBhsPPS+9XOw4Ves3ommAtM8yIxnCyFKIdDYuEUOj5JIixEV4XVMiYn1a4c9klmAXFo78LZXAV5NnNG2cYaSuw==',key_name='tempest-keypair-1229893823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cede3351295e451283a0414aefea1de5',ramdisk_id='',reservation_id='r-p8wz8ax5',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='635d50f2-49f4-4589-b08b-3bd3f2f32a2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-384950708',owner_user_name='tempest-AttachSCSIVolumeTestJSON-384950708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:35:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f1517aae734c8aa5b0acbc906af9c0',uuid=3d261c30-0c6f-4d1b-8965-448dc019728e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38", "address": "fa:16:3e:37:c9:7a", "network": {"id": "38b15083-7fc7-4136-940b-ac6f8ce892a7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-827628896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cede3351295e451283a0414aefea1de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c8bd6-ec", "ovs_interfaceid": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Converting VIF {"id": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38", "address": "fa:16:3e:37:c9:7a", "network": {"id": "38b15083-7fc7-4136-940b-ac6f8ce892a7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-827628896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cede3351295e451283a0414aefea1de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c8bd6-ec", "ovs_interfaceid": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:c9:7a,bridge_name='br-int',has_traffic_filtering=True,id=166c8bd6-ec3c-46f1-ad64-9efb6e21ad38,network=Network(38b15083-7fc7-4136-940b-ac6f8ce892a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166c8bd6-ec') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.objects.instance [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d261c30-0c6f-4d1b-8965-448dc019728e {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:36:01 user nova-compute[71557]:   <uuid>3d261c30-0c6f-4d1b-8965-448dc019728e</uuid>
Apr 12 10:36:01 user nova-compute[71557]:   <name>instance-00000009</name>
Apr 12 10:36:01 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:36:01 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:36:01 user nova-compute[71557]:   <metadata>
Apr 12 10:36:01 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:36:01 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:36:01 user nova-compute[71557]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-328020930</nova:name>
Apr 12 10:36:01 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:36:01</nova:creationTime>
Apr 12 10:36:01 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:36:01 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:36:01 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:36:01 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:36:01 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:36:01 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:36:01 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:36:01 user nova-compute[71557]:       <nova:owner>
Apr 12 10:36:01 user nova-compute[71557]:         <nova:user uuid="b2f1517aae734c8aa5b0acbc906af9c0">tempest-AttachSCSIVolumeTestJSON-384950708-project-member</nova:user>
Apr 12 10:36:01 user nova-compute[71557]:         <nova:project uuid="cede3351295e451283a0414aefea1de5">tempest-AttachSCSIVolumeTestJSON-384950708</nova:project>
Apr 12 10:36:01 user nova-compute[71557]:       </nova:owner>
Apr 12 10:36:01 user nova-compute[71557]:       <nova:root type="image" uuid="635d50f2-49f4-4589-b08b-3bd3f2f32a2e"/>
Apr 12 10:36:01 user nova-compute[71557]:       <nova:ports>
Apr 12 10:36:01 user nova-compute[71557]:         <nova:port uuid="166c8bd6-ec3c-46f1-ad64-9efb6e21ad38">
Apr 12 10:36:01 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 10:36:01 user nova-compute[71557]:         </nova:port>
Apr 12 10:36:01 user nova-compute[71557]:       </nova:ports>
Apr 12 10:36:01 user nova-compute[71557]:     </nova:instance>
Apr 12 10:36:01 user nova-compute[71557]:   </metadata>
Apr 12 10:36:01 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:36:01 user nova-compute[71557]:     <system>
Apr 12 10:36:01 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:36:01 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:36:01 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:36:01 user nova-compute[71557]:       <entry name="serial">3d261c30-0c6f-4d1b-8965-448dc019728e</entry>
Apr 12 10:36:01 user nova-compute[71557]:       <entry name="uuid">3d261c30-0c6f-4d1b-8965-448dc019728e</entry>
Apr 12 10:36:01 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:36:01 user nova-compute[71557]:     </system>
Apr 12 10:36:01 user nova-compute[71557]:   </sysinfo>
Apr 12 10:36:01 user nova-compute[71557]:   <os>
Apr 12 10:36:01 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:36:01 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:36:01 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:36:01 user nova-compute[71557]:   </os>
Apr 12 10:36:01 user nova-compute[71557]:   <features>
Apr 12 10:36:01 user nova-compute[71557]:     <acpi/>
Apr 12 10:36:01 user nova-compute[71557]:     <apic/>
Apr 12 10:36:01 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:36:01 user nova-compute[71557]:   </features>
Apr 12 10:36:01 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:36:01 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:36:01 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:36:01 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:36:01 user nova-compute[71557]:   </clock>
Apr 12 10:36:01 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:36:01 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:36:01 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:36:01 user nova-compute[71557]:   </cpu>
Apr 12 10:36:01 user nova-compute[71557]:   <devices>
Apr 12 10:36:01 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:36:01 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:36:01 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/disk"/>
Apr 12 10:36:01 user nova-compute[71557]:       <target dev="sda" bus="scsi"/>
Apr 12 10:36:01 user nova-compute[71557]:       <address type="drive" controller="0" unit="0"/>
Apr 12 10:36:01 user nova-compute[71557]:     </disk>
Apr 12 10:36:01 user nova-compute[71557]:     <disk type="file" device="cdrom">
Apr 12 10:36:01 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 10:36:01 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/disk.config"/>
Apr 12 10:36:01 user nova-compute[71557]:       <target dev="sdb" bus="scsi"/>
Apr 12 10:36:01 user nova-compute[71557]:       <address type="drive" controller="0" unit="1"/>
Apr 12 10:36:01 user nova-compute[71557]:     </disk>
Apr 12 10:36:01 user nova-compute[71557]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 12 10:36:01 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:36:01 user nova-compute[71557]:       <mac address="fa:16:3e:37:c9:7a"/>
Apr 12 10:36:01 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:36:01 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:36:01 user nova-compute[71557]:       <target dev="tap166c8bd6-ec"/>
Apr 12 10:36:01 user nova-compute[71557]:     </interface>
Apr 12 10:36:01 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:36:01 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/console.log" append="off"/>
Apr 12 10:36:01 user nova-compute[71557]:     </serial>
Apr 12 10:36:01 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:36:01 user nova-compute[71557]:     <video>
Apr 12 10:36:01 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:36:01 user nova-compute[71557]:     </video>
Apr 12 10:36:01 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:36:01 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:36:01 user nova-compute[71557]:     </rng>
Apr 12 10:36:01 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:36:01 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:36:01 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:36:01 user nova-compute[71557]:     </memballoon>
Apr 12 10:36:01 user nova-compute[71557]:   </devices>
Apr 12 10:36:01 user nova-compute[71557]: </domain>
Apr 12 10:36:01 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:35:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-328020930',display_name='tempest-AttachSCSIVolumeTestJSON-server-328020930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-328020930',id=9,image_ref='635d50f2-49f4-4589-b08b-3bd3f2f32a2e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzQawsEeqCly4GrkNJAA9BBwNnMJnPgKodH8mU0eVkzeBhsPPS+9XOw4Ves3ommAtM8yIxnCyFKIdDYuEUOj5JIixEV4XVMiYn1a4c9klmAXFo78LZXAV5NnNG2cYaSuw==',key_name='tempest-keypair-1229893823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cede3351295e451283a0414aefea1de5',ramdisk_id='',reservation_id='r-p8wz8ax5',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='635d50f2-49f4-4589-b08b-3bd3f2f32a2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-384950708',owner_user_name='tempest-AttachSCSIVolumeTestJSON-384950708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:35:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f1517aae734c8aa5b0acbc906af9c0',uuid=3d261c30-0c6f-4d1b-8965-448dc019728e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38", "address": "fa:16:3e:37:c9:7a", "network": {"id": "38b15083-7fc7-4136-940b-ac6f8ce892a7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-827628896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cede3351295e451283a0414aefea1de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c8bd6-ec", "ovs_interfaceid": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Converting VIF {"id": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38", "address": "fa:16:3e:37:c9:7a", "network": {"id": "38b15083-7fc7-4136-940b-ac6f8ce892a7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-827628896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cede3351295e451283a0414aefea1de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c8bd6-ec", "ovs_interfaceid": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:c9:7a,bridge_name='br-int',has_traffic_filtering=True,id=166c8bd6-ec3c-46f1-ad64-9efb6e21ad38,network=Network(38b15083-7fc7-4136-940b-ac6f8ce892a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166c8bd6-ec') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG os_vif [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:c9:7a,bridge_name='br-int',has_traffic_filtering=True,id=166c8bd6-ec3c-46f1-ad64-9efb6e21ad38,network=Network(38b15083-7fc7-4136-940b-ac6f8ce892a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166c8bd6-ec') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap166c8bd6-ec, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap166c8bd6-ec, col_values=(('external_ids', {'iface-id': '166c8bd6-ec3c-46f1-ad64-9efb6e21ad38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:c9:7a', 'vm-uuid': '3d261c30-0c6f-4d1b-8965-448dc019728e'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:01 user nova-compute[71557]: INFO os_vif [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:c9:7a,bridge_name='br-int',has_traffic_filtering=True,id=166c8bd6-ec3c-46f1-ad64-9efb6e21ad38,network=Network(38b15083-7fc7-4136-940b-ac6f8ce892a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166c8bd6-ec')
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] No BDM found with device name sda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] No VIF found with MAC fa:16:3e:37:c9:7a, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:36:01 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Using config drive
Apr 12 10:36:01 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Creating config drive at /opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/disk.config
Apr 12 10:36:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn0bx2u3b {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn0bx2u3b" returned: 0 in 0.089s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG nova.network.neutron [req-d90b2069-2c02-4671-9700-3ced10fb21a0 req-8232c9fc-91f2-4677-b240-13f5b075060c service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Updated VIF entry in instance network info cache for port 166c8bd6-ec3c-46f1-ad64-9efb6e21ad38. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG nova.network.neutron [req-d90b2069-2c02-4671-9700-3ced10fb21a0 req-8232c9fc-91f2-4677-b240-13f5b075060c service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Updating instance_info_cache with network_info: [{"id": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38", "address": "fa:16:3e:37:c9:7a", "network": {"id": "38b15083-7fc7-4136-940b-ac6f8ce892a7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-827628896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cede3351295e451283a0414aefea1de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c8bd6-ec", "ovs_interfaceid": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d90b2069-2c02-4671-9700-3ced10fb21a0 req-8232c9fc-91f2-4677-b240-13f5b075060c service nova] Releasing lock "refresh_cache-3d261c30-0c6f-4d1b-8965-448dc019728e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "f147b4ee-d130-41ae-a4db-bc248fb23266" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG nova.compute.manager [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:36:02 user nova-compute[71557]: INFO nova.compute.claims [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Claim successful on node user
Apr 12 10:36:02 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG nova.compute.manager [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Received event network-vif-plugged-d6cd169f-f736-45da-96ea-c0b933c882a0 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] Acquiring lock "d04cb526-f77a-457c-90b1-3e5c202c0c30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] Lock "d04cb526-f77a-457c-90b1-3e5c202c0c30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] Lock "d04cb526-f77a-457c-90b1-3e5c202c0c30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG nova.compute.manager [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] No waiting events found dispatching network-vif-plugged-d6cd169f-f736-45da-96ea-c0b933c882a0 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:36:02 user nova-compute[71557]: WARNING nova.compute.manager [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Received unexpected event network-vif-plugged-d6cd169f-f736-45da-96ea-c0b933c882a0 for instance with vm_state building and task_state spawning.
Apr 12 10:36:02 user nova-compute[71557]: DEBUG nova.compute.manager [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Received event network-vif-plugged-9d4bc0b7-4a2b-4354-a609-c673f6235cc7 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] Acquiring lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG nova.compute.manager [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] No waiting events found dispatching network-vif-plugged-9d4bc0b7-4a2b-4354-a609-c673f6235cc7 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:36:02 user nova-compute[71557]: WARNING nova.compute.manager [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Received unexpected event network-vif-plugged-9d4bc0b7-4a2b-4354-a609-c673f6235cc7 for instance with vm_state building and task_state spawning.
Apr 12 10:36:02 user nova-compute[71557]: DEBUG nova.compute.manager [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Received event network-vif-plugged-9d4bc0b7-4a2b-4354-a609-c673f6235cc7 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] Acquiring lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG nova.compute.manager [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] No waiting events found dispatching network-vif-plugged-9d4bc0b7-4a2b-4354-a609-c673f6235cc7 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:36:02 user nova-compute[71557]: WARNING nova.compute.manager [req-e308fe3a-1011-4fa5-a64e-fe5ed2a6dc82 req-5a56cb31-3669-42d0-ad41-71769645f79a service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Received unexpected event network-vif-plugged-9d4bc0b7-4a2b-4354-a609-c673f6235cc7 for instance with vm_state building and task_state spawning.
Apr 12 10:36:02 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG nova.compute.manager [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG nova.compute.manager [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG nova.network.neutron [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:36:02 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:36:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:02 user nova-compute[71557]: DEBUG nova.compute.manager [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.policy [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '254d3560065c4d8a8aaf312870be2967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6981486a29b64ee7b9ef7cbf2ca852be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.compute.manager [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:36:03 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Creating image(s)
Apr 12 10:36:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "/opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "/opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "/opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.144s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.164s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk 1073741824" returned: 0 in 0.075s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295763.5615914, d04cb526-f77a-457c-90b1-3e5c202c0c30 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:36:03 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] VM Resumed (Lifecycle Event)
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.compute.manager [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:36:03 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Instance spawned successfully.
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.180s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:03 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Instance spawned successfully.
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:03 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295763.5645432, d04cb526-f77a-457c-90b1-3e5c202c0c30 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:36:03 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] VM Started (Lifecycle Event)
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Cannot resize image /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.objects.instance [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lazy-loading 'migration_context' on Instance uuid f147b4ee-d130-41ae-a4db-bc248fb23266 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:36:03 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295763.5646524, ea55f551-968e-4ece-a37a-c4128ce5e8cb => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:36:03 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] VM Resumed (Lifecycle Event)
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Ensure instance console log exists: /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:03 user nova-compute[71557]: INFO nova.compute.manager [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Took 8.76 seconds to spawn the instance on the hypervisor.
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.compute.manager [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:36:03 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295763.5894122, ea55f551-968e-4ece-a37a-c4128ce5e8cb => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:36:03 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] VM Started (Lifecycle Event)
Apr 12 10:36:03 user nova-compute[71557]: INFO nova.compute.manager [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Took 8.22 seconds to spawn the instance on the hypervisor.
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:03 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:36:03 user nova-compute[71557]: DEBUG nova.network.neutron [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Successfully created port: 96998164-acd9-4a18-b230-d63787eaf154 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:36:03 user nova-compute[71557]: INFO nova.compute.manager [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Took 10.28 seconds to build instance.
Apr 12 10:36:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:03 user nova-compute[71557]: INFO nova.compute.manager [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Took 9.29 seconds to build instance.
Apr 12 10:36:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8ebdb05c-ccc5-4c5c-8343-40eef2e9a58e tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "d04cb526-f77a-457c-90b1-3e5c202c0c30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.407s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2cb2959d-71fc-49f3-8c09-85940978726f tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.404s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:04 user nova-compute[71557]: DEBUG nova.network.neutron [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Successfully updated port: 96998164-acd9-4a18-b230-d63787eaf154 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:36:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "refresh_cache-f147b4ee-d130-41ae-a4db-bc248fb23266" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:36:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquired lock "refresh_cache-f147b4ee-d130-41ae-a4db-bc248fb23266" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:36:04 user nova-compute[71557]: DEBUG nova.network.neutron [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:36:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-040e8f0c-824f-4f2e-95b1-558194016d00 req-5353de91-7403-40ce-a93c-d10daa2bfe49 service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Received event network-vif-plugged-166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-040e8f0c-824f-4f2e-95b1-558194016d00 req-5353de91-7403-40ce-a93c-d10daa2bfe49 service nova] Acquiring lock "3d261c30-0c6f-4d1b-8965-448dc019728e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-040e8f0c-824f-4f2e-95b1-558194016d00 req-5353de91-7403-40ce-a93c-d10daa2bfe49 service nova] Lock "3d261c30-0c6f-4d1b-8965-448dc019728e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-040e8f0c-824f-4f2e-95b1-558194016d00 req-5353de91-7403-40ce-a93c-d10daa2bfe49 service nova] Lock "3d261c30-0c6f-4d1b-8965-448dc019728e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-040e8f0c-824f-4f2e-95b1-558194016d00 req-5353de91-7403-40ce-a93c-d10daa2bfe49 service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] No waiting events found dispatching network-vif-plugged-166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:36:04 user nova-compute[71557]: WARNING nova.compute.manager [req-040e8f0c-824f-4f2e-95b1-558194016d00 req-5353de91-7403-40ce-a93c-d10daa2bfe49 service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Received unexpected event network-vif-plugged-166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 for instance with vm_state building and task_state spawning.
Apr 12 10:36:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-040e8f0c-824f-4f2e-95b1-558194016d00 req-5353de91-7403-40ce-a93c-d10daa2bfe49 service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Received event network-vif-plugged-166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-040e8f0c-824f-4f2e-95b1-558194016d00 req-5353de91-7403-40ce-a93c-d10daa2bfe49 service nova] Acquiring lock "3d261c30-0c6f-4d1b-8965-448dc019728e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-040e8f0c-824f-4f2e-95b1-558194016d00 req-5353de91-7403-40ce-a93c-d10daa2bfe49 service nova] Lock "3d261c30-0c6f-4d1b-8965-448dc019728e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-040e8f0c-824f-4f2e-95b1-558194016d00 req-5353de91-7403-40ce-a93c-d10daa2bfe49 service nova] Lock "3d261c30-0c6f-4d1b-8965-448dc019728e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-040e8f0c-824f-4f2e-95b1-558194016d00 req-5353de91-7403-40ce-a93c-d10daa2bfe49 service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] No waiting events found dispatching network-vif-plugged-166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:36:04 user nova-compute[71557]: WARNING nova.compute.manager [req-040e8f0c-824f-4f2e-95b1-558194016d00 req-5353de91-7403-40ce-a93c-d10daa2bfe49 service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Received unexpected event network-vif-plugged-166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 for instance with vm_state building and task_state spawning.
Apr 12 10:36:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-9286c6a5-d372-40c1-a9ff-f854ff74e066 req-8c821872-096c-4986-947a-c68506960d00 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Received event network-changed-96998164-acd9-4a18-b230-d63787eaf154 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-9286c6a5-d372-40c1-a9ff-f854ff74e066 req-8c821872-096c-4986-947a-c68506960d00 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Refreshing instance network info cache due to event network-changed-96998164-acd9-4a18-b230-d63787eaf154. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:36:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9286c6a5-d372-40c1-a9ff-f854ff74e066 req-8c821872-096c-4986-947a-c68506960d00 service nova] Acquiring lock "refresh_cache-f147b4ee-d130-41ae-a4db-bc248fb23266" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:36:04 user nova-compute[71557]: DEBUG nova.network.neutron [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.network.neutron [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Updating instance_info_cache with network_info: [{"id": "96998164-acd9-4a18-b230-d63787eaf154", "address": "fa:16:3e:2e:44:60", "network": {"id": "4f4a6f13-7642-4157-ba75-be13336c456e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-673330570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96998164-ac", "ovs_interfaceid": "96998164-acd9-4a18-b230-d63787eaf154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Releasing lock "refresh_cache-f147b4ee-d130-41ae-a4db-bc248fb23266" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.compute.manager [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Instance network_info: |[{"id": "96998164-acd9-4a18-b230-d63787eaf154", "address": "fa:16:3e:2e:44:60", "network": {"id": "4f4a6f13-7642-4157-ba75-be13336c456e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-673330570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96998164-ac", "ovs_interfaceid": "96998164-acd9-4a18-b230-d63787eaf154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9286c6a5-d372-40c1-a9ff-f854ff74e066 req-8c821872-096c-4986-947a-c68506960d00 service nova] Acquired lock "refresh_cache-f147b4ee-d130-41ae-a4db-bc248fb23266" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.network.neutron [req-9286c6a5-d372-40c1-a9ff-f854ff74e066 req-8c821872-096c-4986-947a-c68506960d00 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Refreshing network info cache for port 96998164-acd9-4a18-b230-d63787eaf154 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Start _get_guest_xml network_info=[{"id": "96998164-acd9-4a18-b230-d63787eaf154", "address": "fa:16:3e:2e:44:60", "network": {"id": "4f4a6f13-7642-4157-ba75-be13336c456e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-673330570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96998164-ac", "ovs_interfaceid": "96998164-acd9-4a18-b230-d63787eaf154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:36:05 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:36:05 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973136543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-973136543',id=10,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdimvfCdLuB4VkmLV8sKAN/mnwsyMwY8NOOti+AyTKIr7DOlGneUneWZujzSPReHJ3Bkx1IiksPqGfbsqao0C74w5qd657VSCv5dx2mJ7By8lLfjmYEB3fpEh2Gj0rqkQ==',key_name='tempest-keypair-1041772862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6981486a29b64ee7b9ef7cbf2ca852be',ramdisk_id='',reservation_id='r-c2o3o5pa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2008645939',owner_user_name='tempest-TaggedAttachmentsTest-2008645939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='254d3560065c4d8a8aaf312870be2967',uuid=f147b4ee-d130-41ae-a4db-bc248fb23266,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96998164-acd9-4a18-b230-d63787eaf154", "address": "fa:16:3e:2e:44:60", "network": {"id": "4f4a6f13-7642-4157-ba75-be13336c456e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-673330570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96998164-ac", "ovs_interfaceid": "96998164-acd9-4a18-b230-d63787eaf154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Converting VIF {"id": "96998164-acd9-4a18-b230-d63787eaf154", "address": "fa:16:3e:2e:44:60", "network": {"id": "4f4a6f13-7642-4157-ba75-be13336c456e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-673330570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96998164-ac", "ovs_interfaceid": "96998164-acd9-4a18-b230-d63787eaf154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:44:60,bridge_name='br-int',has_traffic_filtering=True,id=96998164-acd9-4a18-b230-d63787eaf154,network=Network(4f4a6f13-7642-4157-ba75-be13336c456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96998164-ac') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.objects.instance [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lazy-loading 'pci_devices' on Instance uuid f147b4ee-d130-41ae-a4db-bc248fb23266 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:36:05 user nova-compute[71557]:   <uuid>f147b4ee-d130-41ae-a4db-bc248fb23266</uuid>
Apr 12 10:36:05 user nova-compute[71557]:   <name>instance-0000000a</name>
Apr 12 10:36:05 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:36:05 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:36:05 user nova-compute[71557]:   <metadata>
Apr 12 10:36:05 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:36:05 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:36:05 user nova-compute[71557]:       <nova:name>tempest-device-tagging-server-973136543</nova:name>
Apr 12 10:36:05 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:36:05</nova:creationTime>
Apr 12 10:36:05 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:36:05 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:36:05 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:36:05 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:36:05 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:36:05 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:36:05 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:36:05 user nova-compute[71557]:       <nova:owner>
Apr 12 10:36:05 user nova-compute[71557]:         <nova:user uuid="254d3560065c4d8a8aaf312870be2967">tempest-TaggedAttachmentsTest-2008645939-project-member</nova:user>
Apr 12 10:36:05 user nova-compute[71557]:         <nova:project uuid="6981486a29b64ee7b9ef7cbf2ca852be">tempest-TaggedAttachmentsTest-2008645939</nova:project>
Apr 12 10:36:05 user nova-compute[71557]:       </nova:owner>
Apr 12 10:36:05 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:36:05 user nova-compute[71557]:       <nova:ports>
Apr 12 10:36:05 user nova-compute[71557]:         <nova:port uuid="96998164-acd9-4a18-b230-d63787eaf154">
Apr 12 10:36:05 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 10:36:05 user nova-compute[71557]:         </nova:port>
Apr 12 10:36:05 user nova-compute[71557]:       </nova:ports>
Apr 12 10:36:05 user nova-compute[71557]:     </nova:instance>
Apr 12 10:36:05 user nova-compute[71557]:   </metadata>
Apr 12 10:36:05 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:36:05 user nova-compute[71557]:     <system>
Apr 12 10:36:05 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:36:05 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:36:05 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:36:05 user nova-compute[71557]:       <entry name="serial">f147b4ee-d130-41ae-a4db-bc248fb23266</entry>
Apr 12 10:36:05 user nova-compute[71557]:       <entry name="uuid">f147b4ee-d130-41ae-a4db-bc248fb23266</entry>
Apr 12 10:36:05 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:36:05 user nova-compute[71557]:     </system>
Apr 12 10:36:05 user nova-compute[71557]:   </sysinfo>
Apr 12 10:36:05 user nova-compute[71557]:   <os>
Apr 12 10:36:05 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:36:05 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:36:05 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:36:05 user nova-compute[71557]:   </os>
Apr 12 10:36:05 user nova-compute[71557]:   <features>
Apr 12 10:36:05 user nova-compute[71557]:     <acpi/>
Apr 12 10:36:05 user nova-compute[71557]:     <apic/>
Apr 12 10:36:05 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:36:05 user nova-compute[71557]:   </features>
Apr 12 10:36:05 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:36:05 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:36:05 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:36:05 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:36:05 user nova-compute[71557]:   </clock>
Apr 12 10:36:05 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:36:05 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:36:05 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:36:05 user nova-compute[71557]:   </cpu>
Apr 12 10:36:05 user nova-compute[71557]:   <devices>
Apr 12 10:36:05 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:36:05 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:36:05 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk"/>
Apr 12 10:36:05 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:36:05 user nova-compute[71557]:     </disk>
Apr 12 10:36:05 user nova-compute[71557]:     <disk type="file" device="cdrom">
Apr 12 10:36:05 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 10:36:05 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk.config"/>
Apr 12 10:36:05 user nova-compute[71557]:       <target dev="hda" bus="ide"/>
Apr 12 10:36:05 user nova-compute[71557]:     </disk>
Apr 12 10:36:05 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:36:05 user nova-compute[71557]:       <mac address="fa:16:3e:2e:44:60"/>
Apr 12 10:36:05 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:36:05 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:36:05 user nova-compute[71557]:       <target dev="tap96998164-ac"/>
Apr 12 10:36:05 user nova-compute[71557]:     </interface>
Apr 12 10:36:05 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:36:05 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/console.log" append="off"/>
Apr 12 10:36:05 user nova-compute[71557]:     </serial>
Apr 12 10:36:05 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:36:05 user nova-compute[71557]:     <video>
Apr 12 10:36:05 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:36:05 user nova-compute[71557]:     </video>
Apr 12 10:36:05 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:36:05 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:36:05 user nova-compute[71557]:     </rng>
Apr 12 10:36:05 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:36:05 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:36:05 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:36:05 user nova-compute[71557]:     </memballoon>
Apr 12 10:36:05 user nova-compute[71557]:   </devices>
Apr 12 10:36:05 user nova-compute[71557]: </domain>
Apr 12 10:36:05 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973136543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-973136543',id=10,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdimvfCdLuB4VkmLV8sKAN/mnwsyMwY8NOOti+AyTKIr7DOlGneUneWZujzSPReHJ3Bkx1IiksPqGfbsqao0C74w5qd657VSCv5dx2mJ7By8lLfjmYEB3fpEh2Gj0rqkQ==',key_name='tempest-keypair-1041772862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6981486a29b64ee7b9ef7cbf2ca852be',ramdisk_id='',reservation_id='r-c2o3o5pa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2008645939',owner_user_name='tempest-TaggedAttachmentsTest-2008645939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='254d3560065c4d8a8aaf312870be2967',uuid=f147b4ee-d130-41ae-a4db-bc248fb23266,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96998164-acd9-4a18-b230-d63787eaf154", "address": "fa:16:3e:2e:44:60", "network": {"id": "4f4a6f13-7642-4157-ba75-be13336c456e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-673330570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96998164-ac", "ovs_interfaceid": "96998164-acd9-4a18-b230-d63787eaf154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Converting VIF {"id": "96998164-acd9-4a18-b230-d63787eaf154", "address": "fa:16:3e:2e:44:60", "network": {"id": "4f4a6f13-7642-4157-ba75-be13336c456e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-673330570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96998164-ac", "ovs_interfaceid": "96998164-acd9-4a18-b230-d63787eaf154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:44:60,bridge_name='br-int',has_traffic_filtering=True,id=96998164-acd9-4a18-b230-d63787eaf154,network=Network(4f4a6f13-7642-4157-ba75-be13336c456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96998164-ac') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG os_vif [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:44:60,bridge_name='br-int',has_traffic_filtering=True,id=96998164-acd9-4a18-b230-d63787eaf154,network=Network(4f4a6f13-7642-4157-ba75-be13336c456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96998164-ac') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96998164-ac, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96998164-ac, col_values=(('external_ids', {'iface-id': '96998164-acd9-4a18-b230-d63787eaf154', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:44:60', 'vm-uuid': 'f147b4ee-d130-41ae-a4db-bc248fb23266'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:05 user nova-compute[71557]: INFO os_vif [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:44:60,bridge_name='br-int',has_traffic_filtering=True,id=96998164-acd9-4a18-b230-d63787eaf154,network=Network(4f4a6f13-7642-4157-ba75-be13336c456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96998164-ac')
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] No BDM found with device name hda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] No VIF found with MAC fa:16:3e:2e:44:60, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:36:05 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Using config drive
Apr 12 10:36:05 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Creating config drive at /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk.config
Apr 12 10:36:05 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3uozqmg9 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3uozqmg9" returned: 0 in 0.055s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295765.5808952, 3d261c30-0c6f-4d1b-8965-448dc019728e => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:36:05 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] VM Resumed (Lifecycle Event)
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.compute.manager [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:36:05 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Instance spawned successfully.
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:36:05 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295765.5897381, 3d261c30-0c6f-4d1b-8965-448dc019728e => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:36:05 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] VM Started (Lifecycle Event)
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:36:05 user nova-compute[71557]: INFO nova.compute.manager [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Took 7.24 seconds to spawn the instance on the hypervisor.
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.compute.manager [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:36:05 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.network.neutron [req-9286c6a5-d372-40c1-a9ff-f854ff74e066 req-8c821872-096c-4986-947a-c68506960d00 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Updated VIF entry in instance network info cache for port 96998164-acd9-4a18-b230-d63787eaf154. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG nova.network.neutron [req-9286c6a5-d372-40c1-a9ff-f854ff74e066 req-8c821872-096c-4986-947a-c68506960d00 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Updating instance_info_cache with network_info: [{"id": "96998164-acd9-4a18-b230-d63787eaf154", "address": "fa:16:3e:2e:44:60", "network": {"id": "4f4a6f13-7642-4157-ba75-be13336c456e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-673330570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96998164-ac", "ovs_interfaceid": "96998164-acd9-4a18-b230-d63787eaf154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:36:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9286c6a5-d372-40c1-a9ff-f854ff74e066 req-8c821872-096c-4986-947a-c68506960d00 service nova] Releasing lock "refresh_cache-f147b4ee-d130-41ae-a4db-bc248fb23266" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:36:05 user nova-compute[71557]: INFO nova.compute.manager [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Took 8.30 seconds to build instance.
Apr 12 10:36:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3606c93f-d74b-4168-bb36-d5dcdfa9f4d7 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "3d261c30-0c6f-4d1b-8965-448dc019728e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.452s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:07 user nova-compute[71557]: DEBUG nova.compute.manager [req-99f1a30a-51ad-4bf2-b34d-5fde3f86f76a req-53ec995f-3771-4d50-9439-5a581a17120b service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Received event network-vif-plugged-96998164-acd9-4a18-b230-d63787eaf154 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-99f1a30a-51ad-4bf2-b34d-5fde3f86f76a req-53ec995f-3771-4d50-9439-5a581a17120b service nova] Acquiring lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-99f1a30a-51ad-4bf2-b34d-5fde3f86f76a req-53ec995f-3771-4d50-9439-5a581a17120b service nova] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-99f1a30a-51ad-4bf2-b34d-5fde3f86f76a req-53ec995f-3771-4d50-9439-5a581a17120b service nova] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:07 user nova-compute[71557]: DEBUG nova.compute.manager [req-99f1a30a-51ad-4bf2-b34d-5fde3f86f76a req-53ec995f-3771-4d50-9439-5a581a17120b service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] No waiting events found dispatching network-vif-plugged-96998164-acd9-4a18-b230-d63787eaf154 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:36:07 user nova-compute[71557]: WARNING nova.compute.manager [req-99f1a30a-51ad-4bf2-b34d-5fde3f86f76a req-53ec995f-3771-4d50-9439-5a581a17120b service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Received unexpected event network-vif-plugged-96998164-acd9-4a18-b230-d63787eaf154 for instance with vm_state building and task_state spawning.
Apr 12 10:36:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:09 user nova-compute[71557]: DEBUG nova.compute.manager [req-a83173f0-73b1-4fc4-87e6-e90fe38939e7 req-44f1286b-54c4-4b1e-9d6f-f482f4f70e3a service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Received event network-vif-plugged-96998164-acd9-4a18-b230-d63787eaf154 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a83173f0-73b1-4fc4-87e6-e90fe38939e7 req-44f1286b-54c4-4b1e-9d6f-f482f4f70e3a service nova] Acquiring lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a83173f0-73b1-4fc4-87e6-e90fe38939e7 req-44f1286b-54c4-4b1e-9d6f-f482f4f70e3a service nova] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a83173f0-73b1-4fc4-87e6-e90fe38939e7 req-44f1286b-54c4-4b1e-9d6f-f482f4f70e3a service nova] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:09 user nova-compute[71557]: DEBUG nova.compute.manager [req-a83173f0-73b1-4fc4-87e6-e90fe38939e7 req-44f1286b-54c4-4b1e-9d6f-f482f4f70e3a service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] No waiting events found dispatching network-vif-plugged-96998164-acd9-4a18-b230-d63787eaf154 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:36:09 user nova-compute[71557]: WARNING nova.compute.manager [req-a83173f0-73b1-4fc4-87e6-e90fe38939e7 req-44f1286b-54c4-4b1e-9d6f-f482f4f70e3a service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Received unexpected event network-vif-plugged-96998164-acd9-4a18-b230-d63787eaf154 for instance with vm_state building and task_state spawning.
Apr 12 10:36:09 user nova-compute[71557]: DEBUG nova.compute.manager [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:36:09 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:36:09 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Instance spawned successfully.
Apr 12 10:36:09 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:36:09 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295769.5486722, f147b4ee-d130-41ae-a4db-bc248fb23266 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:36:09 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] VM Resumed (Lifecycle Event)
Apr 12 10:36:09 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:36:09 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:09 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:09 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:09 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:09 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:09 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:09 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:36:09 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:36:09 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295769.5510433, f147b4ee-d130-41ae-a4db-bc248fb23266 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:36:09 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] VM Started (Lifecycle Event)
Apr 12 10:36:09 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:36:09 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:36:09 user nova-compute[71557]: INFO nova.compute.manager [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Took 6.77 seconds to spawn the instance on the hypervisor.
Apr 12 10:36:09 user nova-compute[71557]: DEBUG nova.compute.manager [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:36:09 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:36:09 user nova-compute[71557]: INFO nova.compute.manager [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Took 7.58 seconds to build instance.
Apr 12 10:36:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bb542c9f-8063-4794-8673-c7f1ca343845 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.733s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:11 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:36:11 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Cleaning up deleted instances {{(pid=71557) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 10:36:11 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] There are 0 instances to clean {{(pid=71557) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 10:36:11 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:36:11 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Cleaning up deleted instances with incomplete migration  {{(pid=71557) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 10:36:11 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:36:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:14 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:36:14 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:36:14 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:36:14 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:36:14 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:36:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:14 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:36:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270d5d4d-4df6-4ba5-9145-98f343fb3b0e/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270d5d4d-4df6-4ba5-9145-98f343fb3b0e/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270d5d4d-4df6-4ba5-9145-98f343fb3b0e/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270d5d4d-4df6-4ba5-9145-98f343fb3b0e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d49077-b100-4630-b4f8-00c3daffb9e3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d49077-b100-4630-b4f8-00c3daffb9e3/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d49077-b100-4630-b4f8-00c3daffb9e3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d49077-b100-4630-b4f8-00c3daffb9e3/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:18 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:36:18 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:36:18 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=7517MB free_disk=26.62952423095703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:36:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:18 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 270d5d4d-4df6-4ba5-9145-98f343fb3b0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:36:18 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:36:18 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance f47d368e-3870-49d0-8522-a94991ec4ba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:36:18 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:36:18 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance dc6eb5d4-d415-4459-a95b-5a470ec66586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:36:18 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:36:18 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance d04cb526-f77a-457c-90b1-3e5c202c0c30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:36:18 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance ea55f551-968e-4ece-a37a-c4128ce5e8cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:36:18 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 3d261c30-0c6f-4d1b-8965-448dc019728e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:36:18 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance f147b4ee-d130-41ae-a4db-bc248fb23266 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:36:18 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:36:18 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:36:18 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:36:18 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:36:19 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:36:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:19 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:36:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:19 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:36:19 user nova-compute[71557]: INFO nova.compute.claims [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Claim successful on node user
Apr 12 10:36:19 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:36:19 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:36:19 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:36:19 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Rebuilding the list of instances to heal {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 10:36:19 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Skipping network cache update for instance because it is Building. {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 12 10:36:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-270d5d4d-4df6-4ba5-9145-98f343fb3b0e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:36:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-270d5d4d-4df6-4ba5-9145-98f343fb3b0e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:36:20 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:36:20 user nova-compute[71557]: DEBUG nova.objects.instance [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lazy-loading 'info_cache' on Instance uuid 270d5d4d-4df6-4ba5-9145-98f343fb3b0e {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:36:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:20 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:36:20 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:36:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.624s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:20 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:36:20 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:36:20 user nova-compute[71557]: DEBUG nova.network.neutron [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:36:20 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:36:20 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:36:20 user nova-compute[71557]: INFO nova.virt.block_device [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Booting with volume 5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd at /dev/vda
Apr 12 10:36:20 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Updating instance_info_cache with network_info: [{"id": "42768d69-c7da-43fb-b092-c5b41ac2d55c", "address": "fa:16:3e:65:7d:3d", "network": {"id": "b5640ff6-6dc1-44c3-b04c-9e2d4ef8ecb3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fef1d0d3952d43e2be1c2b52c16966b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42768d69-c7", "ovs_interfaceid": "42768d69-c7da-43fb-b092-c5b41ac2d55c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:36:20 user nova-compute[71557]: DEBUG nova.policy [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '949ebef2d45b4d64a89a11d837dfffd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcfbd94249342b2a436d2592e0dc9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:36:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-270d5d4d-4df6-4ba5-9145-98f343fb3b0e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:36:20 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:36:20 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:36:20 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:36:20 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:36:20 user nova-compute[71557]: DEBUG os_brick.utils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:36:20 user nova-compute[71557]: INFO oslo.privsep.daemon [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpmbn8imez/privsep.sock']
Apr 12 10:36:20 user sudo[81980]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpmbn8imez/privsep.sock
Apr 12 10:36:20 user sudo[81980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 10:36:21 user nova-compute[71557]: DEBUG nova.network.neutron [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Successfully created port: fe31a29c-b57d-463d-98ba-6527848edeba {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:36:22 user nova-compute[71557]: DEBUG nova.network.neutron [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Successfully created port: 1173b214-caa3-4d2b-9ee4-efe4ab063cac {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:36:22 user sudo[81980]: pam_unix(sudo:session): session closed for user root
Apr 12 10:36:22 user nova-compute[71557]: INFO oslo.privsep.daemon [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Spawned new privsep daemon via rootwrap
Apr 12 10:36:22 user nova-compute[71557]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 10:36:22 user nova-compute[71557]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 10:36:22 user nova-compute[71557]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 12 10:36:22 user nova-compute[71557]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82009
Apr 12 10:36:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd78d2e2-70a1-42ef-8244-2d2fe75623ec]: (2,) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f0496b-6475-4740-83f5-18dfe962b98e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:22 user nova-compute[71557]: WARNING os_brick.initiator.connectors.nvmeof [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 12 10:36:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe667ed-105e-4df0-ad27-b9db8819ac5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cc04c7-eaa7-4708-8c03-bd7f22562461]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:22 user nova-compute[71557]: DEBUG nova.network.neutron [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Successfully created port: 925f7823-924b-4df5-8bec-5f065331e4fe {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:36:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3ff767-35a1-4c42-86e2-3474c61fb7d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:36:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:36:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:36:22 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:36:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dafa73-6e3b-46a3-bc49-5109c3ddd49a]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:36:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:36:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:36:22 user nova-compute[71557]: DEBUG os_brick.utils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] <== get_connector_properties: return (1915ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:36:22 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Updating existing volume attachment record: e959a21b-bb7d-4ef5-a80d-643a4ea0c824 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:36:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:23 user nova-compute[71557]: DEBUG nova.network.neutron [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Successfully created port: 23c5dfaa-4003-410d-836e-4218b879cf66 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:36:24 user nova-compute[71557]: DEBUG nova.network.neutron [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Successfully created port: 718755e4-0ae2-47c0-b5c9-630c5df1e840 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:36:24 user nova-compute[71557]: DEBUG nova.network.neutron [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Successfully updated port: fe31a29c-b57d-463d-98ba-6527848edeba {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:36:24 user nova-compute[71557]: DEBUG nova.compute.manager [req-7f9d5049-d4a0-4710-b672-d921b342d57a req-cd2fe095-ce2a-4576-8a5d-f361f66ba62a service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-changed-fe31a29c-b57d-463d-98ba-6527848edeba {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:24 user nova-compute[71557]: DEBUG nova.compute.manager [req-7f9d5049-d4a0-4710-b672-d921b342d57a req-cd2fe095-ce2a-4576-8a5d-f361f66ba62a service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Refreshing instance network info cache due to event network-changed-fe31a29c-b57d-463d-98ba-6527848edeba. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:36:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7f9d5049-d4a0-4710-b672-d921b342d57a req-cd2fe095-ce2a-4576-8a5d-f361f66ba62a service nova] Acquiring lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:36:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7f9d5049-d4a0-4710-b672-d921b342d57a req-cd2fe095-ce2a-4576-8a5d-f361f66ba62a service nova] Acquired lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:36:24 user nova-compute[71557]: DEBUG nova.network.neutron [req-7f9d5049-d4a0-4710-b672-d921b342d57a req-cd2fe095-ce2a-4576-8a5d-f361f66ba62a service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Refreshing network info cache for port fe31a29c-b57d-463d-98ba-6527848edeba {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:36:25 user nova-compute[71557]: DEBUG nova.network.neutron [req-7f9d5049-d4a0-4710-b672-d921b342d57a req-cd2fe095-ce2a-4576-8a5d-f361f66ba62a service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:36:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:25 user nova-compute[71557]: DEBUG nova.network.neutron [req-7f9d5049-d4a0-4710-b672-d921b342d57a req-cd2fe095-ce2a-4576-8a5d-f361f66ba62a service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:36:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7f9d5049-d4a0-4710-b672-d921b342d57a req-cd2fe095-ce2a-4576-8a5d-f361f66ba62a service nova] Releasing lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:36:25 user nova-compute[71557]: DEBUG nova.network.neutron [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Successfully updated port: c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:36:26 user nova-compute[71557]: DEBUG nova.compute.manager [req-deaef6e3-76d3-4dc6-83ee-db8379b1e72d req-b18399fd-654b-4e00-b1f1-0653d3a4565d service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-changed-c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:26 user nova-compute[71557]: DEBUG nova.compute.manager [req-deaef6e3-76d3-4dc6-83ee-db8379b1e72d req-b18399fd-654b-4e00-b1f1-0653d3a4565d service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Refreshing instance network info cache due to event network-changed-c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:36:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-deaef6e3-76d3-4dc6-83ee-db8379b1e72d req-b18399fd-654b-4e00-b1f1-0653d3a4565d service nova] Acquiring lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:36:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-deaef6e3-76d3-4dc6-83ee-db8379b1e72d req-b18399fd-654b-4e00-b1f1-0653d3a4565d service nova] Acquired lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:36:26 user nova-compute[71557]: DEBUG nova.network.neutron [req-deaef6e3-76d3-4dc6-83ee-db8379b1e72d req-b18399fd-654b-4e00-b1f1-0653d3a4565d service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Refreshing network info cache for port c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:36:26 user nova-compute[71557]: DEBUG nova.network.neutron [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Successfully updated port: 307fee9a-af5f-45a9-b678-7cb16cfad99d {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG nova.network.neutron [req-deaef6e3-76d3-4dc6-83ee-db8379b1e72d req-b18399fd-654b-4e00-b1f1-0653d3a4565d service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG nova.network.neutron [req-deaef6e3-76d3-4dc6-83ee-db8379b1e72d req-b18399fd-654b-4e00-b1f1-0653d3a4565d service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-deaef6e3-76d3-4dc6-83ee-db8379b1e72d req-b18399fd-654b-4e00-b1f1-0653d3a4565d service nova] Releasing lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG nova.network.neutron [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Successfully updated port: 1173b214-caa3-4d2b-9ee4-efe4ab063cac {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG nova.compute.manager [req-cb5eaf7f-93da-492b-89f0-4f81cd375bc0 req-6dcafe07-fd5b-4126-b686-39604388dfcb service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-changed-1173b214-caa3-4d2b-9ee4-efe4ab063cac {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG nova.compute.manager [req-cb5eaf7f-93da-492b-89f0-4f81cd375bc0 req-6dcafe07-fd5b-4126-b686-39604388dfcb service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Refreshing instance network info cache due to event network-changed-1173b214-caa3-4d2b-9ee4-efe4ab063cac. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cb5eaf7f-93da-492b-89f0-4f81cd375bc0 req-6dcafe07-fd5b-4126-b686-39604388dfcb service nova] Acquiring lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cb5eaf7f-93da-492b-89f0-4f81cd375bc0 req-6dcafe07-fd5b-4126-b686-39604388dfcb service nova] Acquired lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG nova.network.neutron [req-cb5eaf7f-93da-492b-89f0-4f81cd375bc0 req-6dcafe07-fd5b-4126-b686-39604388dfcb service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Refreshing network info cache for port 1173b214-caa3-4d2b-9ee4-efe4ab063cac {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:36:27 user nova-compute[71557]: INFO nova.virt.block_device [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Booting with volume eb1f25c3-c274-4c2d-b5be-af3f13f3e84f at /dev/vdb
Apr 12 10:36:27 user nova-compute[71557]: DEBUG nova.network.neutron [req-cb5eaf7f-93da-492b-89f0-4f81cd375bc0 req-6dcafe07-fd5b-4126-b686-39604388dfcb service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG os_brick.utils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcbf082-704a-414d-8c2a-b83e260733d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef87f74-e855-4de9-97be-8a59771a2a3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[748dc1b2-b190-42d9-b2f1-22023531ee1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e28c705-c382-404c-8003-bf80991ed200]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:36:27 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:36:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57970db-795e-4705-a82f-740964ac22bb]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:36:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:36:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:36:28 user nova-compute[71557]: DEBUG os_brick.utils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:36:28 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Updating existing volume attachment record: d9cb20f7-145d-4bf7-a274-cc07598b64d1 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:36:28 user nova-compute[71557]: DEBUG nova.network.neutron [req-cb5eaf7f-93da-492b-89f0-4f81cd375bc0 req-6dcafe07-fd5b-4126-b686-39604388dfcb service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:36:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cb5eaf7f-93da-492b-89f0-4f81cd375bc0 req-6dcafe07-fd5b-4126-b686-39604388dfcb service nova] Releasing lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:36:28 user nova-compute[71557]: DEBUG nova.network.neutron [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Successfully updated port: 925f7823-924b-4df5-8bec-5f065331e4fe {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:36:28 user nova-compute[71557]: DEBUG nova.compute.manager [req-2412f8b5-5c12-4994-9a66-f5e0abb6ecde req-ee91858e-cf77-49ae-b0c6-6d4bafc18b88 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-changed-307fee9a-af5f-45a9-b678-7cb16cfad99d {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:28 user nova-compute[71557]: DEBUG nova.compute.manager [req-2412f8b5-5c12-4994-9a66-f5e0abb6ecde req-ee91858e-cf77-49ae-b0c6-6d4bafc18b88 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Refreshing instance network info cache due to event network-changed-307fee9a-af5f-45a9-b678-7cb16cfad99d. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:36:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2412f8b5-5c12-4994-9a66-f5e0abb6ecde req-ee91858e-cf77-49ae-b0c6-6d4bafc18b88 service nova] Acquiring lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:36:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2412f8b5-5c12-4994-9a66-f5e0abb6ecde req-ee91858e-cf77-49ae-b0c6-6d4bafc18b88 service nova] Acquired lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:36:28 user nova-compute[71557]: DEBUG nova.network.neutron [req-2412f8b5-5c12-4994-9a66-f5e0abb6ecde req-ee91858e-cf77-49ae-b0c6-6d4bafc18b88 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Refreshing network info cache for port 307fee9a-af5f-45a9-b678-7cb16cfad99d {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:36:29 user nova-compute[71557]: DEBUG nova.network.neutron [req-2412f8b5-5c12-4994-9a66-f5e0abb6ecde req-ee91858e-cf77-49ae-b0c6-6d4bafc18b88 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:36:29 user nova-compute[71557]: DEBUG nova.network.neutron [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Successfully updated port: 23c5dfaa-4003-410d-836e-4218b879cf66 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:36:29 user nova-compute[71557]: DEBUG nova.network.neutron [req-2412f8b5-5c12-4994-9a66-f5e0abb6ecde req-ee91858e-cf77-49ae-b0c6-6d4bafc18b88 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:36:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2412f8b5-5c12-4994-9a66-f5e0abb6ecde req-ee91858e-cf77-49ae-b0c6-6d4bafc18b88 service nova] Releasing lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:36:29 user nova-compute[71557]: DEBUG nova.compute.manager [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-changed-925f7823-924b-4df5-8bec-5f065331e4fe {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:29 user nova-compute[71557]: DEBUG nova.compute.manager [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Refreshing instance network info cache due to event network-changed-925f7823-924b-4df5-8bec-5f065331e4fe. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:36:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] Acquiring lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:36:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] Acquired lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:36:29 user nova-compute[71557]: DEBUG nova.network.neutron [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Refreshing network info cache for port 925f7823-924b-4df5-8bec-5f065331e4fe {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:36:29 user nova-compute[71557]: DEBUG nova.network.neutron [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Successfully updated port: 718755e4-0ae2-47c0-b5c9-630c5df1e840 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:36:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:36:29 user nova-compute[71557]: DEBUG nova.network.neutron [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:36:30 user nova-compute[71557]: DEBUG nova.network.neutron [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:36:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] Releasing lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:36:30 user nova-compute[71557]: DEBUG nova.compute.manager [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-changed-23c5dfaa-4003-410d-836e-4218b879cf66 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:30 user nova-compute[71557]: DEBUG nova.compute.manager [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Refreshing instance network info cache due to event network-changed-23c5dfaa-4003-410d-836e-4218b879cf66. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:36:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] Acquiring lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:36:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] Acquired lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:36:30 user nova-compute[71557]: DEBUG nova.network.neutron [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Refreshing network info cache for port 23c5dfaa-4003-410d-836e-4218b879cf66 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:36:30 user nova-compute[71557]: DEBUG nova.network.neutron [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:36:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:30 user nova-compute[71557]: DEBUG nova.network.neutron [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:36:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6e9e3b01-d786-4b0d-b7c9-2e65c6878221 req-338651e7-7edb-46c5-8122-de9a67e8de74 service nova] Releasing lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:36:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquired lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:36:30 user nova-compute[71557]: DEBUG nova.network.neutron [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:36:31 user nova-compute[71557]: DEBUG nova.compute.manager [req-2c695850-e9a1-4838-b74d-90c2e27882f0 req-efaa2a90-ad47-4ef0-b953-da9bf55f7802 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-changed-718755e4-0ae2-47c0-b5c9-630c5df1e840 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:31 user nova-compute[71557]: DEBUG nova.compute.manager [req-2c695850-e9a1-4838-b74d-90c2e27882f0 req-efaa2a90-ad47-4ef0-b953-da9bf55f7802 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Refreshing instance network info cache due to event network-changed-718755e4-0ae2-47c0-b5c9-630c5df1e840. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:36:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2c695850-e9a1-4838-b74d-90c2e27882f0 req-efaa2a90-ad47-4ef0-b953-da9bf55f7802 service nova] Acquiring lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:36:31 user nova-compute[71557]: DEBUG nova.network.neutron [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:36:32 user nova-compute[71557]: INFO nova.virt.block_device [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Booting with volume 7b206a0b-d64c-4f10-b072-f1473bf5f2ca at /dev/vdc
Apr 12 10:36:32 user nova-compute[71557]: DEBUG os_brick.utils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:36:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae54b6dd-5536-4e6e-b3cd-37fbc39706a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5601b29-75d0-42ea-b70a-34babb95e749]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b11dd1-9013-4a87-b0a0-c95ce8667cf0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0acb8e-c344-41ce-ad93-60f1eb60c588]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:36:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:36:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:36:32 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:36:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c98bb89-58fd-43fc-887b-6e0b927febab]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:36:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:36:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:36:32 user nova-compute[71557]: DEBUG os_brick.utils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] <== get_connector_properties: return (193ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:36:32 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Updating existing volume attachment record: ba6d58d5-ba3a-4124-9e73-18c36100dc22 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:36:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:33 user nova-compute[71557]: DEBUG nova.network.neutron [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Updating instance_info_cache with network_info: [{"id": "fe31a29c-b57d-463d-98ba-6527848edeba", "address": "fa:16:3e:04:9a:84", "network": {"id": "487a3034-5a63-4896-a029-be581b719991", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-754944090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe31a29c-b5", "ovs_interfaceid": "fe31a29c-b57d-463d-98ba-6527848edeba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "address": "fa:16:3e:7f:41:2c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e2f100-f6", "ovs_interfaceid": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "address": "fa:16:3e:b0:8e:21", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307fee9a-af", "ovs_interfaceid": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1173b214-caa3-4d2b-9ee4-efe4ab063cac", "address": "fa:16:3e:c3:05:a8", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1173b214-ca", "ovs_interfaceid": "1173b214-caa3-4d2b-9ee4-efe4ab063cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "925f7823-924b-4df5-8bec-5f065331e4fe", "address": "fa:16:3e:41:4d:9c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap925f7823-92", "ovs_interfaceid": "925f7823-924b-4df5-8bec-5f065331e4fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23c5dfaa-4003-410d-836e-4218b879cf66", "address": "fa:16:3e:49:60:f7", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c5dfaa-40", "ovs_interfaceid": "23c5dfaa-4003-410d-836e-4218b879cf66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "address": "fa:16:3e:d3:ce:bd", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap718755e4-0a", "ovs_interfaceid": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:36:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Releasing lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:36:33 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Instance network_info: |[{"id": "fe31a29c-b57d-463d-98ba-6527848edeba", "address": "fa:16:3e:04:9a:84", "network": {"id": "487a3034-5a63-4896-a029-be581b719991", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-754944090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe31a29c-b5", "ovs_interfaceid": "fe31a29c-b57d-463d-98ba-6527848edeba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "address": "fa:16:3e:7f:41:2c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e2f100-f6", "ovs_interfaceid": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "address": "fa:16:3e:b0:8e:21", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307fee9a-af", "ovs_interfaceid": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1173b214-caa3-4d2b-9ee4-efe4ab063cac", "address": "fa:16:3e:c3:05:a8", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1173b214-ca", "ovs_interfaceid": "1173b214-caa3-4d2b-9ee4-efe4ab063cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "925f7823-924b-4df5-8bec-5f065331e4fe", "address": "fa:16:3e:41:4d:9c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap925f7823-92", "ovs_interfaceid": "925f7823-924b-4df5-8bec-5f065331e4fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23c5dfaa-4003-410d-836e-4218b879cf66", "address": "fa:16:3e:49:60:f7", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c5dfaa-40", "ovs_interfaceid": "23c5dfaa-4003-410d-836e-4218b879cf66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "address": "fa:16:3e:d3:ce:bd", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap718755e4-0a", "ovs_interfaceid": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:36:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2c695850-e9a1-4838-b74d-90c2e27882f0 req-efaa2a90-ad47-4ef0-b953-da9bf55f7802 service nova] Acquired lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:36:33 user nova-compute[71557]: DEBUG nova.network.neutron [req-2c695850-e9a1-4838-b74d-90c2e27882f0 req-efaa2a90-ad47-4ef0-b953-da9bf55f7802 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Refreshing network info cache for port 718755e4-0ae2-47c0-b5c9-630c5df1e840 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:36:33 user nova-compute[71557]: DEBUG nova.network.neutron [req-2c695850-e9a1-4838-b74d-90c2e27882f0 req-efaa2a90-ad47-4ef0-b953-da9bf55f7802 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Updated VIF entry in instance network info cache for port 718755e4-0ae2-47c0-b5c9-630c5df1e840. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:36:33 user nova-compute[71557]: DEBUG nova.network.neutron [req-2c695850-e9a1-4838-b74d-90c2e27882f0 req-efaa2a90-ad47-4ef0-b953-da9bf55f7802 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Updating instance_info_cache with network_info: [{"id": "fe31a29c-b57d-463d-98ba-6527848edeba", "address": "fa:16:3e:04:9a:84", "network": {"id": "487a3034-5a63-4896-a029-be581b719991", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-754944090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe31a29c-b5", "ovs_interfaceid": "fe31a29c-b57d-463d-98ba-6527848edeba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "address": "fa:16:3e:7f:41:2c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e2f100-f6", "ovs_interfaceid": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "address": "fa:16:3e:b0:8e:21", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307fee9a-af", "ovs_interfaceid": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1173b214-caa3-4d2b-9ee4-efe4ab063cac", "address": "fa:16:3e:c3:05:a8", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1173b214-ca", "ovs_interfaceid": "1173b214-caa3-4d2b-9ee4-efe4ab063cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "925f7823-924b-4df5-8bec-5f065331e4fe", "address": "fa:16:3e:41:4d:9c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap925f7823-92", "ovs_interfaceid": "925f7823-924b-4df5-8bec-5f065331e4fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23c5dfaa-4003-410d-836e-4218b879cf66", "address": "fa:16:3e:49:60:f7", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c5dfaa-40", "ovs_interfaceid": "23c5dfaa-4003-410d-836e-4218b879cf66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "address": "fa:16:3e:d3:ce:bd", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap718755e4-0a", "ovs_interfaceid": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:36:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2c695850-e9a1-4838-b74d-90c2e27882f0 req-efaa2a90-ad47-4ef0-b953-da9bf55f7802 service nova] Releasing lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:36:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:36:36 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Creating image(s)
Apr 12 10:36:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Did not create local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Ensure instance console log exists: /opt/stack/data/nova/instances/b9fd76e3-c7ed-4631-b056-3bd13439f7d3/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Start _get_guest_xml network_info=[{"id": "fe31a29c-b57d-463d-98ba-6527848edeba", "address": "fa:16:3e:04:9a:84", "network": {"id": "487a3034-5a63-4896-a029-be581b719991", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-754944090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe31a29c-b5", "ovs_interfaceid": "fe31a29c-b57d-463d-98ba-6527848edeba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "address": "fa:16:3e:7f:41:2c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e2f100-f6", "ovs_interfaceid": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "address": "fa:16:3e:b0:8e:21", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307fee9a-af", "ovs_interfaceid": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1173b214-caa3-4d2b-9ee4-efe4ab063cac", "address": "fa:16:3e:c3:05:a8", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1173b214-ca", "ovs_interfaceid": "1173b214-caa3-4d2b-9ee4-efe4ab063cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "925f7823-924b-4df5-8bec-5f065331e4fe", "address": "fa:16:3e:41:4d:9c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap925f7823-92", "ovs_interfaceid": "925f7823-924b-4df5-8bec-5f065331e4fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23c5dfaa-4003-410d-836e-4218b879cf66", "address": "fa:16:3e:49:60:f7", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c5dfaa-40", "ovs_interfaceid": "23c5dfaa-4003-410d-836e-4218b879cf66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "address": "fa:16:3e:d3:ce:bd", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap718755e4-0a", "ovs_interfaceid": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'e959a21b-bb7d-4ef5-a80d-643a4ea0c824', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYhORJSe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b9fd76e3-c7ed-4631-b056-3bd13439f7d3', 'attached_at': '', 'detached_at': '', 'volume_id': '5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd', 'serial': '5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd'}, 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': 1, 'guest_format': None, 'attachment_id': 'd9cb20f7-145d-4bf7-a274-cc07598b64d1', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmHtNICB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b9fd76e3-c7ed-4631-b056-3bd13439f7d3', 'attached_at': '', 'detached_at': '', 'volume_id': 'eb1f25c3-c274-4c2d-b5be-af3f13f3e84f', 'serial': 'eb1f25c3-c274-4c2d-b5be-af3f13f3e84f'}, 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'boot_index': 2, 'guest_format': None, 'attachment_id': 'ba6d58d5-ba3a-4124-9e73-18c36100dc22', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usCHNVDL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b9fd76e3-c7ed-4631-b056-3bd13439f7d3', 'attached_at': '', 'detached_at': '', 'volume_id': '7b206a0b-d64c-4f10-b072-f1473bf5f2ca', 'serial': '7b206a0b-d64c-4f10-b072-f1473bf5f2ca'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:36:36 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:36:36 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:36:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG os_brick.initiator.connector [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Factory for ISCSI on None {{(pid=71557) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYhORJSe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:36:36 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:36:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:36:36 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:36:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:36:36 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:36:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd46b0c-d2b0-4072-aa91-8a223c1c95da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:36:36 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[71617095-c9df-4767-9ff1-89a1714294e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd] added
Apr 12 10:36:37 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69f1608-e468-40f0-9d37-6d6fc8dd5057]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f6fa77-4707-4eb2-84df-a4f6c72a233a]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cYhORJSe {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cYhORJSe" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2149012a-113b-4cc1-be11-0cf0bda2814b]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cYhORJSe'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f465b9ab-480b-48d6-8e2c-17e1491f2c46]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ad8ef0-e6a2-4d65-af9d-137e68192d58]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 10:36:37 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 10:36:37 user nova-compute[71557]:  {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:36:37 user nova-compute[71557]: WARNING os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 10:36:37 user nova-compute[71557]: 
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f15c569-6fc4-475c-855c-f427a0747560]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd, portal: 172.16.0.220,3260]
Apr 12 10:36:37 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd, portal: 172.16.0.220,3260] successful.
Apr 12 10:36:37 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5160300-9b87-4b07-8ffe-4be00b32f8f3]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[495e2dd7-232c-4e2c-b566-b7d664cecdb6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:36:37 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:36:37 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f6916d-e1dd-4d90-8d41-fd4da06719b5]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:36:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYhORJSe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23136323665313265', 'path': '/dev/sdb'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136323665313265', 'path': '/dev/sdb'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmHtNICB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:36:38 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:36:38 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:36:38 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6577d402-4abf-46c4-8251-7289b12657e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:36:38 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5adb37-62a6-44cc-afb5-42625668234a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f] added
Apr 12 10:36:38 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b6a1a7-58b0-4879-bdfa-96d35164c9ce]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf17626-8489-47fa-8f41-c7f6b57440a9]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GmHtNICB {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GmHtNICB" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b98790d-125a-41ae-885c-8dcf955afa6a]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GmHtNICB'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58e836a-fef5-4d2d-b240-a1cb5e57f212]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[da301d68-a90c-4bdf-94bd-bbf8695033f7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:36:38 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:36:38 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4414ac75-4aa6-493f-b108-ea1984c20aba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f, portal: 172.16.0.220,3260]
Apr 12 10:36:38 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f, portal: 172.16.0.220,3260] successful.
Apr 12 10:36:38 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c13197-63a6-4c2e-86a7-248f297f7a27]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf282e1-c1f4-4700-96b2-ead38892a925]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:36:38 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:36:38 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:36:38 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:36:38 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daab08c-94dc-43da-bb57-9f62451dc430]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:36:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmHtNICB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23962333231623165', 'path': '/dev/sdc'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962333231623165', 'path': '/dev/sdc'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usCHNVDL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:36:39 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:36:39 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:36:39 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6c2845-ffde-4e66-b204-381e18372f3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:36:39 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb2358e-a867-4bb9-bd85-1f4549e9ba35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca] added
Apr 12 10:36:39 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b3f20d-05dc-481c-8cbe-6b0a96dd6ccf]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[266f3cba-c709-4e55-a2e3-202b0d776260]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v usCHNVDL {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v usCHNVDL" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcef303-5a95-4349-afec-367509aff0cc]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'usCHNVDL'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cffbe9-238e-4d81-864d-004a25923e9c]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[833430fe-a956-4273-94c1-17529d8fa606]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:36:39 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:36:39 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:36:39 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:36:39 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ea38e5-adbf-452c-a045-148194ce4225]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca, portal: 172.16.0.220,3260]
Apr 12 10:36:39 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca, portal: 172.16.0.220,3260] successful.
Apr 12 10:36:39 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e0c5cd-a6f1-4b3e-9286-f681d9222f64]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a44a76-3683-4e40-b8b4-7959249ff2a9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:36:39 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:36:39 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:36:39 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:36:39 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:36:39 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:36:39 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d5dcca-85ab-41b1-8c2b-6717ea32e745]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:36:39 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usCHNVDL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23365633361363535', 'path': '/dev/sdd'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365633361363535', 'path': '/dev/sdd'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-294974011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-294974011',id=11,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBbhZM6FHyb7OoBiL7tXVD9RTsDb5IWjWMgDXbi5oOKRJjUMkLSqayOoq+9fpq9oQu4F57O2IwTtOYZdDfjQCXB2a+FJKKNCs+mfOi/2wgZGCXUo+TcvBLhs27dkbJDg==',key_name='tempest-keypair-1600069342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fcfbd94249342b2a436d2592e0dc9bf',ramdisk_id='',reservation_id='r-lwww07gj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-639083036',owner_user_name='tempest-TaggedBootDevicesTest_v242-639083036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='949ebef2d45b4d64a89a11d837dfffd3',uuid=b9fd76e3-c7ed-4631-b056-3bd13439f7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe31a29c-b57d-463d-98ba-6527848edeba", "address": "fa:16:3e:04:9a:84", "network": {"id": "487a3034-5a63-4896-a029-be581b719991", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-754944090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe31a29c-b5", "ovs_interfaceid": "fe31a29c-b57d-463d-98ba-6527848edeba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converting VIF {"id": "fe31a29c-b57d-463d-98ba-6527848edeba", "address": "fa:16:3e:04:9a:84", "network": {"id": "487a3034-5a63-4896-a029-be581b719991", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-754944090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe31a29c-b5", "ovs_interfaceid": "fe31a29c-b57d-463d-98ba-6527848edeba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:9a:84,bridge_name='br-int',has_traffic_filtering=True,id=fe31a29c-b57d-463d-98ba-6527848edeba,network=Network(487a3034-5a63-4896-a029-be581b719991),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe31a29c-b5') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-294974011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-294974011',id=11,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBbhZM6FHyb7OoBiL7tXVD9RTsDb5IWjWMgDXbi5oOKRJjUMkLSqayOoq+9fpq9oQu4F57O2IwTtOYZdDfjQCXB2a+FJKKNCs+mfOi/2wgZGCXUo+TcvBLhs27dkbJDg==',key_name='tempest-keypair-1600069342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fcfbd94249342b2a436d2592e0dc9bf',ramdisk_id='',reservation_id='r-lwww07gj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-639083036',owner_user_name='tempest-TaggedBootDevicesTest_v242-639083036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='949ebef2d45b4d64a89a11d837dfffd3',uuid=b9fd76e3-c7ed-4631-b056-3bd13439f7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "address": "fa:16:3e:7f:41:2c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e2f100-f6", "ovs_interfaceid": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converting VIF {"id": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "address": "fa:16:3e:7f:41:2c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e2f100-f6", "ovs_interfaceid": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:41:2c,bridge_name='br-int',has_traffic_filtering=True,id=c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc5e2f100-f6') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-294974011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-294974011',id=11,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBbhZM6FHyb7OoBiL7tXVD9RTsDb5IWjWMgDXbi5oOKRJjUMkLSqayOoq+9fpq9oQu4F57O2IwTtOYZdDfjQCXB2a+FJKKNCs+mfOi/2wgZGCXUo+TcvBLhs27dkbJDg==',key_name='tempest-keypair-1600069342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fcfbd94249342b2a436d2592e0dc9bf',ramdisk_id='',reservation_id='r-lwww07gj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-639083036',owner_user_name='tempest-TaggedBootDevicesTest_v242-639083036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='949ebef2d45b4d64a89a11d837dfffd3',uuid=b9fd76e3-c7ed-4631-b056-3bd13439f7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "address": "fa:16:3e:b0:8e:21", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307fee9a-af", "ovs_interfaceid": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converting VIF {"id": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "address": "fa:16:3e:b0:8e:21", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307fee9a-af", "ovs_interfaceid": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8e:21,bridge_name='br-int',has_traffic_filtering=True,id=307fee9a-af5f-45a9-b678-7cb16cfad99d,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap307fee9a-af') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-294974011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-294974011',id=11,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBbhZM6FHyb7OoBiL7tXVD9RTsDb5IWjWMgDXbi5oOKRJjUMkLSqayOoq+9fpq9oQu4F57O2IwTtOYZdDfjQCXB2a+FJKKNCs+mfOi/2wgZGCXUo+TcvBLhs27dkbJDg==',key_name='tempest-keypair-1600069342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fcfbd94249342b2a436d2592e0dc9bf',ramdisk_id='',reservation_id='r-lwww07gj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-639083036',owner_user_name='tempest-TaggedBootDevicesTest_v242-639083036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='949ebef2d45b4d64a89a11d837dfffd3',uuid=b9fd76e3-c7ed-4631-b056-3bd13439f7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1173b214-caa3-4d2b-9ee4-efe4ab063cac", "address": "fa:16:3e:c3:05:a8", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1173b214-ca", "ovs_interfaceid": "1173b214-caa3-4d2b-9ee4-efe4ab063cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converting VIF {"id": "1173b214-caa3-4d2b-9ee4-efe4ab063cac", "address": "fa:16:3e:c3:05:a8", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1173b214-ca", "ovs_interfaceid": "1173b214-caa3-4d2b-9ee4-efe4ab063cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:05:a8,bridge_name='br-int',has_traffic_filtering=True,id=1173b214-caa3-4d2b-9ee4-efe4ab063cac,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1173b214-ca') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-294974011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-294974011',id=11,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBbhZM6FHyb7OoBiL7tXVD9RTsDb5IWjWMgDXbi5oOKRJjUMkLSqayOoq+9fpq9oQu4F57O2IwTtOYZdDfjQCXB2a+FJKKNCs+mfOi/2wgZGCXUo+TcvBLhs27dkbJDg==',key_name='tempest-keypair-1600069342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fcfbd94249342b2a436d2592e0dc9bf',ramdisk_id='',reservation_id='r-lwww07gj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-639083036',owner_user_name='tempest-TaggedBootDevicesTest_v242-639083036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='949ebef2d45b4d64a89a11d837dfffd3',uuid=b9fd76e3-c7ed-4631-b056-3bd13439f7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "925f7823-924b-4df5-8bec-5f065331e4fe", "address": "fa:16:3e:41:4d:9c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap925f7823-92", "ovs_interfaceid": "925f7823-924b-4df5-8bec-5f065331e4fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converting VIF {"id": "925f7823-924b-4df5-8bec-5f065331e4fe", "address": "fa:16:3e:41:4d:9c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap925f7823-92", "ovs_interfaceid": "925f7823-924b-4df5-8bec-5f065331e4fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:4d:9c,bridge_name='br-int',has_traffic_filtering=True,id=925f7823-924b-4df5-8bec-5f065331e4fe,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap925f7823-92') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-294974011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-294974011',id=11,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBbhZM6FHyb7OoBiL7tXVD9RTsDb5IWjWMgDXbi5oOKRJjUMkLSqayOoq+9fpq9oQu4F57O2IwTtOYZdDfjQCXB2a+FJKKNCs+mfOi/2wgZGCXUo+TcvBLhs27dkbJDg==',key_name='tempest-keypair-1600069342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fcfbd94249342b2a436d2592e0dc9bf',ramdisk_id='',reservation_id='r-lwww07gj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-639083036',owner_user_name='tempest-TaggedBootDevicesTest_v242-639083036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='949ebef2d45b4d64a89a11d837dfffd3',uuid=b9fd76e3-c7ed-4631-b056-3bd13439f7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23c5dfaa-4003-410d-836e-4218b879cf66", "address": "fa:16:3e:49:60:f7", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c5dfaa-40", "ovs_interfaceid": "23c5dfaa-4003-410d-836e-4218b879cf66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converting VIF {"id": "23c5dfaa-4003-410d-836e-4218b879cf66", "address": "fa:16:3e:49:60:f7", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c5dfaa-40", "ovs_interfaceid": "23c5dfaa-4003-410d-836e-4218b879cf66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:60:f7,bridge_name='br-int',has_traffic_filtering=True,id=23c5dfaa-4003-410d-836e-4218b879cf66,network=Network(47aa3673-739f-40a5-90b5-9bdc59b7590c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c5dfaa-40') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-294974011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-294974011',id=11,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBbhZM6FHyb7OoBiL7tXVD9RTsDb5IWjWMgDXbi5oOKRJjUMkLSqayOoq+9fpq9oQu4F57O2IwTtOYZdDfjQCXB2a+FJKKNCs+mfOi/2wgZGCXUo+TcvBLhs27dkbJDg==',key_name='tempest-keypair-1600069342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fcfbd94249342b2a436d2592e0dc9bf',ramdisk_id='',reservation_id='r-lwww07gj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-639083036',owner_user_name='tempest-TaggedBootDevicesTest_v242-639083036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='949ebef2d45b4d64a89a11d837dfffd3',uuid=b9fd76e3-c7ed-4631-b056-3bd13439f7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "address": "fa:16:3e:d3:ce:bd", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap718755e4-0a", "ovs_interfaceid": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converting VIF {"id": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "address": "fa:16:3e:d3:ce:bd", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap718755e4-0a", "ovs_interfaceid": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ce:bd,bridge_name='br-int',has_traffic_filtering=True,id=718755e4-0ae2-47c0-b5c9-630c5df1e840,network=Network(47aa3673-739f-40a5-90b5-9bdc59b7590c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap718755e4-0a') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.objects.instance [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lazy-loading 'pci_devices' on Instance uuid b9fd76e3-c7ed-4631-b056-3bd13439f7d3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:36:40 user nova-compute[71557]:   <uuid>b9fd76e3-c7ed-4631-b056-3bd13439f7d3</uuid>
Apr 12 10:36:40 user nova-compute[71557]:   <name>instance-0000000b</name>
Apr 12 10:36:40 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:36:40 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:36:40 user nova-compute[71557]:   <metadata>
Apr 12 10:36:40 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:36:40 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:36:40 user nova-compute[71557]:       <nova:name>tempest-device-tagging-server-294974011</nova:name>
Apr 12 10:36:40 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:36:36</nova:creationTime>
Apr 12 10:36:40 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:36:40 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:36:40 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:36:40 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:36:40 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:36:40 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:36:40 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:36:40 user nova-compute[71557]:       <nova:owner>
Apr 12 10:36:40 user nova-compute[71557]:         <nova:user uuid="949ebef2d45b4d64a89a11d837dfffd3">tempest-TaggedBootDevicesTest_v242-639083036-project-member</nova:user>
Apr 12 10:36:40 user nova-compute[71557]:         <nova:project uuid="1fcfbd94249342b2a436d2592e0dc9bf">tempest-TaggedBootDevicesTest_v242-639083036</nova:project>
Apr 12 10:36:40 user nova-compute[71557]:       </nova:owner>
Apr 12 10:36:40 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:36:40 user nova-compute[71557]:       <nova:ports>
Apr 12 10:36:40 user nova-compute[71557]:         <nova:port uuid="fe31a29c-b57d-463d-98ba-6527848edeba">
Apr 12 10:36:40 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 10:36:40 user nova-compute[71557]:         </nova:port>
Apr 12 10:36:40 user nova-compute[71557]:         <nova:port uuid="c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5">
Apr 12 10:36:40 user nova-compute[71557]:           <nova:ip type="fixed" address="10.1.1.138" ipVersion="4"/>
Apr 12 10:36:40 user nova-compute[71557]:         </nova:port>
Apr 12 10:36:40 user nova-compute[71557]:         <nova:port uuid="307fee9a-af5f-45a9-b678-7cb16cfad99d">
Apr 12 10:36:40 user nova-compute[71557]:           <nova:ip type="fixed" address="10.1.1.30" ipVersion="4"/>
Apr 12 10:36:40 user nova-compute[71557]:         </nova:port>
Apr 12 10:36:40 user nova-compute[71557]:         <nova:port uuid="1173b214-caa3-4d2b-9ee4-efe4ab063cac">
Apr 12 10:36:40 user nova-compute[71557]:           <nova:ip type="fixed" address="10.1.1.12" ipVersion="4"/>
Apr 12 10:36:40 user nova-compute[71557]:         </nova:port>
Apr 12 10:36:40 user nova-compute[71557]:         <nova:port uuid="925f7823-924b-4df5-8bec-5f065331e4fe">
Apr 12 10:36:40 user nova-compute[71557]:           <nova:ip type="fixed" address="10.1.1.59" ipVersion="4"/>
Apr 12 10:36:40 user nova-compute[71557]:         </nova:port>
Apr 12 10:36:40 user nova-compute[71557]:         <nova:port uuid="23c5dfaa-4003-410d-836e-4218b879cf66">
Apr 12 10:36:40 user nova-compute[71557]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 12 10:36:40 user nova-compute[71557]:         </nova:port>
Apr 12 10:36:40 user nova-compute[71557]:         <nova:port uuid="718755e4-0ae2-47c0-b5c9-630c5df1e840">
Apr 12 10:36:40 user nova-compute[71557]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 12 10:36:40 user nova-compute[71557]:         </nova:port>
Apr 12 10:36:40 user nova-compute[71557]:       </nova:ports>
Apr 12 10:36:40 user nova-compute[71557]:     </nova:instance>
Apr 12 10:36:40 user nova-compute[71557]:   </metadata>
Apr 12 10:36:40 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:36:40 user nova-compute[71557]:     <system>
Apr 12 10:36:40 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:36:40 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:36:40 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:36:40 user nova-compute[71557]:       <entry name="serial">b9fd76e3-c7ed-4631-b056-3bd13439f7d3</entry>
Apr 12 10:36:40 user nova-compute[71557]:       <entry name="uuid">b9fd76e3-c7ed-4631-b056-3bd13439f7d3</entry>
Apr 12 10:36:40 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:36:40 user nova-compute[71557]:     </system>
Apr 12 10:36:40 user nova-compute[71557]:   </sysinfo>
Apr 12 10:36:40 user nova-compute[71557]:   <os>
Apr 12 10:36:40 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:36:40 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:36:40 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:36:40 user nova-compute[71557]:   </os>
Apr 12 10:36:40 user nova-compute[71557]:   <features>
Apr 12 10:36:40 user nova-compute[71557]:     <acpi/>
Apr 12 10:36:40 user nova-compute[71557]:     <apic/>
Apr 12 10:36:40 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:36:40 user nova-compute[71557]:   </features>
Apr 12 10:36:40 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:36:40 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:36:40 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:36:40 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:36:40 user nova-compute[71557]:   </clock>
Apr 12 10:36:40 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:36:40 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:36:40 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:36:40 user nova-compute[71557]:   </cpu>
Apr 12 10:36:40 user nova-compute[71557]:   <devices>
Apr 12 10:36:40 user nova-compute[71557]:     <disk type="file" device="cdrom">
Apr 12 10:36:40 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 10:36:40 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/b9fd76e3-c7ed-4631-b056-3bd13439f7d3/disk.config"/>
Apr 12 10:36:40 user nova-compute[71557]:       <target dev="hda" bus="ide"/>
Apr 12 10:36:40 user nova-compute[71557]:     </disk>
Apr 12 10:36:40 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:36:40 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:36:40 user nova-compute[71557]:       <source dev="/dev/sdb"/>
Apr 12 10:36:40 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:36:40 user nova-compute[71557]:       <serial>5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd</serial>
Apr 12 10:36:40 user nova-compute[71557]:     </disk>
Apr 12 10:36:40 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:36:40 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:36:40 user nova-compute[71557]:       <source dev="/dev/sdc"/>
Apr 12 10:36:40 user nova-compute[71557]:       <target dev="vdb" bus="virtio"/>
Apr 12 10:36:40 user nova-compute[71557]:       <serial>eb1f25c3-c274-4c2d-b5be-af3f13f3e84f</serial>
Apr 12 10:36:40 user nova-compute[71557]:     </disk>
Apr 12 10:36:40 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:36:40 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:36:40 user nova-compute[71557]:       <source dev="/dev/sdd"/>
Apr 12 10:36:40 user nova-compute[71557]:       <target dev="vdc" bus="virtio"/>
Apr 12 10:36:40 user nova-compute[71557]:       <serial>7b206a0b-d64c-4f10-b072-f1473bf5f2ca</serial>
Apr 12 10:36:40 user nova-compute[71557]:     </disk>
Apr 12 10:36:40 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:36:40 user nova-compute[71557]:       <mac address="fa:16:3e:04:9a:84"/>
Apr 12 10:36:40 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:36:40 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:36:40 user nova-compute[71557]:       <target dev="tapfe31a29c-b5"/>
Apr 12 10:36:40 user nova-compute[71557]:     </interface>
Apr 12 10:36:40 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:36:40 user nova-compute[71557]:       <mac address="fa:16:3e:7f:41:2c"/>
Apr 12 10:36:40 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:36:40 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:36:40 user nova-compute[71557]:       <target dev="tapc5e2f100-f6"/>
Apr 12 10:36:40 user nova-compute[71557]:     </interface>
Apr 12 10:36:40 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:36:40 user nova-compute[71557]:       <mac address="fa:16:3e:b0:8e:21"/>
Apr 12 10:36:40 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:36:40 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:36:40 user nova-compute[71557]:       <target dev="tap307fee9a-af"/>
Apr 12 10:36:40 user nova-compute[71557]:     </interface>
Apr 12 10:36:40 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:36:40 user nova-compute[71557]:       <mac address="fa:16:3e:c3:05:a8"/>
Apr 12 10:36:40 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:36:40 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:36:40 user nova-compute[71557]:       <target dev="tap1173b214-ca"/>
Apr 12 10:36:40 user nova-compute[71557]:     </interface>
Apr 12 10:36:40 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:36:40 user nova-compute[71557]:       <mac address="fa:16:3e:41:4d:9c"/>
Apr 12 10:36:40 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:36:40 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:36:40 user nova-compute[71557]:       <target dev="tap925f7823-92"/>
Apr 12 10:36:40 user nova-compute[71557]:     </interface>
Apr 12 10:36:40 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:36:40 user nova-compute[71557]:       <mac address="fa:16:3e:49:60:f7"/>
Apr 12 10:36:40 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:36:40 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:36:40 user nova-compute[71557]:       <target dev="tap23c5dfaa-40"/>
Apr 12 10:36:40 user nova-compute[71557]:     </interface>
Apr 12 10:36:40 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:36:40 user nova-compute[71557]:       <mac address="fa:16:3e:d3:ce:bd"/>
Apr 12 10:36:40 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:36:40 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:36:40 user nova-compute[71557]:       <target dev="tap718755e4-0a"/>
Apr 12 10:36:40 user nova-compute[71557]:     </interface>
Apr 12 10:36:40 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:36:40 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/b9fd76e3-c7ed-4631-b056-3bd13439f7d3/console.log" append="off"/>
Apr 12 10:36:40 user nova-compute[71557]:     </serial>
Apr 12 10:36:40 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:36:40 user nova-compute[71557]:     <video>
Apr 12 10:36:40 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:36:40 user nova-compute[71557]:     </video>
Apr 12 10:36:40 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:36:40 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:36:40 user nova-compute[71557]:     </rng>
Apr 12 10:36:40 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:36:40 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:36:40 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:36:40 user nova-compute[71557]:     </memballoon>
Apr 12 10:36:40 user nova-compute[71557]:   </devices>
Apr 12 10:36:40 user nova-compute[71557]: </domain>
Apr 12 10:36:40 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-294974011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-294974011',id=11,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBbhZM6FHyb7OoBiL7tXVD9RTsDb5IWjWMgDXbi5oOKRJjUMkLSqayOoq+9fpq9oQu4F57O2IwTtOYZdDfjQCXB2a+FJKKNCs+mfOi/2wgZGCXUo+TcvBLhs27dkbJDg==',key_name='tempest-keypair-1600069342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fcfbd94249342b2a436d2592e0dc9bf',ramdisk_id='',reservation_id='r-lwww07gj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-639083036',owner_user_name='tempest-TaggedBootDevicesTest_v242-639083036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='949ebef2d45b4d64a89a11d837dfffd3',uuid=b9fd76e3-c7ed-4631-b056-3bd13439f7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe31a29c-b57d-463d-98ba-6527848edeba", "address": "fa:16:3e:04:9a:84", "network": {"id": "487a3034-5a63-4896-a029-be581b719991", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-754944090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe31a29c-b5", "ovs_interfaceid": "fe31a29c-b57d-463d-98ba-6527848edeba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converting VIF {"id": "fe31a29c-b57d-463d-98ba-6527848edeba", "address": "fa:16:3e:04:9a:84", "network": {"id": "487a3034-5a63-4896-a029-be581b719991", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-754944090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe31a29c-b5", "ovs_interfaceid": "fe31a29c-b57d-463d-98ba-6527848edeba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:9a:84,bridge_name='br-int',has_traffic_filtering=True,id=fe31a29c-b57d-463d-98ba-6527848edeba,network=Network(487a3034-5a63-4896-a029-be581b719991),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe31a29c-b5') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG os_vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:9a:84,bridge_name='br-int',has_traffic_filtering=True,id=fe31a29c-b57d-463d-98ba-6527848edeba,network=Network(487a3034-5a63-4896-a029-be581b719991),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe31a29c-b5') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe31a29c-b5, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe31a29c-b5, col_values=(('external_ids', {'iface-id': 'fe31a29c-b57d-463d-98ba-6527848edeba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:9a:84', 'vm-uuid': 'b9fd76e3-c7ed-4631-b056-3bd13439f7d3'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:40 user nova-compute[71557]: INFO os_vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:9a:84,bridge_name='br-int',has_traffic_filtering=True,id=fe31a29c-b57d-463d-98ba-6527848edeba,network=Network(487a3034-5a63-4896-a029-be581b719991),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe31a29c-b5')
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-294974011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-294974011',id=11,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBbhZM6FHyb7OoBiL7tXVD9RTsDb5IWjWMgDXbi5oOKRJjUMkLSqayOoq+9fpq9oQu4F57O2IwTtOYZdDfjQCXB2a+FJKKNCs+mfOi/2wgZGCXUo+TcvBLhs27dkbJDg==',key_name='tempest-keypair-1600069342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fcfbd94249342b2a436d2592e0dc9bf',ramdisk_id='',reservation_id='r-lwww07gj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-639083036',owner_user_name='tempest-TaggedBootDevicesTest_v242-639083036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='949ebef2d45b4d64a89a11d837dfffd3',uuid=b9fd76e3-c7ed-4631-b056-3bd13439f7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "address": "fa:16:3e:7f:41:2c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e2f100-f6", "ovs_interfaceid": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converting VIF {"id": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "address": "fa:16:3e:7f:41:2c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e2f100-f6", "ovs_interfaceid": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:41:2c,bridge_name='br-int',has_traffic_filtering=True,id=c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc5e2f100-f6') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG os_vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:41:2c,bridge_name='br-int',has_traffic_filtering=True,id=c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc5e2f100-f6') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5e2f100-f6, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5e2f100-f6, col_values=(('external_ids', {'iface-id': 'c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:41:2c', 'vm-uuid': 'b9fd76e3-c7ed-4631-b056-3bd13439f7d3'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:41 user nova-compute[71557]: INFO os_vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:41:2c,bridge_name='br-int',has_traffic_filtering=True,id=c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc5e2f100-f6')
Apr 12 10:36:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-294974011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-294974011',id=11,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBbhZM6FHyb7OoBiL7tXVD9RTsDb5IWjWMgDXbi5oOKRJjUMkLSqayOoq+9fpq9oQu4F57O2IwTtOYZdDfjQCXB2a+FJKKNCs+mfOi/2wgZGCXUo+TcvBLhs27dkbJDg==',key_name='tempest-keypair-1600069342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fcfbd94249342b2a436d2592e0dc9bf',ramdisk_id='',reservation_id='r-lwww07gj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-639083036',owner_user_name='tempest-TaggedBootDevicesTest_v242-639083036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='949ebef2d45b4d64a89a11d837dfffd3',uuid=b9fd76e3-c7ed-4631-b056-3bd13439f7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "address": "fa:16:3e:b0:8e:21", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307fee9a-af", "ovs_interfaceid": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converting VIF {"id": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "address": "fa:16:3e:b0:8e:21", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307fee9a-af", "ovs_interfaceid": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8e:21,bridge_name='br-int',has_traffic_filtering=True,id=307fee9a-af5f-45a9-b678-7cb16cfad99d,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap307fee9a-af') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG os_vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8e:21,bridge_name='br-int',has_traffic_filtering=True,id=307fee9a-af5f-45a9-b678-7cb16cfad99d,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap307fee9a-af') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap307fee9a-af, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap307fee9a-af, col_values=(('external_ids', {'iface-id': '307fee9a-af5f-45a9-b678-7cb16cfad99d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:8e:21', 'vm-uuid': 'b9fd76e3-c7ed-4631-b056-3bd13439f7d3'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:41 user nova-compute[71557]: INFO os_vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8e:21,bridge_name='br-int',has_traffic_filtering=True,id=307fee9a-af5f-45a9-b678-7cb16cfad99d,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap307fee9a-af')
Apr 12 10:36:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-294974011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-294974011',id=11,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBbhZM6FHyb7OoBiL7tXVD9RTsDb5IWjWMgDXbi5oOKRJjUMkLSqayOoq+9fpq9oQu4F57O2IwTtOYZdDfjQCXB2a+FJKKNCs+mfOi/2wgZGCXUo+TcvBLhs27dkbJDg==',key_name='tempest-keypair-1600069342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fcfbd94249342b2a436d2592e0dc9bf',ramdisk_id='',reservation_id='r-lwww07gj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-639083036',owner_user_name='tempest-TaggedBootDevicesTest_v242-639083036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='949ebef2d45b4d64a89a11d837dfffd3',uuid=b9fd76e3-c7ed-4631-b056-3bd13439f7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1173b214-caa3-4d2b-9ee4-efe4ab063cac", "address": "fa:16:3e:c3:05:a8", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1173b214-ca", "ovs_interfaceid": "1173b214-caa3-4d2b-9ee4-efe4ab063cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converting VIF {"id": "1173b214-caa3-4d2b-9ee4-efe4ab063cac", "address": "fa:16:3e:c3:05:a8", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1173b214-ca", "ovs_interfaceid": "1173b214-caa3-4d2b-9ee4-efe4ab063cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:05:a8,bridge_name='br-int',has_traffic_filtering=True,id=1173b214-caa3-4d2b-9ee4-efe4ab063cac,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1173b214-ca') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG os_vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:05:a8,bridge_name='br-int',has_traffic_filtering=True,id=1173b214-caa3-4d2b-9ee4-efe4ab063cac,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1173b214-ca') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1173b214-ca, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1173b214-ca, col_values=(('external_ids', {'iface-id': '1173b214-caa3-4d2b-9ee4-efe4ab063cac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:05:a8', 'vm-uuid': 'b9fd76e3-c7ed-4631-b056-3bd13439f7d3'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:41 user nova-compute[71557]: INFO os_vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:05:a8,bridge_name='br-int',has_traffic_filtering=True,id=1173b214-caa3-4d2b-9ee4-efe4ab063cac,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1173b214-ca')
Apr 12 10:36:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-294974011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-294974011',id=11,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBbhZM6FHyb7OoBiL7tXVD9RTsDb5IWjWMgDXbi5oOKRJjUMkLSqayOoq+9fpq9oQu4F57O2IwTtOYZdDfjQCXB2a+FJKKNCs+mfOi/2wgZGCXUo+TcvBLhs27dkbJDg==',key_name='tempest-keypair-1600069342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fcfbd94249342b2a436d2592e0dc9bf',ramdisk_id='',reservation_id='r-lwww07gj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-639083036',owner_user_name='tempest-TaggedBootDevicesTest_v242-639083036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='949ebef2d45b4d64a89a11d837dfffd3',uuid=b9fd76e3-c7ed-4631-b056-3bd13439f7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "925f7823-924b-4df5-8bec-5f065331e4fe", "address": "fa:16:3e:41:4d:9c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap925f7823-92", "ovs_interfaceid": "925f7823-924b-4df5-8bec-5f065331e4fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converting VIF {"id": "925f7823-924b-4df5-8bec-5f065331e4fe", "address": "fa:16:3e:41:4d:9c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap925f7823-92", "ovs_interfaceid": "925f7823-924b-4df5-8bec-5f065331e4fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:4d:9c,bridge_name='br-int',has_traffic_filtering=True,id=925f7823-924b-4df5-8bec-5f065331e4fe,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap925f7823-92') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG os_vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:4d:9c,bridge_name='br-int',has_traffic_filtering=True,id=925f7823-924b-4df5-8bec-5f065331e4fe,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap925f7823-92') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap925f7823-92, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap925f7823-92, col_values=(('external_ids', {'iface-id': '925f7823-924b-4df5-8bec-5f065331e4fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:4d:9c', 'vm-uuid': 'b9fd76e3-c7ed-4631-b056-3bd13439f7d3'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:41 user nova-compute[71557]: INFO os_vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:4d:9c,bridge_name='br-int',has_traffic_filtering=True,id=925f7823-924b-4df5-8bec-5f065331e4fe,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap925f7823-92')
Apr 12 10:36:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-294974011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-294974011',id=11,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBbhZM6FHyb7OoBiL7tXVD9RTsDb5IWjWMgDXbi5oOKRJjUMkLSqayOoq+9fpq9oQu4F57O2IwTtOYZdDfjQCXB2a+FJKKNCs+mfOi/2wgZGCXUo+TcvBLhs27dkbJDg==',key_name='tempest-keypair-1600069342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fcfbd94249342b2a436d2592e0dc9bf',ramdisk_id='',reservation_id='r-lwww07gj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-639083036',owner_user_name='tempest-TaggedBootDevicesTest_v242-639083036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='949ebef2d45b4d64a89a11d837dfffd3',uuid=b9fd76e3-c7ed-4631-b056-3bd13439f7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23c5dfaa-4003-410d-836e-4218b879cf66", "address": "fa:16:3e:49:60:f7", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c5dfaa-40", "ovs_interfaceid": "23c5dfaa-4003-410d-836e-4218b879cf66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converting VIF {"id": "23c5dfaa-4003-410d-836e-4218b879cf66", "address": "fa:16:3e:49:60:f7", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c5dfaa-40", "ovs_interfaceid": "23c5dfaa-4003-410d-836e-4218b879cf66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:60:f7,bridge_name='br-int',has_traffic_filtering=True,id=23c5dfaa-4003-410d-836e-4218b879cf66,network=Network(47aa3673-739f-40a5-90b5-9bdc59b7590c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c5dfaa-40') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG os_vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:60:f7,bridge_name='br-int',has_traffic_filtering=True,id=23c5dfaa-4003-410d-836e-4218b879cf66,network=Network(47aa3673-739f-40a5-90b5-9bdc59b7590c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c5dfaa-40') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23c5dfaa-40, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap23c5dfaa-40, col_values=(('external_ids', {'iface-id': '23c5dfaa-4003-410d-836e-4218b879cf66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:60:f7', 'vm-uuid': 'b9fd76e3-c7ed-4631-b056-3bd13439f7d3'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:41 user nova-compute[71557]: INFO os_vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:60:f7,bridge_name='br-int',has_traffic_filtering=True,id=23c5dfaa-4003-410d-836e-4218b879cf66,network=Network(47aa3673-739f-40a5-90b5-9bdc59b7590c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c5dfaa-40')
Apr 12 10:36:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-294974011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-294974011',id=11,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBbhZM6FHyb7OoBiL7tXVD9RTsDb5IWjWMgDXbi5oOKRJjUMkLSqayOoq+9fpq9oQu4F57O2IwTtOYZdDfjQCXB2a+FJKKNCs+mfOi/2wgZGCXUo+TcvBLhs27dkbJDg==',key_name='tempest-keypair-1600069342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fcfbd94249342b2a436d2592e0dc9bf',ramdisk_id='',reservation_id='r-lwww07gj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-639083036',owner_user_name='tempest-TaggedBootDevicesTest_v242-639083036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='949ebef2d45b4d64a89a11d837dfffd3',uuid=b9fd76e3-c7ed-4631-b056-3bd13439f7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "address": "fa:16:3e:d3:ce:bd", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap718755e4-0a", "ovs_interfaceid": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converting VIF {"id": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "address": "fa:16:3e:d3:ce:bd", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap718755e4-0a", "ovs_interfaceid": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ce:bd,bridge_name='br-int',has_traffic_filtering=True,id=718755e4-0ae2-47c0-b5c9-630c5df1e840,network=Network(47aa3673-739f-40a5-90b5-9bdc59b7590c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap718755e4-0a') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG os_vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ce:bd,bridge_name='br-int',has_traffic_filtering=True,id=718755e4-0ae2-47c0-b5c9-630c5df1e840,network=Network(47aa3673-739f-40a5-90b5-9bdc59b7590c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap718755e4-0a') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap718755e4-0a, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap718755e4-0a, col_values=(('external_ids', {'iface-id': '718755e4-0ae2-47c0-b5c9-630c5df1e840', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:ce:bd', 'vm-uuid': 'b9fd76e3-c7ed-4631-b056-3bd13439f7d3'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:41 user nova-compute[71557]: INFO os_vif [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ce:bd,bridge_name='br-int',has_traffic_filtering=True,id=718755e4-0ae2-47c0-b5c9-630c5df1e840,network=Network(47aa3673-739f-40a5-90b5-9bdc59b7590c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap718755e4-0a')
Apr 12 10:36:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] No BDM found with device name hda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] No VIF found with MAC fa:16:3e:04:9a:84, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] No VIF found with MAC fa:16:3e:41:4d:9c, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:36:41 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Using config drive
Apr 12 10:36:41 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Creating config drive at /opt/stack/data/nova/instances/b9fd76e3-c7ed-4631-b056-3bd13439f7d3/disk.config
Apr 12 10:36:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b9fd76e3-c7ed-4631-b056-3bd13439f7d3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgy74gm_i {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:36:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b9fd76e3-c7ed-4631-b056-3bd13439f7d3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgy74gm_i" returned: 0 in 0.059s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:36:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-0dea8ac6-2ace-48a0-9091-cf53e04d7b2e req-11a206ad-8c69-4a65-9bf8-96e9e61ec9c1 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-plugged-fe31a29c-b57d-463d-98ba-6527848edeba {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0dea8ac6-2ace-48a0-9091-cf53e04d7b2e req-11a206ad-8c69-4a65-9bf8-96e9e61ec9c1 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0dea8ac6-2ace-48a0-9091-cf53e04d7b2e req-11a206ad-8c69-4a65-9bf8-96e9e61ec9c1 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0dea8ac6-2ace-48a0-9091-cf53e04d7b2e req-11a206ad-8c69-4a65-9bf8-96e9e61ec9c1 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-0dea8ac6-2ace-48a0-9091-cf53e04d7b2e req-11a206ad-8c69-4a65-9bf8-96e9e61ec9c1 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-plugged-fe31a29c-b57d-463d-98ba-6527848edeba {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:36:43 user nova-compute[71557]: WARNING nova.compute.manager [req-0dea8ac6-2ace-48a0-9091-cf53e04d7b2e req-11a206ad-8c69-4a65-9bf8-96e9e61ec9c1 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received unexpected event network-vif-plugged-fe31a29c-b57d-463d-98ba-6527848edeba for instance with vm_state building and task_state spawning.
Apr 12 10:36:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-e9558555-f33d-4494-a673-bf4106c19691 req-8e47d134-be34-49e3-aefc-35ef5fdfe645 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-plugged-c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e9558555-f33d-4494-a673-bf4106c19691 req-8e47d134-be34-49e3-aefc-35ef5fdfe645 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e9558555-f33d-4494-a673-bf4106c19691 req-8e47d134-be34-49e3-aefc-35ef5fdfe645 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e9558555-f33d-4494-a673-bf4106c19691 req-8e47d134-be34-49e3-aefc-35ef5fdfe645 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-e9558555-f33d-4494-a673-bf4106c19691 req-8e47d134-be34-49e3-aefc-35ef5fdfe645 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-plugged-c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:36:43 user nova-compute[71557]: WARNING nova.compute.manager [req-e9558555-f33d-4494-a673-bf4106c19691 req-8e47d134-be34-49e3-aefc-35ef5fdfe645 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received unexpected event network-vif-plugged-c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5 for instance with vm_state building and task_state spawning.
Apr 12 10:36:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-44d103aa-7c29-4364-89d4-5f6c3539e442 req-c2a55ee7-094f-4b8e-8b14-460815296572 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-plugged-1173b214-caa3-4d2b-9ee4-efe4ab063cac {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-44d103aa-7c29-4364-89d4-5f6c3539e442 req-c2a55ee7-094f-4b8e-8b14-460815296572 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-44d103aa-7c29-4364-89d4-5f6c3539e442 req-c2a55ee7-094f-4b8e-8b14-460815296572 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-44d103aa-7c29-4364-89d4-5f6c3539e442 req-c2a55ee7-094f-4b8e-8b14-460815296572 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-44d103aa-7c29-4364-89d4-5f6c3539e442 req-c2a55ee7-094f-4b8e-8b14-460815296572 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-plugged-1173b214-caa3-4d2b-9ee4-efe4ab063cac {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:36:44 user nova-compute[71557]: WARNING nova.compute.manager [req-44d103aa-7c29-4364-89d4-5f6c3539e442 req-c2a55ee7-094f-4b8e-8b14-460815296572 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received unexpected event network-vif-plugged-1173b214-caa3-4d2b-9ee4-efe4ab063cac for instance with vm_state building and task_state spawning.
Apr 12 10:36:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:45 user nova-compute[71557]: DEBUG nova.compute.manager [req-3a314bd6-7bd9-4196-aabb-d2e4530b05ec req-e0679357-fad4-4e9b-96c5-1c4765bd8d87 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-plugged-fe31a29c-b57d-463d-98ba-6527848edeba {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3a314bd6-7bd9-4196-aabb-d2e4530b05ec req-e0679357-fad4-4e9b-96c5-1c4765bd8d87 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3a314bd6-7bd9-4196-aabb-d2e4530b05ec req-e0679357-fad4-4e9b-96c5-1c4765bd8d87 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3a314bd6-7bd9-4196-aabb-d2e4530b05ec req-e0679357-fad4-4e9b-96c5-1c4765bd8d87 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:45 user nova-compute[71557]: DEBUG nova.compute.manager [req-3a314bd6-7bd9-4196-aabb-d2e4530b05ec req-e0679357-fad4-4e9b-96c5-1c4765bd8d87 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-plugged-fe31a29c-b57d-463d-98ba-6527848edeba {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:36:45 user nova-compute[71557]: WARNING nova.compute.manager [req-3a314bd6-7bd9-4196-aabb-d2e4530b05ec req-e0679357-fad4-4e9b-96c5-1c4765bd8d87 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received unexpected event network-vif-plugged-fe31a29c-b57d-463d-98ba-6527848edeba for instance with vm_state building and task_state spawning.
Apr 12 10:36:45 user nova-compute[71557]: DEBUG nova.compute.manager [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-plugged-c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:45 user nova-compute[71557]: DEBUG nova.compute.manager [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-plugged-c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:36:45 user nova-compute[71557]: WARNING nova.compute.manager [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received unexpected event network-vif-plugged-c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5 for instance with vm_state building and task_state spawning.
Apr 12 10:36:45 user nova-compute[71557]: DEBUG nova.compute.manager [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-plugged-307fee9a-af5f-45a9-b678-7cb16cfad99d {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:45 user nova-compute[71557]: DEBUG nova.compute.manager [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-plugged-307fee9a-af5f-45a9-b678-7cb16cfad99d {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:36:45 user nova-compute[71557]: WARNING nova.compute.manager [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received unexpected event network-vif-plugged-307fee9a-af5f-45a9-b678-7cb16cfad99d for instance with vm_state building and task_state spawning.
Apr 12 10:36:45 user nova-compute[71557]: DEBUG nova.compute.manager [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-plugged-307fee9a-af5f-45a9-b678-7cb16cfad99d {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:45 user nova-compute[71557]: DEBUG nova.compute.manager [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-plugged-307fee9a-af5f-45a9-b678-7cb16cfad99d {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:36:45 user nova-compute[71557]: WARNING nova.compute.manager [req-438711e0-8c4e-4723-80e1-569daecd8bcd req-2100908e-dbc4-46a5-b580-d777c750c4b2 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received unexpected event network-vif-plugged-307fee9a-af5f-45a9-b678-7cb16cfad99d for instance with vm_state building and task_state spawning.
Apr 12 10:36:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-plugged-1173b214-caa3-4d2b-9ee4-efe4ab063cac {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-plugged-1173b214-caa3-4d2b-9ee4-efe4ab063cac {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:36:46 user nova-compute[71557]: WARNING nova.compute.manager [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received unexpected event network-vif-plugged-1173b214-caa3-4d2b-9ee4-efe4ab063cac for instance with vm_state building and task_state spawning.
Apr 12 10:36:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-plugged-925f7823-924b-4df5-8bec-5f065331e4fe {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-plugged-925f7823-924b-4df5-8bec-5f065331e4fe {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:36:46 user nova-compute[71557]: WARNING nova.compute.manager [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received unexpected event network-vif-plugged-925f7823-924b-4df5-8bec-5f065331e4fe for instance with vm_state building and task_state spawning.
Apr 12 10:36:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-plugged-925f7823-924b-4df5-8bec-5f065331e4fe {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-plugged-925f7823-924b-4df5-8bec-5f065331e4fe {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:36:46 user nova-compute[71557]: WARNING nova.compute.manager [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received unexpected event network-vif-plugged-925f7823-924b-4df5-8bec-5f065331e4fe for instance with vm_state building and task_state spawning.
Apr 12 10:36:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-plugged-23c5dfaa-4003-410d-836e-4218b879cf66 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-plugged-23c5dfaa-4003-410d-836e-4218b879cf66 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:36:46 user nova-compute[71557]: WARNING nova.compute.manager [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received unexpected event network-vif-plugged-23c5dfaa-4003-410d-836e-4218b879cf66 for instance with vm_state building and task_state spawning.
Apr 12 10:36:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-plugged-23c5dfaa-4003-410d-836e-4218b879cf66 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-plugged-23c5dfaa-4003-410d-836e-4218b879cf66 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:36:46 user nova-compute[71557]: WARNING nova.compute.manager [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received unexpected event network-vif-plugged-23c5dfaa-4003-410d-836e-4218b879cf66 for instance with vm_state building and task_state spawning.
Apr 12 10:36:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-plugged-718755e4-0ae2-47c0-b5c9-630c5df1e840 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-plugged-718755e4-0ae2-47c0-b5c9-630c5df1e840 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:36:46 user nova-compute[71557]: WARNING nova.compute.manager [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received unexpected event network-vif-plugged-718755e4-0ae2-47c0-b5c9-630c5df1e840 for instance with vm_state building and task_state spawning.
Apr 12 10:36:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-plugged-718755e4-0ae2-47c0-b5c9-630c5df1e840 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-plugged-718755e4-0ae2-47c0-b5c9-630c5df1e840 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:36:46 user nova-compute[71557]: WARNING nova.compute.manager [req-025a4dff-8b8c-45c3-8507-a1e37b09a72d req-defbba7e-b5ca-47a1-b305-42ec8c0ced85 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received unexpected event network-vif-plugged-718755e4-0ae2-47c0-b5c9-630c5df1e840 for instance with vm_state building and task_state spawning.
Apr 12 10:36:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295806.961815, b9fd76e3-c7ed-4631-b056-3bd13439f7d3 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:36:46 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] VM Resumed (Lifecycle Event)
Apr 12 10:36:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:36:46 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Instance spawned successfully.
Apr 12 10:36:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:36:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:36:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:36:47 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:36:47 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295806.963421, b9fd76e3-c7ed-4631-b056-3bd13439f7d3 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:36:47 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] VM Started (Lifecycle Event)
Apr 12 10:36:47 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:36:47 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:36:47 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:36:47 user nova-compute[71557]: INFO nova.compute.manager [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Took 10.21 seconds to spawn the instance on the hypervisor.
Apr 12 10:36:47 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:36:47 user nova-compute[71557]: INFO nova.compute.manager [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Took 27.37 seconds to build instance.
Apr 12 10:36:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0827669c-fdb9-4d1b-ab4b-2853fa3a9e6f tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.475s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:51 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:56 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Acquiring lock "270d5d4d-4df6-4ba5-9145-98f343fb3b0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "270d5d4d-4df6-4ba5-9145-98f343fb3b0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Acquiring lock "270d5d4d-4df6-4ba5-9145-98f343fb3b0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:36:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "270d5d4d-4df6-4ba5-9145-98f343fb3b0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:36:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "270d5d4d-4df6-4ba5-9145-98f343fb3b0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:36:59 user nova-compute[71557]: INFO nova.compute.manager [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Terminating instance
Apr 12 10:36:59 user nova-compute[71557]: DEBUG nova.compute.manager [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:36:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:36:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-54998032-be3f-4f9c-8b20-91037b76c8a0 req-8f698108-1506-4270-a3b3-29f649e492a6 service nova] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Received event network-vif-unplugged-42768d69-c7da-43fb-b092-c5b41ac2d55c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:37:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-54998032-be3f-4f9c-8b20-91037b76c8a0 req-8f698108-1506-4270-a3b3-29f649e492a6 service nova] Acquiring lock "270d5d4d-4df6-4ba5-9145-98f343fb3b0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-54998032-be3f-4f9c-8b20-91037b76c8a0 req-8f698108-1506-4270-a3b3-29f649e492a6 service nova] Lock "270d5d4d-4df6-4ba5-9145-98f343fb3b0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-54998032-be3f-4f9c-8b20-91037b76c8a0 req-8f698108-1506-4270-a3b3-29f649e492a6 service nova] Lock "270d5d4d-4df6-4ba5-9145-98f343fb3b0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-54998032-be3f-4f9c-8b20-91037b76c8a0 req-8f698108-1506-4270-a3b3-29f649e492a6 service nova] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] No waiting events found dispatching network-vif-unplugged-42768d69-c7da-43fb-b092-c5b41ac2d55c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:37:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-54998032-be3f-4f9c-8b20-91037b76c8a0 req-8f698108-1506-4270-a3b3-29f649e492a6 service nova] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Received event network-vif-unplugged-42768d69-c7da-43fb-b092-c5b41ac2d55c for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:37:00 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Instance destroyed successfully.
Apr 12 10:37:00 user nova-compute[71557]: DEBUG nova.objects.instance [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lazy-loading 'resources' on Instance uuid 270d5d4d-4df6-4ba5-9145-98f343fb3b0e {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:37:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-772245965',display_name='tempest-VolumesNegativeTest-instance-772245965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-772245965',id=1,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:35:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d8cbfbed2c843f796e810c6cc8530ba',ramdisk_id='',reservation_id='r-4mgik8wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-452512257',owner_user_name='tempest-VolumesNegativeTest-452512257-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:35:26Z,user_data=None,user_id='064f86e997904027aa9f086e3b137916',uuid=270d5d4d-4df6-4ba5-9145-98f343fb3b0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42768d69-c7da-43fb-b092-c5b41ac2d55c", "address": "fa:16:3e:65:7d:3d", "network": {"id": "b5640ff6-6dc1-44c3-b04c-9e2d4ef8ecb3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fef1d0d3952d43e2be1c2b52c16966b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42768d69-c7", "ovs_interfaceid": "42768d69-c7da-43fb-b092-c5b41ac2d55c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:37:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Converting VIF {"id": "42768d69-c7da-43fb-b092-c5b41ac2d55c", "address": "fa:16:3e:65:7d:3d", "network": {"id": "b5640ff6-6dc1-44c3-b04c-9e2d4ef8ecb3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "fef1d0d3952d43e2be1c2b52c16966b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42768d69-c7", "ovs_interfaceid": "42768d69-c7da-43fb-b092-c5b41ac2d55c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:37:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:7d:3d,bridge_name='br-int',has_traffic_filtering=True,id=42768d69-c7da-43fb-b092-c5b41ac2d55c,network=Network(b5640ff6-6dc1-44c3-b04c-9e2d4ef8ecb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42768d69-c7') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:37:00 user nova-compute[71557]: DEBUG os_vif [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:7d:3d,bridge_name='br-int',has_traffic_filtering=True,id=42768d69-c7da-43fb-b092-c5b41ac2d55c,network=Network(b5640ff6-6dc1-44c3-b04c-9e2d4ef8ecb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42768d69-c7') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:37:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42768d69-c7, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:37:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:37:00 user nova-compute[71557]: INFO os_vif [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:7d:3d,bridge_name='br-int',has_traffic_filtering=True,id=42768d69-c7da-43fb-b092-c5b41ac2d55c,network=Network(b5640ff6-6dc1-44c3-b04c-9e2d4ef8ecb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42768d69-c7')
Apr 12 10:37:00 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Deleting instance files /opt/stack/data/nova/instances/270d5d4d-4df6-4ba5-9145-98f343fb3b0e_del
Apr 12 10:37:00 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Deletion of /opt/stack/data/nova/instances/270d5d4d-4df6-4ba5-9145-98f343fb3b0e_del complete
Apr 12 10:37:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71557) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 12 10:37:00 user nova-compute[71557]: INFO nova.virt.libvirt.host [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] UEFI support detected
Apr 12 10:37:00 user nova-compute[71557]: INFO nova.compute.manager [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Took 1.02 seconds to destroy the instance on the hypervisor.
Apr 12 10:37:00 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:37:00 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:37:00 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:37:01 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:37:01 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Took 0.57 seconds to deallocate network for instance.
Apr 12 10:37:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:01 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Refreshing inventories for resource provider 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 10:37:01 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Updating ProviderTree inventory for provider 24299bcb-a671-492d-9d13-df83697a8f87 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 10:37:01 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Updating inventory in ProviderTree for provider 24299bcb-a671-492d-9d13-df83697a8f87 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 10:37:01 user nova-compute[71557]: DEBUG nova.compute.manager [req-b9906f31-0a8e-4a48-b5ed-3d5f399e8d81 req-e00859b4-d3a6-44db-b460-75e426b788dc service nova] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Received event network-vif-deleted-42768d69-c7da-43fb-b092-c5b41ac2d55c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:37:01 user nova-compute[71557]: INFO nova.compute.manager [req-b9906f31-0a8e-4a48-b5ed-3d5f399e8d81 req-e00859b4-d3a6-44db-b460-75e426b788dc service nova] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Neutron deleted interface 42768d69-c7da-43fb-b092-c5b41ac2d55c; detaching it from the instance and deleting it from the info cache
Apr 12 10:37:01 user nova-compute[71557]: DEBUG nova.network.neutron [req-b9906f31-0a8e-4a48-b5ed-3d5f399e8d81 req-e00859b4-d3a6-44db-b460-75e426b788dc service nova] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:37:01 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Refreshing aggregate associations for resource provider 24299bcb-a671-492d-9d13-df83697a8f87, aggregates: None {{(pid=71557) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 10:37:01 user nova-compute[71557]: DEBUG nova.compute.manager [req-b9906f31-0a8e-4a48-b5ed-3d5f399e8d81 req-e00859b4-d3a6-44db-b460-75e426b788dc service nova] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Detach interface failed, port_id=42768d69-c7da-43fb-b092-c5b41ac2d55c, reason: Instance 270d5d4d-4df6-4ba5-9145-98f343fb3b0e could not be found. {{(pid=71557) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 10:37:01 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Refreshing trait associations for resource provider 24299bcb-a671-492d-9d13-df83697a8f87, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=71557) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 10:37:01 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:37:02 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:37:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.529s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:02 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Deleted allocations for instance 270d5d4d-4df6-4ba5-9145-98f343fb3b0e
Apr 12 10:37:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6e6f64f2-76cf-4e0c-b007-597f648bc0d6 tempest-VolumesNegativeTest-452512257 tempest-VolumesNegativeTest-452512257-project-member] Lock "270d5d4d-4df6-4ba5-9145-98f343fb3b0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.360s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:02 user nova-compute[71557]: DEBUG nova.compute.manager [req-09b059f1-5528-4483-8a9d-8aec010c0285 req-b24dda5f-6bf9-452b-bc20-68ffcc054ffb service nova] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Received event network-vif-plugged-42768d69-c7da-43fb-b092-c5b41ac2d55c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:37:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-09b059f1-5528-4483-8a9d-8aec010c0285 req-b24dda5f-6bf9-452b-bc20-68ffcc054ffb service nova] Acquiring lock "270d5d4d-4df6-4ba5-9145-98f343fb3b0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-09b059f1-5528-4483-8a9d-8aec010c0285 req-b24dda5f-6bf9-452b-bc20-68ffcc054ffb service nova] Lock "270d5d4d-4df6-4ba5-9145-98f343fb3b0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-09b059f1-5528-4483-8a9d-8aec010c0285 req-b24dda5f-6bf9-452b-bc20-68ffcc054ffb service nova] Lock "270d5d4d-4df6-4ba5-9145-98f343fb3b0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:02 user nova-compute[71557]: DEBUG nova.compute.manager [req-09b059f1-5528-4483-8a9d-8aec010c0285 req-b24dda5f-6bf9-452b-bc20-68ffcc054ffb service nova] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] No waiting events found dispatching network-vif-plugged-42768d69-c7da-43fb-b092-c5b41ac2d55c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:37:02 user nova-compute[71557]: WARNING nova.compute.manager [req-09b059f1-5528-4483-8a9d-8aec010c0285 req-b24dda5f-6bf9-452b-bc20-68ffcc054ffb service nova] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Received unexpected event network-vif-plugged-42768d69-c7da-43fb-b092-c5b41ac2d55c for instance with vm_state deleted and task_state None.
Apr 12 10:37:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:15 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:37:15 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:37:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-0f55cab4-8530-4be0-a91d-65671f0dccd9" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:37:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-0f55cab4-8530-4be0-a91d-65671f0dccd9" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:37:15 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:37:15 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681295820.7128234, 270d5d4d-4df6-4ba5-9145-98f343fb3b0e => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:37:15 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] VM Stopped (Lifecycle Event)
Apr 12 10:37:15 user nova-compute[71557]: DEBUG nova.compute.manager [None req-6b71ded7-06be-4ad3-89de-a19464d01168 None None] [instance: 270d5d4d-4df6-4ba5-9145-98f343fb3b0e] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:37:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:15 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Updating instance_info_cache with network_info: [{"id": "e1506948-cd44-4d78-a019-853199016229", "address": "fa:16:3e:a5:75:17", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1506948-cd", "ovs_interfaceid": "e1506948-cd44-4d78-a019-853199016229", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:37:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-0f55cab4-8530-4be0-a91d-65671f0dccd9" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:37:15 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:37:15 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:37:15 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:37:15 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:37:15 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:37:15 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:37:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:15 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:37:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:16 user nova-compute[71557]: DEBUG nova.compute.manager [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:37:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:16 user nova-compute[71557]: INFO nova.compute.manager [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] instance snapshotting
Apr 12 10:37:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:16 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Beginning live snapshot process
Apr 12 10:37:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json -f qcow2 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json -f qcow2" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json -f qcow2 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json -f qcow2" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzdkzsv1s/37fa3cd7e20d4169b7e996f8c3d7cd90.delta 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzdkzsv1s/37fa3cd7e20d4169b7e996f8c3d7cd90.delta 1073741824" returned: 0 in 0.048s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:17 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 10:37:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:37:18 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d49077-b100-4630-b4f8-00c3daffb9e3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d49077-b100-4630-b4f8-00c3daffb9e3/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d49077-b100-4630-b4f8-00c3daffb9e3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:37:18 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 10:37:18 user nova-compute[71557]: DEBUG nova.privsep.utils [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71557) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 10:37:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzdkzsv1s/37fa3cd7e20d4169b7e996f8c3d7cd90.delta /opt/stack/data/nova/instances/snapshots/tmpzdkzsv1s/37fa3cd7e20d4169b7e996f8c3d7cd90 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d49077-b100-4630-b4f8-00c3daffb9e3/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:37:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:37:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzdkzsv1s/37fa3cd7e20d4169b7e996f8c3d7cd90.delta /opt/stack/data/nova/instances/snapshots/tmpzdkzsv1s/37fa3cd7e20d4169b7e996f8c3d7cd90" returned: 0 in 0.581s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:19 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Snapshot extracted, beginning image upload
Apr 12 10:37:19 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:37:19 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:37:19 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=7561MB free_disk=26.566307067871094GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance f47d368e-3870-49d0-8522-a94991ec4ba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance dc6eb5d4-d415-4459-a95b-5a470ec66586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance d04cb526-f77a-457c-90b1-3e5c202c0c30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance ea55f551-968e-4ece-a37a-c4128ce5e8cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 3d261c30-0c6f-4d1b-8965-448dc019728e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance f147b4ee-d130-41ae-a4db-bc248fb23266 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG nova.compute.manager [req-40992c72-b9a9-4053-bbe0-590560ccbc3e req-b04f0393-c92f-4a19-9818-815e61a00ffc service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received event network-changed-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG nova.compute.manager [req-40992c72-b9a9-4053-bbe0-590560ccbc3e req-b04f0393-c92f-4a19-9818-815e61a00ffc service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Refreshing instance network info cache due to event network-changed-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-40992c72-b9a9-4053-bbe0-590560ccbc3e req-b04f0393-c92f-4a19-9818-815e61a00ffc service nova] Acquiring lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-40992c72-b9a9-4053-bbe0-590560ccbc3e req-b04f0393-c92f-4a19-9818-815e61a00ffc service nova] Acquired lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG nova.network.neutron [req-40992c72-b9a9-4053-bbe0-590560ccbc3e req-b04f0393-c92f-4a19-9818-815e61a00ffc service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Refreshing network info cache for port 7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:37:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:20 user nova-compute[71557]: DEBUG nova.network.neutron [req-40992c72-b9a9-4053-bbe0-590560ccbc3e req-b04f0393-c92f-4a19-9818-815e61a00ffc service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Updated VIF entry in instance network info cache for port 7b5c1f1e-a739-4317-a7b5-d6d884d32f7c. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:37:20 user nova-compute[71557]: DEBUG nova.network.neutron [req-40992c72-b9a9-4053-bbe0-590560ccbc3e req-b04f0393-c92f-4a19-9818-815e61a00ffc service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Updating instance_info_cache with network_info: [{"id": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "address": "fa:16:3e:97:77:c8", "network": {"id": "4d3f7dc3-82bc-43ab-be83-29e8f16f99de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-970702209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce2a3bde13e464f8df0a41f30c240ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5c1f1e-a7", "ovs_interfaceid": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:37:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-40992c72-b9a9-4053-bbe0-590560ccbc3e req-b04f0393-c92f-4a19-9818-815e61a00ffc service nova] Releasing lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:37:20 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:37:20 user nova-compute[71557]: INFO nova.compute.manager [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] instance snapshotting
Apr 12 10:37:20 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Beginning live snapshot process
Apr 12 10:37:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json -f qcow2 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json -f qcow2" returned: 0 in 0.144s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json -f qcow2 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:20 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:37:20 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:37:20 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:37:20 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:37:20 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:37:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplnv_vde1/54c96a921ae24fe8a6cb437f9727ada1.delta 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplnv_vde1/54c96a921ae24fe8a6cb437f9727ada1.delta 1073741824" returned: 0 in 0.049s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:21 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 10:37:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-c5fbe625-19e4-441a-ad90-239a26a4fd91 req-ecb33133-3f15-4e37-9675-f1c2efe9fde6 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-changed-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:37:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-c5fbe625-19e4-441a-ad90-239a26a4fd91 req-ecb33133-3f15-4e37-9675-f1c2efe9fde6 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Refreshing instance network info cache due to event network-changed-fa1878d2-9c1a-4fda-bdbf-b226839d56c4. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:37:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c5fbe625-19e4-441a-ad90-239a26a4fd91 req-ecb33133-3f15-4e37-9675-f1c2efe9fde6 service nova] Acquiring lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:37:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c5fbe625-19e4-441a-ad90-239a26a4fd91 req-ecb33133-3f15-4e37-9675-f1c2efe9fde6 service nova] Acquired lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:37:21 user nova-compute[71557]: DEBUG nova.network.neutron [req-c5fbe625-19e4-441a-ad90-239a26a4fd91 req-ecb33133-3f15-4e37-9675-f1c2efe9fde6 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Refreshing network info cache for port fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:37:21 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Snapshot image upload complete
Apr 12 10:37:21 user nova-compute[71557]: INFO nova.compute.manager [None req-19e9201c-84aa-4603-9283-9d2ace6670c1 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Took 4.86 seconds to snapshot the instance on the hypervisor.
Apr 12 10:37:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:37:21 user nova-compute[71557]: DEBUG nova.network.neutron [req-c5fbe625-19e4-441a-ad90-239a26a4fd91 req-ecb33133-3f15-4e37-9675-f1c2efe9fde6 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Updated VIF entry in instance network info cache for port fa1878d2-9c1a-4fda-bdbf-b226839d56c4. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:37:21 user nova-compute[71557]: DEBUG nova.network.neutron [req-c5fbe625-19e4-441a-ad90-239a26a4fd91 req-ecb33133-3f15-4e37-9675-f1c2efe9fde6 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Updating instance_info_cache with network_info: [{"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:37:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c5fbe625-19e4-441a-ad90-239a26a4fd91 req-ecb33133-3f15-4e37-9675-f1c2efe9fde6 service nova] Releasing lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:37:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:37:22 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 10:37:22 user nova-compute[71557]: DEBUG nova.privsep.utils [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71557) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 10:37:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplnv_vde1/54c96a921ae24fe8a6cb437f9727ada1.delta /opt/stack/data/nova/instances/snapshots/tmplnv_vde1/54c96a921ae24fe8a6cb437f9727ada1 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplnv_vde1/54c96a921ae24fe8a6cb437f9727ada1.delta /opt/stack/data/nova/instances/snapshots/tmplnv_vde1/54c96a921ae24fe8a6cb437f9727ada1" returned: 0 in 0.163s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:22 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Snapshot extracted, beginning image upload
Apr 12 10:37:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "893c42b2-83ed-4823-9698-2015a3ffd4c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "893c42b2-83ed-4823-9698-2015a3ffd4c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:37:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:24 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:37:24 user nova-compute[71557]: INFO nova.compute.claims [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Claim successful on node user
Apr 12 10:37:24 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Snapshot image upload complete
Apr 12 10:37:24 user nova-compute[71557]: INFO nova.compute.manager [None req-0e37d924-56eb-414f-b7bd-f7fda5551a29 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Took 4.42 seconds to snapshot the instance on the hypervisor.
Apr 12 10:37:24 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:37:24 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:37:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:37:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:37:25 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:37:25 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:37:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:37:25 user nova-compute[71557]: DEBUG nova.policy [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33d19bfc4894401cb664521438338b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '024682bfda5548b8b9b404c85dd55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:37:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:37:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:37:25 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Creating image(s)
Apr 12 10:37:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "/opt/stack/data/nova/instances/893c42b2-83ed-4823-9698-2015a3ffd4c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "/opt/stack/data/nova/instances/893c42b2-83ed-4823-9698-2015a3ffd4c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "/opt/stack/data/nova/instances/893c42b2-83ed-4823-9698-2015a3ffd4c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.423s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.174s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/893c42b2-83ed-4823-9698-2015a3ffd4c5/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/893c42b2-83ed-4823-9698-2015a3ffd4c5/disk 1073741824" returned: 0 in 0.053s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.176s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:26 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Checking if we can resize image /opt/stack/data/nova/instances/893c42b2-83ed-4823-9698-2015a3ffd4c5/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:37:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/893c42b2-83ed-4823-9698-2015a3ffd4c5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:26 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Successfully created port: 92cfa1bd-511c-4432-8b37-529eb34f8b21 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:37:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/893c42b2-83ed-4823-9698-2015a3ffd4c5/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:26 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Cannot resize image /opt/stack/data/nova/instances/893c42b2-83ed-4823-9698-2015a3ffd4c5/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:37:26 user nova-compute[71557]: DEBUG nova.objects.instance [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lazy-loading 'migration_context' on Instance uuid 893c42b2-83ed-4823-9698-2015a3ffd4c5 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:37:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:37:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Ensure instance console log exists: /opt/stack/data/nova/instances/893c42b2-83ed-4823-9698-2015a3ffd4c5/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:37:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:26 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Successfully updated port: 92cfa1bd-511c-4432-8b37-529eb34f8b21 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:37:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "refresh_cache-893c42b2-83ed-4823-9698-2015a3ffd4c5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:37:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquired lock "refresh_cache-893c42b2-83ed-4823-9698-2015a3ffd4c5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:37:26 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.compute.manager [req-b6d5410f-145b-4527-b907-51efde165172 req-784da2e4-bae0-4c06-bb8a-3f3872cd0125 service nova] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Received event network-changed-92cfa1bd-511c-4432-8b37-529eb34f8b21 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.compute.manager [req-b6d5410f-145b-4527-b907-51efde165172 req-784da2e4-bae0-4c06-bb8a-3f3872cd0125 service nova] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Refreshing instance network info cache due to event network-changed-92cfa1bd-511c-4432-8b37-529eb34f8b21. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b6d5410f-145b-4527-b907-51efde165172 req-784da2e4-bae0-4c06-bb8a-3f3872cd0125 service nova] Acquiring lock "refresh_cache-893c42b2-83ed-4823-9698-2015a3ffd4c5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "c4d49077-b100-4630-b4f8-00c3daffb9e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "c4d49077-b100-4630-b4f8-00c3daffb9e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.objects.instance [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lazy-loading 'flavor' on Instance uuid c4d49077-b100-4630-b4f8-00c3daffb9e3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "c4d49077-b100-4630-b4f8-00c3daffb9e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "c4d49077-b100-4630-b4f8-00c3daffb9e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "c4d49077-b100-4630-b4f8-00c3daffb9e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:27 user nova-compute[71557]: INFO nova.compute.manager [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Attaching volume 67a972c3-7132-4357-85f6-24196e512265 to /dev/vdb
Apr 12 10:37:27 user nova-compute[71557]: DEBUG os_brick.utils [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0e5c61-e771-46aa-a64f-8ece29534a14]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Updating instance_info_cache with network_info: [{"id": "92cfa1bd-511c-4432-8b37-529eb34f8b21", "address": "fa:16:3e:f4:27:5b", "network": {"id": "092e35b9-633d-403b-a777-df3e8c018327", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667523639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "024682bfda5548b8b9b404c85dd55b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92cfa1bd-51", "ovs_interfaceid": "92cfa1bd-511c-4432-8b37-529eb34f8b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e1c52f-30ac-4a1d-addb-647a7c6b9ad1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Releasing lock "refresh_cache-893c42b2-83ed-4823-9698-2015a3ffd4c5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Instance network_info: |[{"id": "92cfa1bd-511c-4432-8b37-529eb34f8b21", "address": "fa:16:3e:f4:27:5b", "network": {"id": "092e35b9-633d-403b-a777-df3e8c018327", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667523639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "024682bfda5548b8b9b404c85dd55b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92cfa1bd-51", "ovs_interfaceid": "92cfa1bd-511c-4432-8b37-529eb34f8b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b83d5c7-9253-4c4f-8048-32137d183ede]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b6d5410f-145b-4527-b907-51efde165172 req-784da2e4-bae0-4c06-bb8a-3f3872cd0125 service nova] Acquired lock "refresh_cache-893c42b2-83ed-4823-9698-2015a3ffd4c5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.network.neutron [req-b6d5410f-145b-4527-b907-51efde165172 req-784da2e4-bae0-4c06-bb8a-3f3872cd0125 service nova] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Refreshing network info cache for port 92cfa1bd-511c-4432-8b37-529eb34f8b21 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Start _get_guest_xml network_info=[{"id": "92cfa1bd-511c-4432-8b37-529eb34f8b21", "address": "fa:16:3e:f4:27:5b", "network": {"id": "092e35b9-633d-403b-a777-df3e8c018327", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667523639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "024682bfda5548b8b9b404c85dd55b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92cfa1bd-51", "ovs_interfaceid": "92cfa1bd-511c-4432-8b37-529eb34f8b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7b4e7a-87d4-43f1-bfa7-e7725be5b43d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:37:27 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:37:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c054ac-fa94-43a4-89ef-89bd2eb768e3]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG os_brick.utils [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Updating existing volume attachment record: 5ed15324-d319-49c0-8528-42d27f3e3721 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:37:27 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:37:27 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-59410143',display_name='tempest-ServersNegativeTestJSON-server-59410143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-59410143',id=12,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='024682bfda5548b8b9b404c85dd55b34',ramdisk_id='',reservation_id='r-47yjd5e4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-563292074',owner_user_name='tempest-ServersNegativeTestJSON-563292074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:37:25Z,user_data=None,user_id='33d19bfc4894401cb664521438338b9a',uuid=893c42b2-83ed-4823-9698-2015a3ffd4c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92cfa1bd-511c-4432-8b37-529eb34f8b21", "address": "fa:16:3e:f4:27:5b", "network": {"id": "092e35b9-633d-403b-a777-df3e8c018327", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667523639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "024682bfda5548b8b9b404c85dd55b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92cfa1bd-51", "ovs_interfaceid": "92cfa1bd-511c-4432-8b37-529eb34f8b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Converting VIF {"id": "92cfa1bd-511c-4432-8b37-529eb34f8b21", "address": "fa:16:3e:f4:27:5b", "network": {"id": "092e35b9-633d-403b-a777-df3e8c018327", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667523639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "024682bfda5548b8b9b404c85dd55b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92cfa1bd-51", "ovs_interfaceid": "92cfa1bd-511c-4432-8b37-529eb34f8b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:27:5b,bridge_name='br-int',has_traffic_filtering=True,id=92cfa1bd-511c-4432-8b37-529eb34f8b21,network=Network(092e35b9-633d-403b-a777-df3e8c018327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92cfa1bd-51') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.objects.instance [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lazy-loading 'pci_devices' on Instance uuid 893c42b2-83ed-4823-9698-2015a3ffd4c5 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:37:27 user nova-compute[71557]:   <uuid>893c42b2-83ed-4823-9698-2015a3ffd4c5</uuid>
Apr 12 10:37:27 user nova-compute[71557]:   <name>instance-0000000c</name>
Apr 12 10:37:27 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:37:27 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:37:27 user nova-compute[71557]:   <metadata>
Apr 12 10:37:27 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:37:27 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:37:27 user nova-compute[71557]:       <nova:name>tempest-ServersNegativeTestJSON-server-59410143</nova:name>
Apr 12 10:37:27 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:37:27</nova:creationTime>
Apr 12 10:37:27 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:37:27 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:37:27 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:37:27 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:37:27 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:37:27 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:37:27 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:37:27 user nova-compute[71557]:       <nova:owner>
Apr 12 10:37:27 user nova-compute[71557]:         <nova:user uuid="33d19bfc4894401cb664521438338b9a">tempest-ServersNegativeTestJSON-563292074-project-member</nova:user>
Apr 12 10:37:27 user nova-compute[71557]:         <nova:project uuid="024682bfda5548b8b9b404c85dd55b34">tempest-ServersNegativeTestJSON-563292074</nova:project>
Apr 12 10:37:27 user nova-compute[71557]:       </nova:owner>
Apr 12 10:37:27 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:37:27 user nova-compute[71557]:       <nova:ports>
Apr 12 10:37:27 user nova-compute[71557]:         <nova:port uuid="92cfa1bd-511c-4432-8b37-529eb34f8b21">
Apr 12 10:37:27 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 10:37:27 user nova-compute[71557]:         </nova:port>
Apr 12 10:37:27 user nova-compute[71557]:       </nova:ports>
Apr 12 10:37:27 user nova-compute[71557]:     </nova:instance>
Apr 12 10:37:27 user nova-compute[71557]:   </metadata>
Apr 12 10:37:27 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:37:27 user nova-compute[71557]:     <system>
Apr 12 10:37:27 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:37:27 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:37:27 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:37:27 user nova-compute[71557]:       <entry name="serial">893c42b2-83ed-4823-9698-2015a3ffd4c5</entry>
Apr 12 10:37:27 user nova-compute[71557]:       <entry name="uuid">893c42b2-83ed-4823-9698-2015a3ffd4c5</entry>
Apr 12 10:37:27 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:37:27 user nova-compute[71557]:     </system>
Apr 12 10:37:27 user nova-compute[71557]:   </sysinfo>
Apr 12 10:37:27 user nova-compute[71557]:   <os>
Apr 12 10:37:27 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:37:27 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:37:27 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:37:27 user nova-compute[71557]:   </os>
Apr 12 10:37:27 user nova-compute[71557]:   <features>
Apr 12 10:37:27 user nova-compute[71557]:     <acpi/>
Apr 12 10:37:27 user nova-compute[71557]:     <apic/>
Apr 12 10:37:27 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:37:27 user nova-compute[71557]:   </features>
Apr 12 10:37:27 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:37:27 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:37:27 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:37:27 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:37:27 user nova-compute[71557]:   </clock>
Apr 12 10:37:27 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:37:27 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:37:27 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:37:27 user nova-compute[71557]:   </cpu>
Apr 12 10:37:27 user nova-compute[71557]:   <devices>
Apr 12 10:37:27 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:37:27 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:37:27 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/893c42b2-83ed-4823-9698-2015a3ffd4c5/disk"/>
Apr 12 10:37:27 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:37:27 user nova-compute[71557]:     </disk>
Apr 12 10:37:27 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:37:27 user nova-compute[71557]:       <mac address="fa:16:3e:f4:27:5b"/>
Apr 12 10:37:27 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:37:27 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:37:27 user nova-compute[71557]:       <target dev="tap92cfa1bd-51"/>
Apr 12 10:37:27 user nova-compute[71557]:     </interface>
Apr 12 10:37:27 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:37:27 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/893c42b2-83ed-4823-9698-2015a3ffd4c5/console.log" append="off"/>
Apr 12 10:37:27 user nova-compute[71557]:     </serial>
Apr 12 10:37:27 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:37:27 user nova-compute[71557]:     <video>
Apr 12 10:37:27 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:37:27 user nova-compute[71557]:     </video>
Apr 12 10:37:27 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:37:27 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:37:27 user nova-compute[71557]:     </rng>
Apr 12 10:37:27 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:37:27 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:37:27 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:37:27 user nova-compute[71557]:     </memballoon>
Apr 12 10:37:27 user nova-compute[71557]:   </devices>
Apr 12 10:37:27 user nova-compute[71557]: </domain>
Apr 12 10:37:27 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-59410143',display_name='tempest-ServersNegativeTestJSON-server-59410143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-59410143',id=12,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='024682bfda5548b8b9b404c85dd55b34',ramdisk_id='',reservation_id='r-47yjd5e4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-563292074',owner_user_name='tempest-ServersNegativeTestJSON-563292074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:37:25Z,user_data=None,user_id='33d19bfc4894401cb664521438338b9a',uuid=893c42b2-83ed-4823-9698-2015a3ffd4c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92cfa1bd-511c-4432-8b37-529eb34f8b21", "address": "fa:16:3e:f4:27:5b", "network": {"id": "092e35b9-633d-403b-a777-df3e8c018327", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667523639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "024682bfda5548b8b9b404c85dd55b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92cfa1bd-51", "ovs_interfaceid": "92cfa1bd-511c-4432-8b37-529eb34f8b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Converting VIF {"id": "92cfa1bd-511c-4432-8b37-529eb34f8b21", "address": "fa:16:3e:f4:27:5b", "network": {"id": "092e35b9-633d-403b-a777-df3e8c018327", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667523639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "024682bfda5548b8b9b404c85dd55b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92cfa1bd-51", "ovs_interfaceid": "92cfa1bd-511c-4432-8b37-529eb34f8b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:27:5b,bridge_name='br-int',has_traffic_filtering=True,id=92cfa1bd-511c-4432-8b37-529eb34f8b21,network=Network(092e35b9-633d-403b-a777-df3e8c018327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92cfa1bd-51') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG os_vif [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:27:5b,bridge_name='br-int',has_traffic_filtering=True,id=92cfa1bd-511c-4432-8b37-529eb34f8b21,network=Network(092e35b9-633d-403b-a777-df3e8c018327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92cfa1bd-51') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92cfa1bd-51, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap92cfa1bd-51, col_values=(('external_ids', {'iface-id': '92cfa1bd-511c-4432-8b37-529eb34f8b21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:27:5b', 'vm-uuid': '893c42b2-83ed-4823-9698-2015a3ffd4c5'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:27 user nova-compute[71557]: INFO os_vif [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:27:5b,bridge_name='br-int',has_traffic_filtering=True,id=92cfa1bd-511c-4432-8b37-529eb34f8b21,network=Network(092e35b9-633d-403b-a777-df3e8c018327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92cfa1bd-51')
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:37:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] No VIF found with MAC fa:16:3e:f4:27:5b, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:37:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:28 user nova-compute[71557]: DEBUG nova.network.neutron [req-b6d5410f-145b-4527-b907-51efde165172 req-784da2e4-bae0-4c06-bb8a-3f3872cd0125 service nova] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Updated VIF entry in instance network info cache for port 92cfa1bd-511c-4432-8b37-529eb34f8b21. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:37:28 user nova-compute[71557]: DEBUG nova.network.neutron [req-b6d5410f-145b-4527-b907-51efde165172 req-784da2e4-bae0-4c06-bb8a-3f3872cd0125 service nova] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Updating instance_info_cache with network_info: [{"id": "92cfa1bd-511c-4432-8b37-529eb34f8b21", "address": "fa:16:3e:f4:27:5b", "network": {"id": "092e35b9-633d-403b-a777-df3e8c018327", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667523639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "024682bfda5548b8b9b404c85dd55b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92cfa1bd-51", "ovs_interfaceid": "92cfa1bd-511c-4432-8b37-529eb34f8b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:37:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b6d5410f-145b-4527-b907-51efde165172 req-784da2e4-bae0-4c06-bb8a-3f3872cd0125 service nova] Releasing lock "refresh_cache-893c42b2-83ed-4823-9698-2015a3ffd4c5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:37:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:29 user nova-compute[71557]: DEBUG nova.compute.manager [req-a73082d2-d78a-4478-9ec7-0b1e465ef01f req-abda702c-b994-44d6-a228-04c553b1591d service nova] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Received event network-vif-plugged-92cfa1bd-511c-4432-8b37-529eb34f8b21 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:37:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a73082d2-d78a-4478-9ec7-0b1e465ef01f req-abda702c-b994-44d6-a228-04c553b1591d service nova] Acquiring lock "893c42b2-83ed-4823-9698-2015a3ffd4c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a73082d2-d78a-4478-9ec7-0b1e465ef01f req-abda702c-b994-44d6-a228-04c553b1591d service nova] Lock "893c42b2-83ed-4823-9698-2015a3ffd4c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a73082d2-d78a-4478-9ec7-0b1e465ef01f req-abda702c-b994-44d6-a228-04c553b1591d service nova] Lock "893c42b2-83ed-4823-9698-2015a3ffd4c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:29 user nova-compute[71557]: DEBUG nova.compute.manager [req-a73082d2-d78a-4478-9ec7-0b1e465ef01f req-abda702c-b994-44d6-a228-04c553b1591d service nova] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] No waiting events found dispatching network-vif-plugged-92cfa1bd-511c-4432-8b37-529eb34f8b21 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:37:29 user nova-compute[71557]: WARNING nova.compute.manager [req-a73082d2-d78a-4478-9ec7-0b1e465ef01f req-abda702c-b994-44d6-a228-04c553b1591d service nova] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Received unexpected event network-vif-plugged-92cfa1bd-511c-4432-8b37-529eb34f8b21 for instance with vm_state building and task_state spawning.
Apr 12 10:37:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:31 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295851.2695532, 893c42b2-83ed-4823-9698-2015a3ffd4c5 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:37:31 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] VM Resumed (Lifecycle Event)
Apr 12 10:37:31 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:37:31 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:37:31 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Instance spawned successfully.
Apr 12 10:37:31 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:37:31 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:37:31 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:37:31 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:37:31 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:37:31 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:37:31 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:37:31 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:37:31 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:37:31 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:37:31 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295851.269822, 893c42b2-83ed-4823-9698-2015a3ffd4c5 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:37:31 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] VM Started (Lifecycle Event)
Apr 12 10:37:31 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:37:31 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:37:31 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:37:31 user nova-compute[71557]: INFO nova.compute.manager [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Took 6.08 seconds to spawn the instance on the hypervisor.
Apr 12 10:37:31 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:37:31 user nova-compute[71557]: DEBUG nova.compute.manager [req-ae2d650f-bcf6-43b2-9dac-e1e981f7b76e req-752c0c5e-8237-44b9-bd12-ced9028fe62e service nova] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Received event network-vif-plugged-92cfa1bd-511c-4432-8b37-529eb34f8b21 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:37:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ae2d650f-bcf6-43b2-9dac-e1e981f7b76e req-752c0c5e-8237-44b9-bd12-ced9028fe62e service nova] Acquiring lock "893c42b2-83ed-4823-9698-2015a3ffd4c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ae2d650f-bcf6-43b2-9dac-e1e981f7b76e req-752c0c5e-8237-44b9-bd12-ced9028fe62e service nova] Lock "893c42b2-83ed-4823-9698-2015a3ffd4c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ae2d650f-bcf6-43b2-9dac-e1e981f7b76e req-752c0c5e-8237-44b9-bd12-ced9028fe62e service nova] Lock "893c42b2-83ed-4823-9698-2015a3ffd4c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:31 user nova-compute[71557]: DEBUG nova.compute.manager [req-ae2d650f-bcf6-43b2-9dac-e1e981f7b76e req-752c0c5e-8237-44b9-bd12-ced9028fe62e service nova] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] No waiting events found dispatching network-vif-plugged-92cfa1bd-511c-4432-8b37-529eb34f8b21 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:37:31 user nova-compute[71557]: WARNING nova.compute.manager [req-ae2d650f-bcf6-43b2-9dac-e1e981f7b76e req-752c0c5e-8237-44b9-bd12-ced9028fe62e service nova] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Received unexpected event network-vif-plugged-92cfa1bd-511c-4432-8b37-529eb34f8b21 for instance with vm_state building and task_state spawning.
Apr 12 10:37:31 user nova-compute[71557]: INFO nova.compute.manager [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Took 7.04 seconds to build instance.
Apr 12 10:37:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f6bd5831-4491-4d4b-a5cb-a304c14fd426 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "893c42b2-83ed-4823-9698-2015a3ffd4c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.152s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZDuWaQLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:37:32 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:37:32 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:37:32 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[210123db-3986-46c5-b5b2-76e27843d444]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:37:32 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcf6e27-736c-46e9-a792-cdab1080c96a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265] added
Apr 12 10:37:32 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d6c139-87e1-4db0-8bdb-bc20787f209b]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1138569-4a03-4c49-a433-072c3e50ae15]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZDuWaQLy {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZDuWaQLy" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5062cc3-2160-4d54-841b-98bb9bffc29e]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZDuWaQLy'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f5f1e9-b449-45e2-b254-e70b7019b51b]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[23172202-cc72-4bfd-a80f-91dc8bef2341]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:32 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:32 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:32 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:32 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:32 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:32 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c60546-cf63-4d12-9ae2-aec3f5e0cdfd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265, portal: 172.16.0.220,3260]
Apr 12 10:37:32 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265, portal: 172.16.0.220,3260] successful.
Apr 12 10:37:32 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ac1c87-944a-440f-a71f-ceb635d0618a]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[79717190-5f13-44a3-943a-f97f160f9946]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:32 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:32 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:32 user nova-compute[71557]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 (non-flash)
Apr 12 10:37:32 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:32 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:32 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:32 user nova-compute[71557]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 (non-flash)
Apr 12 10:37:32 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cadcb34-364a-417c-af0c-d974a17745da]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZDuWaQLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:37:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:37:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23832653438623539', 'path': '/dev/sde'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:37:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832653438623539', 'path': '/dev/sde'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:37:33 user nova-compute[71557]: DEBUG nova.objects.instance [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lazy-loading 'flavor' on Instance uuid c4d49077-b100-4630-b4f8-00c3daffb9e3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:37:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 10:37:33 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:37:33 user nova-compute[71557]:   <source dev="/dev/sde"/>
Apr 12 10:37:33 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:37:33 user nova-compute[71557]:   <serial>67a972c3-7132-4357-85f6-24196e512265</serial>
Apr 12 10:37:33 user nova-compute[71557]: </disk>
Apr 12 10:37:33 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 10:37:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:37:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:37:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] No VIF found with MAC fa:16:3e:b3:a3:5b, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:37:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-13df6240-1cbd-4cbe-a49f-f322e49e12c0 tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "c4d49077-b100-4630-b4f8-00c3daffb9e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.843s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "c4d49077-b100-4630-b4f8-00c3daffb9e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "c4d49077-b100-4630-b4f8-00c3daffb9e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "c4d49077-b100-4630-b4f8-00c3daffb9e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "c4d49077-b100-4630-b4f8-00c3daffb9e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "c4d49077-b100-4630-b4f8-00c3daffb9e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:35 user nova-compute[71557]: INFO nova.compute.manager [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Terminating instance
Apr 12 10:37:35 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:37:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:35 user nova-compute[71557]: DEBUG nova.compute.manager [req-7702e647-9541-4123-8302-246290293235 req-f16c165a-f23b-41c9-8c23-a6feeccd6c0c service nova] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Received event network-vif-unplugged-74fb6084-85b5-4bc1-9933-5886e90483fd {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:37:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7702e647-9541-4123-8302-246290293235 req-f16c165a-f23b-41c9-8c23-a6feeccd6c0c service nova] Acquiring lock "c4d49077-b100-4630-b4f8-00c3daffb9e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7702e647-9541-4123-8302-246290293235 req-f16c165a-f23b-41c9-8c23-a6feeccd6c0c service nova] Lock "c4d49077-b100-4630-b4f8-00c3daffb9e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7702e647-9541-4123-8302-246290293235 req-f16c165a-f23b-41c9-8c23-a6feeccd6c0c service nova] Lock "c4d49077-b100-4630-b4f8-00c3daffb9e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:35 user nova-compute[71557]: DEBUG nova.compute.manager [req-7702e647-9541-4123-8302-246290293235 req-f16c165a-f23b-41c9-8c23-a6feeccd6c0c service nova] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] No waiting events found dispatching network-vif-unplugged-74fb6084-85b5-4bc1-9933-5886e90483fd {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:37:35 user nova-compute[71557]: DEBUG nova.compute.manager [req-7702e647-9541-4123-8302-246290293235 req-f16c165a-f23b-41c9-8c23-a6feeccd6c0c service nova] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Received event network-vif-unplugged-74fb6084-85b5-4bc1-9933-5886e90483fd for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:37:36 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Instance destroyed successfully.
Apr 12 10:37:36 user nova-compute[71557]: DEBUG nova.objects.instance [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lazy-loading 'resources' on Instance uuid c4d49077-b100-4630-b4f8-00c3daffb9e3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1259808068',display_name='tempest-DeleteServersTestJSON-server-1259808068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1259808068',id=6,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:35:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3dbf247dab94f6eb32e7808314d420a',ramdisk_id='',reservation_id='r-h5k2a1zx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1147850030',owner_user_name='tempest-DeleteServersTestJSON-1147850030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:35:50Z,user_data=None,user_id='3766c8ddd6ae4fdd9d4aa6929cc080cf',uuid=c4d49077-b100-4630-b4f8-00c3daffb9e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74fb6084-85b5-4bc1-9933-5886e90483fd", "address": "fa:16:3e:b3:a3:5b", "network": {"id": "46ccc4d2-269b-4c92-bee1-2846e0d47bd3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1788525491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3dbf247dab94f6eb32e7808314d420a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fb6084-85", "ovs_interfaceid": "74fb6084-85b5-4bc1-9933-5886e90483fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Converting VIF {"id": "74fb6084-85b5-4bc1-9933-5886e90483fd", "address": "fa:16:3e:b3:a3:5b", "network": {"id": "46ccc4d2-269b-4c92-bee1-2846e0d47bd3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1788525491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3dbf247dab94f6eb32e7808314d420a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74fb6084-85", "ovs_interfaceid": "74fb6084-85b5-4bc1-9933-5886e90483fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a3:5b,bridge_name='br-int',has_traffic_filtering=True,id=74fb6084-85b5-4bc1-9933-5886e90483fd,network=Network(46ccc4d2-269b-4c92-bee1-2846e0d47bd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fb6084-85') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG os_vif [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a3:5b,bridge_name='br-int',has_traffic_filtering=True,id=74fb6084-85b5-4bc1-9933-5886e90483fd,network=Network(46ccc4d2-269b-4c92-bee1-2846e0d47bd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fb6084-85') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74fb6084-85, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:37:36 user nova-compute[71557]: INFO os_vif [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a3:5b,bridge_name='br-int',has_traffic_filtering=True,id=74fb6084-85b5-4bc1-9933-5886e90483fd,network=Network(46ccc4d2-269b-4c92-bee1-2846e0d47bd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74fb6084-85')
Apr 12 10:37:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZDuWaQLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:37:36 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:37:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b82f72d-29ee-4c74-a8b6-555020b26578]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:37:36 user nova-compute[71557]: No targets found.
Apr 12 10:37:36 user nova-compute[71557]: iSNS:
Apr 12 10:37:36 user nova-compute[71557]: No targets found.
Apr 12 10:37:36 user nova-compute[71557]: STATIC:
Apr 12 10:37:36 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca
Apr 12 10:37:36 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:37:36 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:37:36 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd
Apr 12 10:37:36 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:37:36 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:37:36 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f
Apr 12 10:37:36 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:37:36 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:37:36 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265
Apr 12 10:37:36 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:37:36 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:37:36 user nova-compute[71557]: FIRMWARE:
Apr 12 10:37:36 user nova-compute[71557]: No targets found.
Apr 12 10:37:36 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:37:36 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:37:36 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fec9767-5c75-4ad2-a941-af6430e04a59]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[378ac820-317c-4d48-9cab-8f98e222e2f0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:36 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:36 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:36 user nova-compute[71557]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 (non-flash)
Apr 12 10:37:36 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:36 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:36 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:36 user nova-compute[71557]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 (non-flash)
Apr 12 10:37:36 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd40bcd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265'): ({'sde'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Removing single pathed devices sde {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cc6f06-b664-4516-ace1-0f79d5a7c9a4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1eaa60-c7e6-45fe-8f38-51d644df11ed]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Flushing IO for device /dev/sde {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3592ca-3e5e-4649-82e0-420c4acf9c1e]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf5c4ee-512f-4ebe-8d36-d75c23266f93]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] SCSI volumes sde have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[217388d2-dfbe-4580-8b76-8c8a07f15f0b]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c724d9-0163-4a64-9d21-a43749750b37]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265, portal: 172.16.0.220,3260]
Apr 12 10:37:36 user nova-compute[71557]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265, portal: 172.16.0.220,3260] successful.
Apr 12 10:37:36 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a972c3-7132-4357-85f6-24196e512265 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd07277c-2d29-4aee-8364-dc22dbd22df8]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] <== disconnect_volume: return (306ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:37:36 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Deleting instance files /opt/stack/data/nova/instances/c4d49077-b100-4630-b4f8-00c3daffb9e3_del
Apr 12 10:37:36 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Deletion of /opt/stack/data/nova/instances/c4d49077-b100-4630-b4f8-00c3daffb9e3_del complete
Apr 12 10:37:36 user nova-compute[71557]: INFO nova.compute.manager [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Took 1.24 seconds to destroy the instance on the hypervisor.
Apr 12 10:37:36 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:37:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-50598b35-a374-41eb-889b-4793a2559f19 req-4c41fe92-1173-4212-a0f0-b315b7c4a461 service nova] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Received event network-vif-deleted-74fb6084-85b5-4bc1-9933-5886e90483fd {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:37:36 user nova-compute[71557]: INFO nova.compute.manager [req-50598b35-a374-41eb-889b-4793a2559f19 req-4c41fe92-1173-4212-a0f0-b315b7c4a461 service nova] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Neutron deleted interface 74fb6084-85b5-4bc1-9933-5886e90483fd; detaching it from the instance and deleting it from the info cache
Apr 12 10:37:36 user nova-compute[71557]: DEBUG nova.network.neutron [req-50598b35-a374-41eb-889b-4793a2559f19 req-4c41fe92-1173-4212-a0f0-b315b7c4a461 service nova] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:37:36 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Took 0.48 seconds to deallocate network for instance.
Apr 12 10:37:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-50598b35-a374-41eb-889b-4793a2559f19 req-4c41fe92-1173-4212-a0f0-b315b7c4a461 service nova] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Detach interface failed, port_id=74fb6084-85b5-4bc1-9933-5886e90483fd, reason: Instance c4d49077-b100-4630-b4f8-00c3daffb9e3 could not be found. {{(pid=71557) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 10:37:37 user nova-compute[71557]: DEBUG nova.compute.manager [req-254df16b-87fa-438b-ab32-434b89c258a7 req-56c7abbc-cf83-4065-a83d-38447339fce9 service nova] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Received event network-vif-plugged-74fb6084-85b5-4bc1-9933-5886e90483fd {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:37:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-254df16b-87fa-438b-ab32-434b89c258a7 req-56c7abbc-cf83-4065-a83d-38447339fce9 service nova] Acquiring lock "c4d49077-b100-4630-b4f8-00c3daffb9e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-254df16b-87fa-438b-ab32-434b89c258a7 req-56c7abbc-cf83-4065-a83d-38447339fce9 service nova] Lock "c4d49077-b100-4630-b4f8-00c3daffb9e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-254df16b-87fa-438b-ab32-434b89c258a7 req-56c7abbc-cf83-4065-a83d-38447339fce9 service nova] Lock "c4d49077-b100-4630-b4f8-00c3daffb9e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:37 user nova-compute[71557]: DEBUG nova.compute.manager [req-254df16b-87fa-438b-ab32-434b89c258a7 req-56c7abbc-cf83-4065-a83d-38447339fce9 service nova] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] No waiting events found dispatching network-vif-plugged-74fb6084-85b5-4bc1-9933-5886e90483fd {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:37:37 user nova-compute[71557]: WARNING nova.compute.manager [req-254df16b-87fa-438b-ab32-434b89c258a7 req-56c7abbc-cf83-4065-a83d-38447339fce9 service nova] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Received unexpected event network-vif-plugged-74fb6084-85b5-4bc1-9933-5886e90483fd for instance with vm_state active and task_state deleting.
Apr 12 10:37:37 user nova-compute[71557]: INFO nova.compute.manager [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Took 0.98 seconds to detach 1 volumes for instance.
Apr 12 10:37:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:38 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:37:38 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:37:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:38 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Deleted allocations for instance c4d49077-b100-4630-b4f8-00c3daffb9e3
Apr 12 10:37:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4783348e-2340-4599-9bac-9a65197dda6e tempest-DeleteServersTestJSON-1147850030 tempest-DeleteServersTestJSON-1147850030-project-member] Lock "c4d49077-b100-4630-b4f8-00c3daffb9e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.232s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-78137417-f620-4b1e-a7fc-cfe2462e176d req-dd37d118-6a0c-44b5-9e9b-ca840ba24e45 service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Received event network-changed-d6cd169f-f736-45da-96ea-c0b933c882a0 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:37:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-78137417-f620-4b1e-a7fc-cfe2462e176d req-dd37d118-6a0c-44b5-9e9b-ca840ba24e45 service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Refreshing instance network info cache due to event network-changed-d6cd169f-f736-45da-96ea-c0b933c882a0. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:37:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-78137417-f620-4b1e-a7fc-cfe2462e176d req-dd37d118-6a0c-44b5-9e9b-ca840ba24e45 service nova] Acquiring lock "refresh_cache-d04cb526-f77a-457c-90b1-3e5c202c0c30" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:37:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-78137417-f620-4b1e-a7fc-cfe2462e176d req-dd37d118-6a0c-44b5-9e9b-ca840ba24e45 service nova] Acquired lock "refresh_cache-d04cb526-f77a-457c-90b1-3e5c202c0c30" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:37:44 user nova-compute[71557]: DEBUG nova.network.neutron [req-78137417-f620-4b1e-a7fc-cfe2462e176d req-dd37d118-6a0c-44b5-9e9b-ca840ba24e45 service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Refreshing network info cache for port d6cd169f-f736-45da-96ea-c0b933c882a0 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:37:45 user nova-compute[71557]: DEBUG nova.network.neutron [req-78137417-f620-4b1e-a7fc-cfe2462e176d req-dd37d118-6a0c-44b5-9e9b-ca840ba24e45 service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Updated VIF entry in instance network info cache for port d6cd169f-f736-45da-96ea-c0b933c882a0. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:37:45 user nova-compute[71557]: DEBUG nova.network.neutron [req-78137417-f620-4b1e-a7fc-cfe2462e176d req-dd37d118-6a0c-44b5-9e9b-ca840ba24e45 service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Updating instance_info_cache with network_info: [{"id": "d6cd169f-f736-45da-96ea-c0b933c882a0", "address": "fa:16:3e:ab:9d:90", "network": {"id": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-80273954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdb8217b1544db384bebe1059848bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6cd169f-f7", "ovs_interfaceid": "d6cd169f-f736-45da-96ea-c0b933c882a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:37:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-78137417-f620-4b1e-a7fc-cfe2462e176d req-dd37d118-6a0c-44b5-9e9b-ca840ba24e45 service nova] Releasing lock "refresh_cache-d04cb526-f77a-457c-90b1-3e5c202c0c30" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:37:45 user nova-compute[71557]: DEBUG nova.compute.manager [req-c6618e44-df92-46e2-a79f-f07bafa79aa6 req-d292f590-2cf7-481f-872b-d5f8f8e1a490 service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Received event network-changed-9d4bc0b7-4a2b-4354-a609-c673f6235cc7 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:37:45 user nova-compute[71557]: DEBUG nova.compute.manager [req-c6618e44-df92-46e2-a79f-f07bafa79aa6 req-d292f590-2cf7-481f-872b-d5f8f8e1a490 service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Refreshing instance network info cache due to event network-changed-9d4bc0b7-4a2b-4354-a609-c673f6235cc7. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:37:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c6618e44-df92-46e2-a79f-f07bafa79aa6 req-d292f590-2cf7-481f-872b-d5f8f8e1a490 service nova] Acquiring lock "refresh_cache-ea55f551-968e-4ece-a37a-c4128ce5e8cb" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:37:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c6618e44-df92-46e2-a79f-f07bafa79aa6 req-d292f590-2cf7-481f-872b-d5f8f8e1a490 service nova] Acquired lock "refresh_cache-ea55f551-968e-4ece-a37a-c4128ce5e8cb" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:37:45 user nova-compute[71557]: DEBUG nova.network.neutron [req-c6618e44-df92-46e2-a79f-f07bafa79aa6 req-d292f590-2cf7-481f-872b-d5f8f8e1a490 service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Refreshing network info cache for port 9d4bc0b7-4a2b-4354-a609-c673f6235cc7 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:37:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:45 user nova-compute[71557]: DEBUG nova.objects.instance [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lazy-loading 'flavor' on Instance uuid ea55f551-968e-4ece-a37a-c4128ce5e8cb {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:37:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:45 user nova-compute[71557]: INFO nova.compute.manager [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Attaching volume 2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 to /dev/vdb
Apr 12 10:37:45 user nova-compute[71557]: DEBUG os_brick.utils [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:37:45 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:45 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:45 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebb2b2d-5866-4be7-a5a0-91d4b61edee1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:45 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:45 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:45 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[02489923-0e58-40fe-a23c-79137bdc2ece]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3659b669-dfba-441d-9b00-17696df58912]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9001bb7-b776-4ec4-8fc4-b472d108bc17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG nova.network.neutron [req-c6618e44-df92-46e2-a79f-f07bafa79aa6 req-d292f590-2cf7-481f-872b-d5f8f8e1a490 service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Updated VIF entry in instance network info cache for port 9d4bc0b7-4a2b-4354-a609-c673f6235cc7. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG nova.network.neutron [req-c6618e44-df92-46e2-a79f-f07bafa79aa6 req-d292f590-2cf7-481f-872b-d5f8f8e1a490 service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Updating instance_info_cache with network_info: [{"id": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7", "address": "fa:16:3e:e1:68:2b", "network": {"id": "d823a4e6-ea4f-426a-8afe-49a806172180", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1926857283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91b7b715cc24490ebd04d5469b6e07ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d4bc0b7-4a", "ovs_interfaceid": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:37:46 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c054f07-28a8-4074-8e3a-8774af0881d9]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG os_brick.utils [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Updating existing volume attachment record: cc17f67b-0371-4104-a718-df9c8c04a776 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c6618e44-df92-46e2-a79f-f07bafa79aa6 req-d292f590-2cf7-481f-872b-d5f8f8e1a490 service nova] Releasing lock "refresh_cache-ea55f551-968e-4ece-a37a-c4128ce5e8cb" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "d04cb526-f77a-457c-90b1-3e5c202c0c30" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "d04cb526-f77a-457c-90b1-3e5c202c0c30" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG nova.objects.instance [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lazy-loading 'flavor' on Instance uuid d04cb526-f77a-457c-90b1-3e5c202c0c30 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "d04cb526-f77a-457c-90b1-3e5c202c0c30" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "d04cb526-f77a-457c-90b1-3e5c202c0c30" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "d04cb526-f77a-457c-90b1-3e5c202c0c30" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:46 user nova-compute[71557]: INFO nova.compute.manager [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Attaching volume 8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 to /dev/vdb
Apr 12 10:37:46 user nova-compute[71557]: DEBUG os_brick.utils [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ac39c8-0e51-4e8e-962e-07791d2e79cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[43af9c0a-7fbc-4a62-b955-c84809415e65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6959a90b-f026-41ba-b312-607e8e03a6f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b75809-66a9-47b9-a7a2-dd3a88655d3a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:37:46 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:37:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e61074b-db32-4794-9cfb-e8e5669a7269]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG os_brick.utils [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:37:46 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Updating existing volume attachment record: e5c9677f-4075-48c1-96b8-e6bd60c96603 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:37:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:48 user nova-compute[71557]: DEBUG nova.compute.manager [req-b0ef9264-0a02-40ba-8c92-ebf58b69d93d req-c05062ef-700c-4800-b1bd-a07bf059c6c6 service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Received event network-changed-166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:37:48 user nova-compute[71557]: DEBUG nova.compute.manager [req-b0ef9264-0a02-40ba-8c92-ebf58b69d93d req-c05062ef-700c-4800-b1bd-a07bf059c6c6 service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Refreshing instance network info cache due to event network-changed-166c8bd6-ec3c-46f1-ad64-9efb6e21ad38. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:37:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b0ef9264-0a02-40ba-8c92-ebf58b69d93d req-c05062ef-700c-4800-b1bd-a07bf059c6c6 service nova] Acquiring lock "refresh_cache-3d261c30-0c6f-4d1b-8965-448dc019728e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:37:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b0ef9264-0a02-40ba-8c92-ebf58b69d93d req-c05062ef-700c-4800-b1bd-a07bf059c6c6 service nova] Acquired lock "refresh_cache-3d261c30-0c6f-4d1b-8965-448dc019728e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:37:48 user nova-compute[71557]: DEBUG nova.network.neutron [req-b0ef9264-0a02-40ba-8c92-ebf58b69d93d req-c05062ef-700c-4800-b1bd-a07bf059c6c6 service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Refreshing network info cache for port 166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:37:49 user nova-compute[71557]: DEBUG nova.network.neutron [req-b0ef9264-0a02-40ba-8c92-ebf58b69d93d req-c05062ef-700c-4800-b1bd-a07bf059c6c6 service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Updated VIF entry in instance network info cache for port 166c8bd6-ec3c-46f1-ad64-9efb6e21ad38. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:37:49 user nova-compute[71557]: DEBUG nova.network.neutron [req-b0ef9264-0a02-40ba-8c92-ebf58b69d93d req-c05062ef-700c-4800-b1bd-a07bf059c6c6 service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Updating instance_info_cache with network_info: [{"id": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38", "address": "fa:16:3e:37:c9:7a", "network": {"id": "38b15083-7fc7-4136-940b-ac6f8ce892a7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-827628896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cede3351295e451283a0414aefea1de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c8bd6-ec", "ovs_interfaceid": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:37:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b0ef9264-0a02-40ba-8c92-ebf58b69d93d req-c05062ef-700c-4800-b1bd-a07bf059c6c6 service nova] Releasing lock "refresh_cache-3d261c30-0c6f-4d1b-8965-448dc019728e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:37:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "3d261c30-0c6f-4d1b-8965-448dc019728e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "3d261c30-0c6f-4d1b-8965-448dc019728e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:49 user nova-compute[71557]: DEBUG nova.objects.instance [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lazy-loading 'flavor' on Instance uuid 3d261c30-0c6f-4d1b-8965-448dc019728e {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:37:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "3d261c30-0c6f-4d1b-8965-448dc019728e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "3d261c30-0c6f-4d1b-8965-448dc019728e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "3d261c30-0c6f-4d1b-8965-448dc019728e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:49 user nova-compute[71557]: INFO nova.compute.manager [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Attaching volume ae71a30e-c9d5-4c42-b1c1-95c0af283832 to /dev/sdc
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.utils [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[145ba36b-9d12-44de-8b7b-6709f89a0552]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d2384a-3642-4418-bdcb-21d1e9a28da4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed4f567-1737-420a-bcef-bf807ad3f96e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61d3e90-df5e-4edd-a778-f7511759fb13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:37:50 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d42fd6a-21fa-45f6-bd87-800fef5ba6db]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.utils [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Updating existing volume attachment record: 259c5e54-6132-40cd-84bb-961d621941cd {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryHjCUZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:37:50 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:37:50 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:37:50 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc70f307-7e15-42aa-a468-9918ad4a4bdd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:37:50 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd5527d-ca21-49b1-9018-77a658ebc25a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4] added
Apr 12 10:37:50 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e124562c-e109-47fd-b83a-09a0f971e347]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c1da6d-65ca-47e4-9046-db7537374084]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ryHjCUZE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ryHjCUZE" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa64a16a-4891-49b1-b78e-4b34960b2cb9]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ryHjCUZE'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a532c2-6e13-4573-824e-abb38a164ae9]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ee5fea-bd77-4724-ac5b-3445fae853b2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:50 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:50 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:50 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:50 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:50 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:50 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a5559d-a6b4-4506-ae19-6660314955c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4, portal: 172.16.0.220,3260]
Apr 12 10:37:50 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4, portal: 172.16.0.220,3260] successful.
Apr 12 10:37:50 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb362a6-62d4-461a-929d-d0331e401616]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cc1caf-354f-4127-8724-3e22f5773de9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:50 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:50 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:50 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:37:50 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:50 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:50 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:50 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:37:50 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8a71ec-996f-4afc-bffd-93a595a9b709]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryHjCUZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRjsXEPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:37:50 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:37:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681295856.0753448, c4d49077-b100-4630-b4f8-00c3daffb9e3 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:37:51 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] VM Stopped (Lifecycle Event)
Apr 12 10:37:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0268196b-6313-4b19-9784-c86039fcc18b None None] [instance: c4d49077-b100-4630-b4f8-00c3daffb9e3] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23338373135396131', 'path': '/dev/sde'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338373135396131', 'path': '/dev/sde'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.833s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:37:51 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:37:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:37:51 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG nova.objects.instance [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lazy-loading 'flavor' on Instance uuid ea55f551-968e-4ece-a37a-c4128ce5e8cb {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0492cdb3-d5ab-4527-a6ee-533235305887]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:37:51 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 10:37:51 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:37:51 user nova-compute[71557]:   <source dev="/dev/sde"/>
Apr 12 10:37:51 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:37:51 user nova-compute[71557]:   <serial>2c1f53d0-46d5-4944-89d3-f0793ff3fbf4</serial>
Apr 12 10:37:51 user nova-compute[71557]: </disk>
Apr 12 10:37:51 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71c76e0-3035-43a2-ac89-f3c004c60a50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98] added
Apr 12 10:37:51 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1b1ed5-5ecc-4fbb-9a7b-f13be41655c9]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef33efc8-8b3e-4044-83c9-ddaa42a6d5d3]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZRjsXEPT {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZRjsXEPT" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3332aa4a-82c9-4cee-8e94-04d46f5f5f0f]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZRjsXEPT'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fa823b-4791-473c-b440-de4d860ec8e2]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f808ea2-c514-4db4-9635-513c63ea446e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:51 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:51 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:51 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:37:51 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:51 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:51 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:51 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:37:51 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f015a0ca-d37a-436b-950a-3eeb76372410]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98, portal: 172.16.0.220,3260]
Apr 12 10:37:51 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98, portal: 172.16.0.220,3260] successful.
Apr 12 10:37:51 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ffea8f-e128-4bfc-8c87-037550fb121b]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cfb398-4626-43f7-ac78-04652463a881]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:52 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:52 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:52 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:37:52 user nova-compute[71557]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 (non-flash)
Apr 12 10:37:52 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:52 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:52 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:52 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:37:52 user nova-compute[71557]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 (non-flash)
Apr 12 10:37:52 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec08f78a-6658-47fd-840d-390047aa4f91]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRjsXEPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] No VIF found with MAC fa:16:3e:e1:68:2b, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9fad7971-968a-4182-b207-3f23f31ad612 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.439s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Acquiring lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG os_brick.utils [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c032fe-44be-4876-8da7-d7c004d0ad66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:52 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4e4438-370e-4aa1-b7c1-09bdef9f5039]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72a50ea-32fb-40c4-87a9-0e4d4ee7edb5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce16bfb1-bc88-474e-8fd4-4f18616b69b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] <== connect_volume: return (2218ms) {'type': 'block', 'scsi_wwn': '26134313135626662', 'path': '/dev/sdf'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134313135626662', 'path': '/dev/sdf'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG nova.compute.manager [req-09801792-b5d8-470a-83a4-31af62fc046f req-33d0db4e-f5dc-4136-ab14-6583094c993d service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Received event network-changed-96998164-acd9-4a18-b230-d63787eaf154 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG nova.compute.manager [req-09801792-b5d8-470a-83a4-31af62fc046f req-33d0db4e-f5dc-4136-ab14-6583094c993d service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Refreshing instance network info cache due to event network-changed-96998164-acd9-4a18-b230-d63787eaf154. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-09801792-b5d8-470a-83a4-31af62fc046f req-33d0db4e-f5dc-4136-ab14-6583094c993d service nova] Acquiring lock "refresh_cache-f147b4ee-d130-41ae-a4db-bc248fb23266" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-09801792-b5d8-470a-83a4-31af62fc046f req-33d0db4e-f5dc-4136-ab14-6583094c993d service nova] Acquired lock "refresh_cache-f147b4ee-d130-41ae-a4db-bc248fb23266" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG nova.network.neutron [req-09801792-b5d8-470a-83a4-31af62fc046f req-33d0db4e-f5dc-4136-ab14-6583094c993d service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Refreshing network info cache for port 96998164-acd9-4a18-b230-d63787eaf154 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG nova.objects.instance [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lazy-loading 'flavor' on Instance uuid d04cb526-f77a-457c-90b1-3e5c202c0c30 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:37:53 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:37:53 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfccba5-c4a0-4f7f-bcdf-354343ca29bc]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG os_brick.utils [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 10:37:53 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:37:53 user nova-compute[71557]:   <source dev="/dev/sdf"/>
Apr 12 10:37:53 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:37:53 user nova-compute[71557]:   <serial>8ff6497a-9926-4c83-bfd1-ea3a8ab15e98</serial>
Apr 12 10:37:53 user nova-compute[71557]: </disk>
Apr 12 10:37:53 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 10:37:53 user nova-compute[71557]: INFO nova.compute.manager [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Swapping volume 2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 for 63298498-6bc0-47a0-b48e-815852c52771
Apr 12 10:37:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "interface-f147b4ee-d130-41ae-a4db-bc248fb23266-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "interface-f147b4ee-d130-41ae-a4db-bc248fb23266-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG nova.objects.instance [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lazy-loading 'flavor' on Instance uuid f147b4ee-d130-41ae-a4db-bc248fb23266 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] No VIF found with MAC fa:16:3e:ab:9d:90, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG nova.objects.instance [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lazy-loading 'pci_requests' on Instance uuid f147b4ee-d130-41ae-a4db-bc248fb23266 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG nova.network.neutron [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG nova.network.neutron [req-09801792-b5d8-470a-83a4-31af62fc046f req-33d0db4e-f5dc-4136-ab14-6583094c993d service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Updated VIF entry in instance network info cache for port 96998164-acd9-4a18-b230-d63787eaf154. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG nova.network.neutron [req-09801792-b5d8-470a-83a4-31af62fc046f req-33d0db4e-f5dc-4136-ab14-6583094c993d service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Updating instance_info_cache with network_info: [{"id": "96998164-acd9-4a18-b230-d63787eaf154", "address": "fa:16:3e:2e:44:60", "network": {"id": "4f4a6f13-7642-4157-ba75-be13336c456e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-673330570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96998164-ac", "ovs_interfaceid": "96998164-acd9-4a18-b230-d63787eaf154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-09801792-b5d8-470a-83a4-31af62fc046f req-33d0db4e-f5dc-4136-ab14-6583094c993d service nova] Releasing lock "refresh_cache-f147b4ee-d130-41ae-a4db-bc248fb23266" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-790e42e8-26cc-4e6f-a5e9-ead8a0dce949 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "d04cb526-f77a-457c-90b1-3e5c202c0c30" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.338s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:53 user nova-compute[71557]: DEBUG nova.policy [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '254d3560065c4d8a8aaf312870be2967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6981486a29b64ee7b9ef7cbf2ca852be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG nova.network.neutron [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Successfully created port: 3f75b48d-25ad-47ff-ab8a-ee743607793a {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "d04cb526-f77a-457c-90b1-3e5c202c0c30" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "d04cb526-f77a-457c-90b1-3e5c202c0c30" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:54 user nova-compute[71557]: INFO nova.compute.manager [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Detaching volume 8ff6497a-9926-4c83-bfd1-ea3a8ab15e98
Apr 12 10:37:54 user nova-compute[71557]: INFO nova.virt.block_device [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Attempting to driver detach volume 8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 from mountpoint /dev/vdb
Apr 12 10:37:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Attempting to detach device vdb from instance d04cb526-f77a-457c-90b1-3e5c202c0c30 from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:37:54 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:37:54 user nova-compute[71557]:   <source dev="/dev/sdf"/>
Apr 12 10:37:54 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:37:54 user nova-compute[71557]:   <serial>8ff6497a-9926-4c83-bfd1-ea3a8ab15e98</serial>
Apr 12 10:37:54 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:37:54 user nova-compute[71557]: </disk>
Apr 12 10:37:54 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:37:54 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Successfully detached device vdb from instance d04cb526-f77a-457c-90b1-3e5c202c0c30 from the persistent domain config.
Apr 12 10:37:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d04cb526-f77a-457c-90b1-3e5c202c0c30 from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:37:54 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:37:54 user nova-compute[71557]:   <source dev="/dev/sdf"/>
Apr 12 10:37:54 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:37:54 user nova-compute[71557]:   <serial>8ff6497a-9926-4c83-bfd1-ea3a8ab15e98</serial>
Apr 12 10:37:54 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:37:54 user nova-compute[71557]: </disk>
Apr 12 10:37:54 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHbVfuZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:37:54 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:37:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:37:54 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:37:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:37:54 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d6fdd5-39b9-4c3d-bc0d-dde7226c995c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:37:54 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0888e65c-9e3c-4b25-aa2f-39dc35e83afd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832] added
Apr 12 10:37:54 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[91de5bab-4ecd-4906-a920-e42a64b04f28]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[147617c8-ecbb-4299-bf1e-0c2088aeb5f1]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zHbVfuZy {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zHbVfuZy" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb765c55-2b1a-4e3a-8d20-aea832807ba9]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zHbVfuZy'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e351e3-8e06-4fa2-ab5d-4ad32f238fab]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d55dbc8-f27b-48d5-8739-d926dadf0a68]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:54 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:54 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:54 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:37:54 user nova-compute[71557]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 (non-flash)
Apr 12 10:37:54 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:54 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:54 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:54 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:37:54 user nova-compute[71557]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 (non-flash)
Apr 12 10:37:54 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:37:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad135dc7-9551-45e9-b646-7db811745502]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832, portal: 172.16.0.220,3260]
Apr 12 10:37:55 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832, portal: 172.16.0.220,3260] successful.
Apr 12 10:37:55 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36e5b94-cca1-4cea-a22d-e98c0ac4a87b]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG nova.network.neutron [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Successfully updated port: 3f75b48d-25ad-47ff-ab8a-ee743607793a {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681295875.0917084, d04cb526-f77a-457c-90b1-3e5c202c0c30 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bab3e5-25ec-4a23-88e8-3ad069657de5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:55 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:55 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:55 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:37:55 user nova-compute[71557]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 (non-flash)
Apr 12 10:37:55 user nova-compute[71557]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 (non-flash)
Apr 12 10:37:55 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:55 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:55 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:55 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:37:55 user nova-compute[71557]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 (non-flash)
Apr 12 10:37:55 user nova-compute[71557]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 (non-flash)
Apr 12 10:37:55 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d04cb526-f77a-457c-90b1-3e5c202c0c30 {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "refresh_cache-f147b4ee-d130-41ae-a4db-bc248fb23266" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquired lock "refresh_cache-f147b4ee-d130-41ae-a4db-bc248fb23266" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG nova.network.neutron [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:55 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Successfully detached device vdb from instance d04cb526-f77a-457c-90b1-3e5c202c0c30 from the live domain config.
Apr 12 10:37:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRjsXEPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:37:55 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:37:55 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG nova.compute.manager [req-2e58e420-71d6-494e-9919-ca62d2594231 req-afe2b7b2-dcaf-4441-888e-f0f831b34914 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Received event network-changed-3f75b48d-25ad-47ff-ab8a-ee743607793a {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG nova.compute.manager [req-2e58e420-71d6-494e-9919-ca62d2594231 req-afe2b7b2-dcaf-4441-888e-f0f831b34914 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Refreshing instance network info cache due to event network-changed-3f75b48d-25ad-47ff-ab8a-ee743607793a. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2e58e420-71d6-494e-9919-ca62d2594231 req-afe2b7b2-dcaf-4441-888e-f0f831b34914 service nova] Acquiring lock "refresh_cache-f147b4ee-d130-41ae-a4db-bc248fb23266" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba9c9b1-7b78-424a-b7de-6f27e0801355]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHbVfuZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG nova.network.neutron [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Updating instance_info_cache with network_info: [{"id": "96998164-acd9-4a18-b230-d63787eaf154", "address": "fa:16:3e:2e:44:60", "network": {"id": "4f4a6f13-7642-4157-ba75-be13336c456e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-673330570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96998164-ac", "ovs_interfaceid": "96998164-acd9-4a18-b230-d63787eaf154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "address": "fa:16:3e:c4:14:86", "network": {"id": "8eeeb207-87de-47b4-ad69-ef653e7e4ee3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-998224895", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f75b48d-25", "ovs_interfaceid": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Releasing lock "refresh_cache-f147b4ee-d130-41ae-a4db-bc248fb23266" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2e58e420-71d6-494e-9919-ca62d2594231 req-afe2b7b2-dcaf-4441-888e-f0f831b34914 service nova] Acquired lock "refresh_cache-f147b4ee-d130-41ae-a4db-bc248fb23266" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG nova.network.neutron [req-2e58e420-71d6-494e-9919-ca62d2594231 req-afe2b7b2-dcaf-4441-888e-f0f831b34914 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Refreshing network info cache for port 3f75b48d-25ad-47ff-ab8a-ee743607793a {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973136543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-973136543',id=10,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdimvfCdLuB4VkmLV8sKAN/mnwsyMwY8NOOti+AyTKIr7DOlGneUneWZujzSPReHJ3Bkx1IiksPqGfbsqao0C74w5qd657VSCv5dx2mJ7By8lLfjmYEB3fpEh2Gj0rqkQ==',key_name='tempest-keypair-1041772862',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:36:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6981486a29b64ee7b9ef7cbf2ca852be',ramdisk_id='',reservation_id='r-c2o3o5pa',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2008645939',owner_user_name='tempest-TaggedAttachmentsTest-2008645939-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='254d3560065c4d8a8aaf312870be2967',uuid=f147b4ee-d130-41ae-a4db-bc248fb23266,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "address": "fa:16:3e:c4:14:86", "network": {"id": "8eeeb207-87de-47b4-ad69-ef653e7e4ee3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-998224895", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f75b48d-25", "ovs_interfaceid": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Converting VIF {"id": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "address": "fa:16:3e:c4:14:86", "network": {"id": "8eeeb207-87de-47b4-ad69-ef653e7e4ee3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-998224895", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f75b48d-25", "ovs_interfaceid": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:86,bridge_name='br-int',has_traffic_filtering=True,id=3f75b48d-25ad-47ff-ab8a-ee743607793a,network=Network(8eeeb207-87de-47b4-ad69-ef653e7e4ee3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f75b48d-25') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG os_vif [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:86,bridge_name='br-int',has_traffic_filtering=True,id=3f75b48d-25ad-47ff-ab8a-ee743607793a,network=Network(8eeeb207-87de-47b4-ad69-ef653e7e4ee3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f75b48d-25') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f75b48d-25, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3f75b48d-25, col_values=(('external_ids', {'iface-id': '3f75b48d-25ad-47ff-ab8a-ee743607793a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:14:86', 'vm-uuid': 'f147b4ee-d130-41ae-a4db-bc248fb23266'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:55 user nova-compute[71557]: INFO os_vif [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:86,bridge_name='br-int',has_traffic_filtering=True,id=3f75b48d-25ad-47ff-ab8a-ee743607793a,network=Network(8eeeb207-87de-47b4-ad69-ef653e7e4ee3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f75b48d-25')
Apr 12 10:37:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973136543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-973136543',id=10,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdimvfCdLuB4VkmLV8sKAN/mnwsyMwY8NOOti+AyTKIr7DOlGneUneWZujzSPReHJ3Bkx1IiksPqGfbsqao0C74w5qd657VSCv5dx2mJ7By8lLfjmYEB3fpEh2Gj0rqkQ==',key_name='tempest-keypair-1041772862',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:36:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6981486a29b64ee7b9ef7cbf2ca852be',ramdisk_id='',reservation_id='r-c2o3o5pa',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2008645939',owner_user_name='tempest-TaggedAttachmentsTest-2008645939-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='254d3560065c4d8a8aaf312870be2967',uuid=f147b4ee-d130-41ae-a4db-bc248fb23266,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "address": "fa:16:3e:c4:14:86", "network": {"id": "8eeeb207-87de-47b4-ad69-ef653e7e4ee3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-998224895", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f75b48d-25", "ovs_interfaceid": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Converting VIF {"id": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "address": "fa:16:3e:c4:14:86", "network": {"id": "8eeeb207-87de-47b4-ad69-ef653e7e4ee3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-998224895", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f75b48d-25", "ovs_interfaceid": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:86,bridge_name='br-int',has_traffic_filtering=True,id=3f75b48d-25ad-47ff-ab8a-ee743607793a,network=Network(8eeeb207-87de-47b4-ad69-ef653e7e4ee3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f75b48d-25') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] attach device xml: <interface type="ethernet">
Apr 12 10:37:55 user nova-compute[71557]:   <mac address="fa:16:3e:c4:14:86"/>
Apr 12 10:37:55 user nova-compute[71557]:   <model type="virtio"/>
Apr 12 10:37:55 user nova-compute[71557]:   <mtu size="1442"/>
Apr 12 10:37:55 user nova-compute[71557]:   <target dev="tap3f75b48d-25"/>
Apr 12 10:37:55 user nova-compute[71557]: </interface>
Apr 12 10:37:55 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23764396635613462', 'path': '/dev/sdg'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764396635613462', 'path': '/dev/sdg'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.030s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG nova.objects.instance [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lazy-loading 'flavor' on Instance uuid 3d261c30-0c6f-4d1b-8965-448dc019728e {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f9e80c-1157-4523-adbe-60586a668806]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:37:56 user nova-compute[71557]: No targets found.
Apr 12 10:37:56 user nova-compute[71557]: iSNS:
Apr 12 10:37:56 user nova-compute[71557]: No targets found.
Apr 12 10:37:56 user nova-compute[71557]: STATIC:
Apr 12 10:37:56 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca
Apr 12 10:37:56 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:37:56 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:37:56 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd
Apr 12 10:37:56 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:37:56 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:37:56 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f
Apr 12 10:37:56 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:37:56 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:37:56 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98
Apr 12 10:37:56 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:37:56 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:37:56 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832
Apr 12 10:37:56 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:37:56 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:37:56 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4
Apr 12 10:37:56 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:37:56 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:37:56 user nova-compute[71557]: FIRMWARE:
Apr 12 10:37:56 user nova-compute[71557]: No targets found.
Apr 12 10:37:56 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:37:56 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:37:56 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 10:37:56 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:37:56 user nova-compute[71557]:   <source dev="/dev/sdg"/>
Apr 12 10:37:56 user nova-compute[71557]:   <target dev="sdc" bus="scsi"/>
Apr 12 10:37:56 user nova-compute[71557]:   <serial>ae71a30e-c9d5-4c42-b1c1-95c0af283832</serial>
Apr 12 10:37:56 user nova-compute[71557]:   <address type="drive" controller="0" unit="2"/>
Apr 12 10:37:56 user nova-compute[71557]: </disk>
Apr 12 10:37:56 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed2c6ff-81f6-4ce6-8816-2330ef0e5321]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG nova.compute.manager [req-8d22cb8b-d8d3-4b2c-a2ad-8122f7a5409e req-b20355a0-01ba-4b70-9565-e1019db5fe7c service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Received event network-vif-plugged-3f75b48d-25ad-47ff-ab8a-ee743607793a {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8d22cb8b-d8d3-4b2c-a2ad-8122f7a5409e req-b20355a0-01ba-4b70-9565-e1019db5fe7c service nova] Acquiring lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8d22cb8b-d8d3-4b2c-a2ad-8122f7a5409e req-b20355a0-01ba-4b70-9565-e1019db5fe7c service nova] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8d22cb8b-d8d3-4b2c-a2ad-8122f7a5409e req-b20355a0-01ba-4b70-9565-e1019db5fe7c service nova] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG nova.compute.manager [req-8d22cb8b-d8d3-4b2c-a2ad-8122f7a5409e req-b20355a0-01ba-4b70-9565-e1019db5fe7c service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] No waiting events found dispatching network-vif-plugged-3f75b48d-25ad-47ff-ab8a-ee743607793a {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:37:56 user nova-compute[71557]: WARNING nova.compute.manager [req-8d22cb8b-d8d3-4b2c-a2ad-8122f7a5409e req-b20355a0-01ba-4b70-9565-e1019db5fe7c service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Received unexpected event network-vif-plugged-3f75b48d-25ad-47ff-ab8a-ee743607793a for instance with vm_state active and task_state None.
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9f6b4d-0ea4-4677-9565-7df5cc209205]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:56 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:56 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:56 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:37:56 user nova-compute[71557]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 (non-flash)
Apr 12 10:37:56 user nova-compute[71557]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 (non-flash)
Apr 12 10:37:56 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:56 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:56 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:56 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:37:56 user nova-compute[71557]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 (non-flash)
Apr 12 10:37:56 user nova-compute[71557]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 (non-flash)
Apr 12 10:37:56 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd40c5870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98'): ({'sdf'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Removing single pathed devices sdf {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a4c158-8d2e-4a6c-9ca2-f9dbec477682]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cffe019-2755-44e0-afd7-c7b420708833]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Flushing IO for device /dev/sdf {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] No BDM found with device name hda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] No VIF found with MAC fa:16:3e:2e:44:60, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a9e124-35c7-464e-abb2-49ea6e666799]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:37:56 user nova-compute[71557]:   <nova:package version="0.0.0"/>
Apr 12 10:37:56 user nova-compute[71557]:   <nova:name>tempest-device-tagging-server-973136543</nova:name>
Apr 12 10:37:56 user nova-compute[71557]:   <nova:creationTime>2023-04-12 10:37:56</nova:creationTime>
Apr 12 10:37:56 user nova-compute[71557]:   <nova:flavor name="m1.nano">
Apr 12 10:37:56 user nova-compute[71557]:     <nova:memory>128</nova:memory>
Apr 12 10:37:56 user nova-compute[71557]:     <nova:disk>1</nova:disk>
Apr 12 10:37:56 user nova-compute[71557]:     <nova:swap>0</nova:swap>
Apr 12 10:37:56 user nova-compute[71557]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:37:56 user nova-compute[71557]:     <nova:vcpus>1</nova:vcpus>
Apr 12 10:37:56 user nova-compute[71557]:   </nova:flavor>
Apr 12 10:37:56 user nova-compute[71557]:   <nova:owner>
Apr 12 10:37:56 user nova-compute[71557]:     <nova:user uuid="254d3560065c4d8a8aaf312870be2967">tempest-TaggedAttachmentsTest-2008645939-project-member</nova:user>
Apr 12 10:37:56 user nova-compute[71557]:     <nova:project uuid="6981486a29b64ee7b9ef7cbf2ca852be">tempest-TaggedAttachmentsTest-2008645939</nova:project>
Apr 12 10:37:56 user nova-compute[71557]:   </nova:owner>
Apr 12 10:37:56 user nova-compute[71557]:   <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:37:56 user nova-compute[71557]:   <nova:ports>
Apr 12 10:37:56 user nova-compute[71557]:     <nova:port uuid="96998164-acd9-4a18-b230-d63787eaf154">
Apr 12 10:37:56 user nova-compute[71557]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 10:37:56 user nova-compute[71557]:     </nova:port>
Apr 12 10:37:56 user nova-compute[71557]:     <nova:port uuid="3f75b48d-25ad-47ff-ab8a-ee743607793a">
Apr 12 10:37:56 user nova-compute[71557]:       <nova:ip type="fixed" address="10.10.10.233" ipVersion="4"/>
Apr 12 10:37:56 user nova-compute[71557]:     </nova:port>
Apr 12 10:37:56 user nova-compute[71557]:   </nova:ports>
Apr 12 10:37:56 user nova-compute[71557]: </nova:instance>
Apr 12 10:37:56 user nova-compute[71557]:  {{(pid=71557) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2a5900-4748-445e-9ee3-dbd66be70ff5]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] SCSI volumes sdf have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-df341c97-03e8-4f32-8cd0-5c1043c7aaf4 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "interface-f147b4ee-d130-41ae-a4db-bc248fb23266-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.026s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d22806-586c-435c-85a9-fc6c14fd48ff]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd8c601-f680-415a-95cf-ebf5e4de8f35]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98, portal: 172.16.0.220,3260]
Apr 12 10:37:56 user nova-compute[71557]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98, portal: 172.16.0.220,3260] successful.
Apr 12 10:37:56 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff6497a-9926-4c83-bfd1-ea3a8ab15e98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[be166306-28b4-4239-8c46-aa771952a6c1]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] <== disconnect_volume: return (1446ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG nova.network.neutron [req-2e58e420-71d6-494e-9919-ca62d2594231 req-afe2b7b2-dcaf-4441-888e-f0f831b34914 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Updated VIF entry in instance network info cache for port 3f75b48d-25ad-47ff-ab8a-ee743607793a. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG nova.network.neutron [req-2e58e420-71d6-494e-9919-ca62d2594231 req-afe2b7b2-dcaf-4441-888e-f0f831b34914 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Updating instance_info_cache with network_info: [{"id": "96998164-acd9-4a18-b230-d63787eaf154", "address": "fa:16:3e:2e:44:60", "network": {"id": "4f4a6f13-7642-4157-ba75-be13336c456e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-673330570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96998164-ac", "ovs_interfaceid": "96998164-acd9-4a18-b230-d63787eaf154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "address": "fa:16:3e:c4:14:86", "network": {"id": "8eeeb207-87de-47b4-ad69-ef653e7e4ee3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-998224895", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f75b48d-25", "ovs_interfaceid": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "f147b4ee-d130-41ae-a4db-bc248fb23266" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2e58e420-71d6-494e-9919-ca62d2594231 req-afe2b7b2-dcaf-4441-888e-f0f831b34914 service nova] Releasing lock "refresh_cache-f147b4ee-d130-41ae-a4db-bc248fb23266" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG nova.objects.instance [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lazy-loading 'flavor' on Instance uuid f147b4ee-d130-41ae-a4db-bc248fb23266 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] No BDM found with device name sda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] No VIF found with MAC fa:16:3e:37:c9:7a, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6a2a828a-48bd-4832-a61e-16ff7263ba08 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "3d261c30-0c6f-4d1b-8965-448dc019728e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.913s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "f147b4ee-d130-41ae-a4db-bc248fb23266" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:57 user nova-compute[71557]: INFO nova.compute.manager [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Attaching volume 564bff2e-deb9-45d4-aaa7-015aed7266cd to /dev/vdb
Apr 12 10:37:57 user nova-compute[71557]: DEBUG os_brick.utils [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cf4f11-5b9e-489b-ba20-72c1a9b9ff22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28e0706-706b-4ec3-b297-804de70c3c65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[060560cb-7df6-45dd-b3c3-42e692cbc3a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[20143b3f-c32a-4c27-885f-63071121c437]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:37:57 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5473daa5-b8c4-45e5-aee3-470fcd83e51e]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG os_brick.utils [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Updating existing volume attachment record: e7716eed-4878-4bc8-9d66-2a3b2798a2bf {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG nova.objects.instance [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lazy-loading 'flavor' on Instance uuid d04cb526-f77a-457c-90b1-3e5c202c0c30 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3db65072-053c-4d60-96cc-f6ec48594ea8 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "d04cb526-f77a-457c-90b1-3e5c202c0c30" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.019s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG nova.compute.manager [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CYKBFxrG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ea55f551-968e-4ece-a37a-c4128ce5e8cb', 'attached_at': '', 'detached_at': '', 'volume_id': '63298498-6bc0-47a0-b48e-815852c52771', 'serial': '63298498-6bc0-47a0-b48e-815852c52771'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryHjCUZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'ea55f551-968e-4ece-a37a-c4128ce5e8cb', 'attached_at': '', 'detached_at': '', 'volume_id': '2c1f53d0-46d5-4944-89d3-f0793ff3fbf4', 'serial'} {{(pid=71557) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CYKBFxrG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:37:57 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:37:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:37:57 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:37:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:37:57 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfe3707-620e-4822-97ab-40634c3a4574]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:37:57 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0051dcb2-00db-416e-9956-177d250368f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771] added
Apr 12 10:37:57 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "3d261c30-0c6f-4d1b-8965-448dc019728e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "3d261c30-0c6f-4d1b-8965-448dc019728e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:58 user nova-compute[71557]: INFO nova.compute.manager [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Detaching volume ae71a30e-c9d5-4c42-b1c1-95c0af283832
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf5bf4f-56f0-4e1b-9180-f7ba674383e2]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a224cfcd-97c9-4ded-9bd1-71e0c8c7340e]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CYKBFxrG {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CYKBFxrG" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[398063d5-99fa-4b2c-845d-4dcd80a39a0e]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CYKBFxrG'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:58 user nova-compute[71557]: INFO nova.virt.block_device [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Attempting to driver detach volume ae71a30e-c9d5-4c42-b1c1-95c0af283832 from mountpoint /dev/sdc
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Attempting to detach device sdc from instance 3d261c30-0c6f-4d1b-8965-448dc019728e from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:37:58 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:37:58 user nova-compute[71557]:   <source dev="/dev/sdg"/>
Apr 12 10:37:58 user nova-compute[71557]:   <target dev="sdc" bus="scsi"/>
Apr 12 10:37:58 user nova-compute[71557]:   <serial>ae71a30e-c9d5-4c42-b1c1-95c0af283832</serial>
Apr 12 10:37:58 user nova-compute[71557]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 12 10:37:58 user nova-compute[71557]: </disk>
Apr 12 10:37:58 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:37:58 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Successfully detached device sdc from instance 3d261c30-0c6f-4d1b-8965-448dc019728e from the persistent domain config.
Apr 12 10:37:58 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 3d261c30-0c6f-4d1b-8965-448dc019728e from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:37:58 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:37:58 user nova-compute[71557]:   <source dev="/dev/sdg"/>
Apr 12 10:37:58 user nova-compute[71557]:   <target dev="sdc" bus="scsi"/>
Apr 12 10:37:58 user nova-compute[71557]:   <serial>ae71a30e-c9d5-4c42-b1c1-95c0af283832</serial>
Apr 12 10:37:58 user nova-compute[71557]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 12 10:37:58 user nova-compute[71557]: </disk>
Apr 12 10:37:58 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f7832b-d3ec-4947-8613-b13c0950a53d]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa1799b-68ea-422c-8e07-6dcd8a23fc6e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:58 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:58 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:58 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:37:58 user nova-compute[71557]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 (non-flash)
Apr 12 10:37:58 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:58 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:58 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:58 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:37:58 user nova-compute[71557]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 (non-flash)
Apr 12 10:37:58 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ea944e-788f-4611-be3b-714148629e59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771, portal: 172.16.0.220,3260]
Apr 12 10:37:58 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771, portal: 172.16.0.220,3260] successful.
Apr 12 10:37:58 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[510c1b94-2ea1-4170-b5a9-b8c19263d2a6]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[703666bd-ac93-48d2-a17d-9ef1e35bbe43]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:58 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:58 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:58 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:37:58 user nova-compute[71557]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 (non-flash)
Apr 12 10:37:58 user nova-compute[71557]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:37:58 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:58 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:58 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:58 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:37:58 user nova-compute[71557]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 (non-flash)
Apr 12 10:37:58 user nova-compute[71557]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:37:58 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG nova.compute.manager [req-fb796e9f-b749-4c4d-a728-12bbbde888cc req-276584b3-9bee-4a92-a32f-51340d1ec515 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Received event network-vif-plugged-3f75b48d-25ad-47ff-ab8a-ee743607793a {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fb796e9f-b749-4c4d-a728-12bbbde888cc req-276584b3-9bee-4a92-a32f-51340d1ec515 service nova] Acquiring lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fb796e9f-b749-4c4d-a728-12bbbde888cc req-276584b3-9bee-4a92-a32f-51340d1ec515 service nova] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fb796e9f-b749-4c4d-a728-12bbbde888cc req-276584b3-9bee-4a92-a32f-51340d1ec515 service nova] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG nova.compute.manager [req-fb796e9f-b749-4c4d-a728-12bbbde888cc req-276584b3-9bee-4a92-a32f-51340d1ec515 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] No waiting events found dispatching network-vif-plugged-3f75b48d-25ad-47ff-ab8a-ee743607793a {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:37:58 user nova-compute[71557]: WARNING nova.compute.manager [req-fb796e9f-b749-4c4d-a728-12bbbde888cc req-276584b3-9bee-4a92-a32f-51340d1ec515 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Received unexpected event network-vif-plugged-3f75b48d-25ad-47ff-ab8a-ee743607793a for instance with vm_state active and task_state None.
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f42172-c917-4210-b431-b3e66112b47c]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: None {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681295878.4733343, 3d261c30-0c6f-4d1b-8965-448dc019728e => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 3d261c30-0c6f-4d1b-8965-448dc019728e {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 10:37:58 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Successfully detached device sdc from instance 3d261c30-0c6f-4d1b-8965-448dc019728e from the live domain config.
Apr 12 10:37:58 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:37:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHbVfuZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:37:58 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:37:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CYKBFxrG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23363316133386234', 'path': '/dev/sdf'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363316133386234', 'path': '/dev/sdf'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.805s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG nova.objects.instance [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lazy-loading 'flavor' on Instance uuid ea55f551-968e-4ece-a37a-c4128ce5e8cb {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e844c3fc-a552-4b95-bbd0-0147a2a8a4fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:37:59 user nova-compute[71557]: No targets found.
Apr 12 10:37:59 user nova-compute[71557]: iSNS:
Apr 12 10:37:59 user nova-compute[71557]: No targets found.
Apr 12 10:37:59 user nova-compute[71557]: STATIC:
Apr 12 10:37:59 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca
Apr 12 10:37:59 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:37:59 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:37:59 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771
Apr 12 10:37:59 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:37:59 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:37:59 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd
Apr 12 10:37:59 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:37:59 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:37:59 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f
Apr 12 10:37:59 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:37:59 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:37:59 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832
Apr 12 10:37:59 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:37:59 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:37:59 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4
Apr 12 10:37:59 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:37:59 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:37:59 user nova-compute[71557]: FIRMWARE:
Apr 12 10:37:59 user nova-compute[71557]: No targets found.
Apr 12 10:37:59 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:37:59 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:37:59 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec17a3c-e8e4-4b7f-b128-a1b72179cda9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e655f678-50f4-46f5-a164-87a6c3a6442b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:59 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:59 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:59 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:37:59 user nova-compute[71557]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 (non-flash)
Apr 12 10:37:59 user nova-compute[71557]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:37:59 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:37:59 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:37:59 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:37:59 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:37:59 user nova-compute[71557]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 (non-flash)
Apr 12 10:37:59 user nova-compute[71557]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:37:59 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd40c7910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832'): ({'sdg'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Removing single pathed devices sdg {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6239a940-1ebd-4cd4-9206-ff4d7fc6649b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f70c2ef-8831-4f68-a799-4dde297afde7]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Flushing IO for device /dev/sdg {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[125d6bbb-b647-425f-9822-2ba7c8001074]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.055s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd5929b-8d24-44d0-b09d-3ef49a31ddab]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] SCSI volumes sdg have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4f4078-a94c-43e6-beb9-53cf98f33682]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[030a4d37-1911-49aa-addf-5cbe520bdc86]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832, portal: 172.16.0.220,3260]
Apr 12 10:37:59 user nova-compute[71557]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832, portal: 172.16.0.220,3260] successful.
Apr 12 10:37:59 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae71a30e-c9d5-4c42-b1c1-95c0af283832 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f5c0c3-6940-4600-957f-d8d4f09f014a]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] <== disconnect_volume: return (1173ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:37:59 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 114294784 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 116391936 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:01 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 116391936 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:01 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 116391936 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:02 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 134217728 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:02 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 253755392 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:03 user nova-compute[71557]: DEBUG nova.objects.instance [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lazy-loading 'flavor' on Instance uuid 3d261c30-0c6f-4d1b-8965-448dc019728e {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:38:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-64c3184a-fd6e-414a-9420-1e8ed7c93c89 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "3d261c30-0c6f-4d1b-8965-448dc019728e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.087s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 257949696 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "3d261c30-0c6f-4d1b-8965-448dc019728e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "3d261c30-0c6f-4d1b-8965-448dc019728e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "3d261c30-0c6f-4d1b-8965-448dc019728e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "3d261c30-0c6f-4d1b-8965-448dc019728e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "3d261c30-0c6f-4d1b-8965-448dc019728e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:03 user nova-compute[71557]: INFO nova.compute.manager [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Terminating instance
Apr 12 10:38:03 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:38:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 257949696 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-0b8e00b1-2db0-4d3e-a4f1-02f71a3f5b57 req-50630167-3b78-454d-8521-d7a3afa46b82 service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Received event network-vif-unplugged-166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0b8e00b1-2db0-4d3e-a4f1-02f71a3f5b57 req-50630167-3b78-454d-8521-d7a3afa46b82 service nova] Acquiring lock "3d261c30-0c6f-4d1b-8965-448dc019728e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0b8e00b1-2db0-4d3e-a4f1-02f71a3f5b57 req-50630167-3b78-454d-8521-d7a3afa46b82 service nova] Lock "3d261c30-0c6f-4d1b-8965-448dc019728e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0b8e00b1-2db0-4d3e-a4f1-02f71a3f5b57 req-50630167-3b78-454d-8521-d7a3afa46b82 service nova] Lock "3d261c30-0c6f-4d1b-8965-448dc019728e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-0b8e00b1-2db0-4d3e-a4f1-02f71a3f5b57 req-50630167-3b78-454d-8521-d7a3afa46b82 service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] No waiting events found dispatching network-vif-unplugged-166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-0b8e00b1-2db0-4d3e-a4f1-02f71a3f5b57 req-50630167-3b78-454d-8521-d7a3afa46b82 service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Received event network-vif-unplugged-166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 287309824 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:04 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Instance destroyed successfully.
Apr 12 10:38:04 user nova-compute[71557]: DEBUG nova.objects.instance [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lazy-loading 'resources' on Instance uuid 3d261c30-0c6f-4d1b-8965-448dc019728e {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:35:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-328020930',display_name='tempest-AttachSCSIVolumeTestJSON-server-328020930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-328020930',id=9,image_ref='635d50f2-49f4-4589-b08b-3bd3f2f32a2e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzQawsEeqCly4GrkNJAA9BBwNnMJnPgKodH8mU0eVkzeBhsPPS+9XOw4Ves3ommAtM8yIxnCyFKIdDYuEUOj5JIixEV4XVMiYn1a4c9klmAXFo78LZXAV5NnNG2cYaSuw==',key_name='tempest-keypair-1229893823',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:36:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cede3351295e451283a0414aefea1de5',ramdisk_id='',reservation_id='r-p8wz8ax5',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='635d50f2-49f4-4589-b08b-3bd3f2f32a2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-384950708',owner_user_name='tempest-AttachSCSIVolumeTestJSON-384950708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:36:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f1517aae734c8aa5b0acbc906af9c0',uuid=3d261c30-0c6f-4d1b-8965-448dc019728e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38", "address": "fa:16:3e:37:c9:7a", "network": {"id": "38b15083-7fc7-4136-940b-ac6f8ce892a7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-827628896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cede3351295e451283a0414aefea1de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c8bd6-ec", "ovs_interfaceid": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Converting VIF {"id": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38", "address": "fa:16:3e:37:c9:7a", "network": {"id": "38b15083-7fc7-4136-940b-ac6f8ce892a7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-827628896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cede3351295e451283a0414aefea1de5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c8bd6-ec", "ovs_interfaceid": "166c8bd6-ec3c-46f1-ad64-9efb6e21ad38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:c9:7a,bridge_name='br-int',has_traffic_filtering=True,id=166c8bd6-ec3c-46f1-ad64-9efb6e21ad38,network=Network(38b15083-7fc7-4136-940b-ac6f8ce892a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166c8bd6-ec') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG os_vif [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:c9:7a,bridge_name='br-int',has_traffic_filtering=True,id=166c8bd6-ec3c-46f1-ad64-9efb6e21ad38,network=Network(38b15083-7fc7-4136-940b-ac6f8ce892a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166c8bd6-ec') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap166c8bd6-ec, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:38:04 user nova-compute[71557]: INFO os_vif [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:c9:7a,bridge_name='br-int',has_traffic_filtering=True,id=166c8bd6-ec3c-46f1-ad64-9efb6e21ad38,network=Network(38b15083-7fc7-4136-940b-ac6f8ce892a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166c8bd6-ec')
Apr 12 10:38:04 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Deleting instance files /opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e_del
Apr 12 10:38:04 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Deletion of /opt/stack/data/nova/instances/3d261c30-0c6f-4d1b-8965-448dc019728e_del complete
Apr 12 10:38:04 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SlgQVHOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:38:04 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:38:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:38:04 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:38:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:38:04 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8571ed-04ff-4e4f-8466-491f75498c12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:38:04 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:04 user nova-compute[71557]: INFO nova.compute.manager [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Took 1.00 seconds to destroy the instance on the hypervisor.
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e52e3a-6227-4d2b-823e-f0bd9c69900f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd] added
Apr 12 10:38:04 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c9b46f-9de2-4128-8633-f8e997bdd52d]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 450887680 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f5a405-a5ed-4736-ba45-d9eda4b8ca87]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SlgQVHOu {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SlgQVHOu" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[93359a21-d7d7-4a0c-8684-b45b5e630a87]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SlgQVHOu'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[11193696-2471-4e6a-95a3-14728e25a9af]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7379b0a-d442-4710-b622-c6a116c05592]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:38:04 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:38:04 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:38:04 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:38:04 user nova-compute[71557]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:38:04 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:38:04 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:38:04 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:38:04 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:38:04 user nova-compute[71557]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:38:04 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:38:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:05 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 610271232 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:05 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:38:05 user nova-compute[71557]: DEBUG nova.compute.manager [req-f90fbdaa-2ba9-4998-bfc9-135e41d4b3ae req-3433c271-39a3-4048-9b0b-95e6f7d72ba2 service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Received event network-vif-deleted-166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:05 user nova-compute[71557]: INFO nova.compute.manager [req-f90fbdaa-2ba9-4998-bfc9-135e41d4b3ae req-3433c271-39a3-4048-9b0b-95e6f7d72ba2 service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Neutron deleted interface 166c8bd6-ec3c-46f1-ad64-9efb6e21ad38; detaching it from the instance and deleting it from the info cache
Apr 12 10:38:05 user nova-compute[71557]: DEBUG nova.network.neutron [req-f90fbdaa-2ba9-4998-bfc9-135e41d4b3ae req-3433c271-39a3-4048-9b0b-95e6f7d72ba2 service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:38:05 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Took 1.01 seconds to deallocate network for instance.
Apr 12 10:38:05 user nova-compute[71557]: DEBUG nova.compute.manager [req-f90fbdaa-2ba9-4998-bfc9-135e41d4b3ae req-3433c271-39a3-4048-9b0b-95e6f7d72ba2 service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Detach interface failed, port_id=166c8bd6-ec3c-46f1-ad64-9efb6e21ad38, reason: Instance 3d261c30-0c6f-4d1b-8965-448dc019728e could not be found. {{(pid=71557) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 10:38:05 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 749731840 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd -p 172.16.0.220:3260 --login" returned: 0 in 1.081s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ffee58-499e-4a19-8e2e-0ba28b5f9782]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd, portal: 172.16.0.220,3260]
Apr 12 10:38:06 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd, portal: 172.16.0.220,3260] successful.
Apr 12 10:38:06 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cfbf45-2bb4-4055-9784-f1927c954e12]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dc384e-73e9-4e67-8d41-5a1da5089b9e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd (non-flash)
Apr 12 10:38:06 user nova-compute[71557]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:38:06 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:38:06 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:38:06 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:38:06 user nova-compute[71557]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:38:06 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd (non-flash)
Apr 12 10:38:06 user nova-compute[71557]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:38:06 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:38:06 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:38:06 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:38:06 user nova-compute[71557]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:38:06 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.413s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] HCTL ('38', '-', '-', 0) found on session 10 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG nova.compute.manager [req-f288318e-abe3-452f-841e-311f08ef9e82 req-3f21e92c-34af-4445-ba5e-14ad9196ce41 service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Received event network-vif-plugged-166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f288318e-abe3-452f-841e-311f08ef9e82 req-3f21e92c-34af-4445-ba5e-14ad9196ce41 service nova] Acquiring lock "3d261c30-0c6f-4d1b-8965-448dc019728e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f288318e-abe3-452f-841e-311f08ef9e82 req-3f21e92c-34af-4445-ba5e-14ad9196ce41 service nova] Lock "3d261c30-0c6f-4d1b-8965-448dc019728e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f288318e-abe3-452f-841e-311f08ef9e82 req-3f21e92c-34af-4445-ba5e-14ad9196ce41 service nova] Lock "3d261c30-0c6f-4d1b-8965-448dc019728e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG nova.compute.manager [req-f288318e-abe3-452f-841e-311f08ef9e82 req-3f21e92c-34af-4445-ba5e-14ad9196ce41 service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] No waiting events found dispatching network-vif-plugged-166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:06 user nova-compute[71557]: WARNING nova.compute.manager [req-f288318e-abe3-452f-841e-311f08ef9e82 req-3f21e92c-34af-4445-ba5e-14ad9196ce41 service nova] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Received unexpected event network-vif-plugged-166c8bd6-ec3c-46f1-ad64-9efb6e21ad38 for instance with vm_state deleted and task_state None.
Apr 12 10:38:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f598cc-32f1-47d9-a552-75dfe4345c92]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SlgQVHOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.465s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:06 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Deleted allocations for instance 3d261c30-0c6f-4d1b-8965-448dc019728e
Apr 12 10:38:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 901775360 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5f91dae6-ce04-43ac-b4d4-fe5b457f4d16 tempest-AttachSCSIVolumeTestJSON-384950708 tempest-AttachSCSIVolumeTestJSON-384950708-project-member] Lock "3d261c30-0c6f-4d1b-8965-448dc019728e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.679s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryHjCUZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:38:07 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:38:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.461s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] <== connect_volume: return (2462ms) {'type': 'block', 'scsi_wwn': '26530616266383830', 'path': '/dev/sdg'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530616266383830', 'path': '/dev/sdg'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.185s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG nova.objects.instance [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lazy-loading 'flavor' on Instance uuid f147b4ee-d130-41ae-a4db-bc248fb23266 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[55889252-33f6-46b8-83c7-ab53f71c68f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:38:07 user nova-compute[71557]: No targets found.
Apr 12 10:38:07 user nova-compute[71557]: iSNS:
Apr 12 10:38:07 user nova-compute[71557]: No targets found.
Apr 12 10:38:07 user nova-compute[71557]: STATIC:
Apr 12 10:38:07 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca
Apr 12 10:38:07 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:07 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:07 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771
Apr 12 10:38:07 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:07 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:07 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd
Apr 12 10:38:07 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:07 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:07 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f
Apr 12 10:38:07 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:07 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:07 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd
Apr 12 10:38:07 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:07 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:07 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4
Apr 12 10:38:07 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:07 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:07 user nova-compute[71557]: FIRMWARE:
Apr 12 10:38:07 user nova-compute[71557]: No targets found.
Apr 12 10:38:07 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:38:07 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:38:07 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 10:38:07 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:38:07 user nova-compute[71557]:   <source dev="/dev/sdg"/>
Apr 12 10:38:07 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:38:07 user nova-compute[71557]:   <serial>564bff2e-deb9-45d4-aaa7-015aed7266cd</serial>
Apr 12 10:38:07 user nova-compute[71557]: </disk>
Apr 12 10:38:07 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbab962-5fb2-40a0-b3b8-1de94cbb6461]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ea49ca-d608-4728-b29c-6862c6c29e45]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd (non-flash)
Apr 12 10:38:07 user nova-compute[71557]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:38:07 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:38:07 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:38:07 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:38:07 user nova-compute[71557]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:38:07 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd (non-flash)
Apr 12 10:38:07 user nova-compute[71557]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:38:07 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:38:07 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:38:07 user nova-compute[71557]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:38:07 user nova-compute[71557]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:38:07 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd44685e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4'): ({'sde'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Removing single pathed devices sde {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a1b4b0-2486-4fce-9361-5d6fbf7356de]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[472bde4e-37df-4754-bcd9-1d73919461e9]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Flushing IO for device /dev/sde {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[186b652f-c05b-4870-8b52-fd1ba9b28e80]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa5f01f-5836-41e6-a18d-8941ae9650a0]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] SCSI volumes sde have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d2cc73-9ab5-4feb-9b4a-869d0292418e]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d32e1a6-e6e0-4aa1-b29b-b5036d19c0fb]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4, portal: 172.16.0.220,3260]
Apr 12 10:38:07 user nova-compute[71557]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4, portal: 172.16.0.220,3260] successful.
Apr 12 10:38:07 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fa9cd5-3a5d-4a43-93aa-bbfdb47e2448]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] <== disconnect_volume: return (501ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG nova.compute.manager [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CYKBFxrG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'ea55f551-968e-4ece-a37a-c4128ce5e8cb', 'attached_at': '', 'detached_at': '', 'volume_id': '63298498-6bc0-47a0-b48e-815852c52771', 'serial'} {{(pid=71557) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG nova.compute.manager [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] swap_volume: removing Cinder connection for volume 2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 {{(pid=71557) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] No BDM found with device name hda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] No VIF found with MAC fa:16:3e:2e:44:60, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:38:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d9da4b6e-0093-4db5-9b2c-37875e703205 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.729s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:08 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:38:08 user nova-compute[71557]: DEBUG nova.compute.manager [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] swap_volume: Updating volume 2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "CYKBFxrG", "auth_password": "3abKr68hHUQOSw", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "63298498-6bc0-47a0-b48e-815852c52771"}, "status": "reserved", "instance": "ea55f551-968e-4ece-a37a-c4128ce5e8cb", "attached_at": "", "detached_at": "", "volume_id": "63298498-6bc0-47a0-b48e-815852c52771", "serial": "63298498-6bc0-47a0-b48e-815852c52771"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '63298498-6bc0-47a0-b48e-815852c52771', 'no_device': None, 'attachment_id': 'fac4d505-fdde-415e-8beb-95356862adeb'} {{(pid=71557) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 12 10:38:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e852c90-8e83-4441-b439-251a641f7b42 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.523s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "f147b4ee-d130-41ae-a4db-bc248fb23266" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:08 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:38:08 user nova-compute[71557]: INFO nova.compute.claims [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Claim successful on node user
Apr 12 10:38:08 user nova-compute[71557]: INFO nova.compute.manager [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Detaching volume 564bff2e-deb9-45d4-aaa7-015aed7266cd
Apr 12 10:38:08 user nova-compute[71557]: INFO nova.virt.block_device [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Attempting to driver detach volume 564bff2e-deb9-45d4-aaa7-015aed7266cd from mountpoint /dev/vdb
Apr 12 10:38:08 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Attempting to detach device vdb from instance f147b4ee-d130-41ae-a4db-bc248fb23266 from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 10:38:08 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:38:08 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:38:08 user nova-compute[71557]:   <source dev="/dev/sdg"/>
Apr 12 10:38:08 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:38:08 user nova-compute[71557]:   <serial>564bff2e-deb9-45d4-aaa7-015aed7266cd</serial>
Apr 12 10:38:08 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 10:38:08 user nova-compute[71557]: </disk>
Apr 12 10:38:08 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:38:08 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Successfully detached device vdb from instance f147b4ee-d130-41ae-a4db-bc248fb23266 from the persistent domain config.
Apr 12 10:38:08 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f147b4ee-d130-41ae-a4db-bc248fb23266 from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 10:38:08 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:38:08 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:38:08 user nova-compute[71557]:   <source dev="/dev/sdg"/>
Apr 12 10:38:08 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:38:08 user nova-compute[71557]:   <serial>564bff2e-deb9-45d4-aaa7-015aed7266cd</serial>
Apr 12 10:38:08 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 10:38:08 user nova-compute[71557]: </disk>
Apr 12 10:38:08 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:38:08 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:38:08 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:38:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:08 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:38:08 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:38:08 user nova-compute[71557]: DEBUG nova.network.neutron [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:38:09 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:38:09 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681295889.019916, f147b4ee-d130-41ae-a4db-bc248fb23266 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f147b4ee-d130-41ae-a4db-bc248fb23266 {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 10:38:09 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Successfully detached device vdb from instance f147b4ee-d130-41ae-a4db-bc248fb23266 from the live domain config.
Apr 12 10:38:09 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SlgQVHOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:38:09 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0accff-4c26-4ea8-a0ad-ef129b175268]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:38:09 user nova-compute[71557]: No targets found.
Apr 12 10:38:09 user nova-compute[71557]: iSNS:
Apr 12 10:38:09 user nova-compute[71557]: No targets found.
Apr 12 10:38:09 user nova-compute[71557]: STATIC:
Apr 12 10:38:09 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca
Apr 12 10:38:09 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:09 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:09 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771
Apr 12 10:38:09 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:09 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:09 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd
Apr 12 10:38:09 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:09 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:09 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f
Apr 12 10:38:09 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:09 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:09 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd
Apr 12 10:38:09 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:09 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:09 user nova-compute[71557]: FIRMWARE:
Apr 12 10:38:09 user nova-compute[71557]: No targets found.
Apr 12 10:38:09 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:38:09 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:38:09 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f38e4d4-e6bb-4b28-a5fc-7f1ad47060b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG nova.policy [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c97c57a3e7142d088e1cf315f5d8d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16de154a6d344b18a939c6a1b1a679f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e865f0-8f01-4684-a473-47bfea10127c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd (non-flash)
Apr 12 10:38:09 user nova-compute[71557]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:38:09 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:38:09 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:38:09 user nova-compute[71557]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:38:09 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd (non-flash)
Apr 12 10:38:09 user nova-compute[71557]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:38:09 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:38:09 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:38:09 user nova-compute[71557]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:38:09 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd4320310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd'): ({'sdg'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Removing single pathed devices sdg {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f46fcbe-20a1-46d0-ac16-959afa0ab241]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:38:09 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Creating image(s)
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "/opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "/opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0297a87a-595e-4014-bdbd-323d42c5ca7d]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Flushing IO for device /dev/sdg {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b74f7f4-b775-4c32-b3e9-3825575ae52f]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[038c6293-bcb4-4ea6-8400-f74f4e4f07a0]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] SCSI volumes sdg have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5bab01-fa38-4bef-9675-40a30c601f31]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.139s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e5a52d-4df7-45d1-9b8f-9ea285ed2259]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd, portal: 172.16.0.220,3260]
Apr 12 10:38:09 user nova-compute[71557]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd, portal: 172.16.0.220,3260] successful.
Apr 12 10:38:09 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:564bff2e-deb9-45d4-aaa7-015aed7266cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2648bf9-c203-404e-ad5e-8ed6f8f3eb1f]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] <== disconnect_volume: return (367ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.144s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/disk 1073741824" returned: 0 in 0.067s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Acquiring lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.utils [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.140s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3322678f-7cdf-4b44-9902-085076863163]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG nova.network.neutron [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Successfully created port: 5eed0079-0c02-43b0-8124-4ef257a7eb1f {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[de53935d-3735-4fc8-ac86-d374cef5c561]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[823a50af-aaa6-439e-9199-d2d7b67f3db4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9ca0d2-e768-41d3-ac65-5e18732c72d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Cannot resize image /opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG nova.objects.instance [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lazy-loading 'migration_context' on Instance uuid a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:38:09 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[562d211d-e9dc-4c0e-b318-17450da43f3f]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG os_brick.utils [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Ensure instance console log exists: /opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:09 user nova-compute[71557]: INFO nova.compute.manager [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Swapping volume 63298498-6bc0-47a0-b48e-815852c52771 for 2c1f53d0-46d5-4944-89d3-f0793ff3fbf4
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.objects.instance [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lazy-loading 'flavor' on Instance uuid f147b4ee-d130-41ae-a4db-bc248fb23266 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.compute.manager [req-c3ad85f9-36d9-46be-a477-81ead2fceeec req-c4b9ef76-1b39-4d60-8980-bdf0b1fa595c service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-changed-fe31a29c-b57d-463d-98ba-6527848edeba {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.compute.manager [req-c3ad85f9-36d9-46be-a477-81ead2fceeec req-c4b9ef76-1b39-4d60-8980-bdf0b1fa595c service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Refreshing instance network info cache due to event network-changed-fe31a29c-b57d-463d-98ba-6527848edeba. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c3ad85f9-36d9-46be-a477-81ead2fceeec req-c4b9ef76-1b39-4d60-8980-bdf0b1fa595c service nova] Acquiring lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c3ad85f9-36d9-46be-a477-81ead2fceeec req-c4b9ef76-1b39-4d60-8980-bdf0b1fa595c service nova] Acquired lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.network.neutron [req-c3ad85f9-36d9-46be-a477-81ead2fceeec req-c4b9ef76-1b39-4d60-8980-bdf0b1fa595c service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Refreshing network info cache for port fe31a29c-b57d-463d-98ba-6527848edeba {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-11fc0954-7f23-48e4-a33a-dc3e9658bff2 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.817s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.network.neutron [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Successfully updated port: 5eed0079-0c02-43b0-8124-4ef257a7eb1f {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "refresh_cache-a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquired lock "refresh_cache-a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.network.neutron [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.compute.manager [req-043d8c22-b5de-4f42-a22b-b3d6d79070a4 req-c9d4377a-51b8-4ff7-8b00-b48255c39ddf service nova] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Received event network-changed-5eed0079-0c02-43b0-8124-4ef257a7eb1f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.compute.manager [req-043d8c22-b5de-4f42-a22b-b3d6d79070a4 req-c9d4377a-51b8-4ff7-8b00-b48255c39ddf service nova] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Refreshing instance network info cache due to event network-changed-5eed0079-0c02-43b0-8124-4ef257a7eb1f. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-043d8c22-b5de-4f42-a22b-b3d6d79070a4 req-c9d4377a-51b8-4ff7-8b00-b48255c39ddf service nova] Acquiring lock "refresh_cache-a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.network.neutron [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "interface-f147b4ee-d130-41ae-a4db-bc248fb23266-3f75b48d-25ad-47ff-ab8a-ee743607793a" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "interface-f147b4ee-d130-41ae-a4db-bc248fb23266-3f75b48d-25ad-47ff-ab8a-ee743607793a" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.objects.instance [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lazy-loading 'flavor' on Instance uuid f147b4ee-d130-41ae-a4db-bc248fb23266 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973136543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-973136543',id=10,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdimvfCdLuB4VkmLV8sKAN/mnwsyMwY8NOOti+AyTKIr7DOlGneUneWZujzSPReHJ3Bkx1IiksPqGfbsqao0C74w5qd657VSCv5dx2mJ7By8lLfjmYEB3fpEh2Gj0rqkQ==',key_name='tempest-keypair-1041772862',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:36:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6981486a29b64ee7b9ef7cbf2ca852be',ramdisk_id='',reservation_id='r-c2o3o5pa',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2008645939',owner_user_name='tempest-TaggedAttachmentsTest-2008645939-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='254d3560065c4d8a8aaf312870be2967',uuid=f147b4ee-d130-41ae-a4db-bc248fb23266,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "address": "fa:16:3e:c4:14:86", "network": {"id": "8eeeb207-87de-47b4-ad69-ef653e7e4ee3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-998224895", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f75b48d-25", "ovs_interfaceid": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Converting VIF {"id": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "address": "fa:16:3e:c4:14:86", "network": {"id": "8eeeb207-87de-47b4-ad69-ef653e7e4ee3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-998224895", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f75b48d-25", "ovs_interfaceid": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:86,bridge_name='br-int',has_traffic_filtering=True,id=3f75b48d-25ad-47ff-ab8a-ee743607793a,network=Network(8eeeb207-87de-47b4-ad69-ef653e7e4ee3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f75b48d-25') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c4:14:86"/><model type="virtio"/><mtu size="1442"/><target dev="tap3f75b48d-25"/></interface> {{(pid=71557) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c4:14:86"/><model type="virtio"/><mtu size="1442"/><target dev="tap3f75b48d-25"/></interface> {{(pid=71557) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Attempting to detach device tap3f75b48d-25 from instance f147b4ee-d130-41ae-a4db-bc248fb23266 from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] detach device xml: <interface type="ethernet">
Apr 12 10:38:10 user nova-compute[71557]:   <mac address="fa:16:3e:c4:14:86"/>
Apr 12 10:38:10 user nova-compute[71557]:   <model type="virtio"/>
Apr 12 10:38:10 user nova-compute[71557]:   <mtu size="1442"/>
Apr 12 10:38:10 user nova-compute[71557]:   <target dev="tap3f75b48d-25"/>
Apr 12 10:38:10 user nova-compute[71557]: </interface>
Apr 12 10:38:10 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c4:14:86"/><model type="virtio"/><mtu size="1442"/><target dev="tap3f75b48d-25"/></interface> {{(pid=71557) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c4:14:86"/><model type="virtio"/><mtu size="1442"/><target dev="tap3f75b48d-25"/></interface>not found in domain: <domain type='kvm' id='10'>
Apr 12 10:38:10 user nova-compute[71557]:   <name>instance-0000000a</name>
Apr 12 10:38:10 user nova-compute[71557]:   <uuid>f147b4ee-d130-41ae-a4db-bc248fb23266</uuid>
Apr 12 10:38:10 user nova-compute[71557]:   <metadata>
Apr 12 10:38:10 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:38:10 user nova-compute[71557]:   <nova:package version="0.0.0"/>
Apr 12 10:38:10 user nova-compute[71557]:   <nova:name>tempest-device-tagging-server-973136543</nova:name>
Apr 12 10:38:10 user nova-compute[71557]:   <nova:creationTime>2023-04-12 10:37:56</nova:creationTime>
Apr 12 10:38:10 user nova-compute[71557]:   <nova:flavor name="m1.nano">
Apr 12 10:38:10 user nova-compute[71557]:     <nova:memory>128</nova:memory>
Apr 12 10:38:10 user nova-compute[71557]:     <nova:disk>1</nova:disk>
Apr 12 10:38:10 user nova-compute[71557]:     <nova:swap>0</nova:swap>
Apr 12 10:38:10 user nova-compute[71557]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:38:10 user nova-compute[71557]:     <nova:vcpus>1</nova:vcpus>
Apr 12 10:38:10 user nova-compute[71557]:   </nova:flavor>
Apr 12 10:38:10 user nova-compute[71557]:   <nova:owner>
Apr 12 10:38:10 user nova-compute[71557]:     <nova:user uuid="254d3560065c4d8a8aaf312870be2967">tempest-TaggedAttachmentsTest-2008645939-project-member</nova:user>
Apr 12 10:38:10 user nova-compute[71557]:     <nova:project uuid="6981486a29b64ee7b9ef7cbf2ca852be">tempest-TaggedAttachmentsTest-2008645939</nova:project>
Apr 12 10:38:10 user nova-compute[71557]:   </nova:owner>
Apr 12 10:38:10 user nova-compute[71557]:   <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:38:10 user nova-compute[71557]:   <nova:ports>
Apr 12 10:38:10 user nova-compute[71557]:     <nova:port uuid="96998164-acd9-4a18-b230-d63787eaf154">
Apr 12 10:38:10 user nova-compute[71557]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 10:38:10 user nova-compute[71557]:     </nova:port>
Apr 12 10:38:10 user nova-compute[71557]:     <nova:port uuid="3f75b48d-25ad-47ff-ab8a-ee743607793a">
Apr 12 10:38:10 user nova-compute[71557]:       <nova:ip type="fixed" address="10.10.10.233" ipVersion="4"/>
Apr 12 10:38:10 user nova-compute[71557]:     </nova:port>
Apr 12 10:38:10 user nova-compute[71557]:   </nova:ports>
Apr 12 10:38:10 user nova-compute[71557]: </nova:instance>
Apr 12 10:38:10 user nova-compute[71557]:   </metadata>
Apr 12 10:38:10 user nova-compute[71557]:   <memory unit='KiB'>131072</memory>
Apr 12 10:38:10 user nova-compute[71557]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 10:38:10 user nova-compute[71557]:   <vcpu placement='static'>1</vcpu>
Apr 12 10:38:10 user nova-compute[71557]:   <resource>
Apr 12 10:38:10 user nova-compute[71557]:     <partition>/machine</partition>
Apr 12 10:38:10 user nova-compute[71557]:   </resource>
Apr 12 10:38:10 user nova-compute[71557]:   <sysinfo type='smbios'>
Apr 12 10:38:10 user nova-compute[71557]:     <system>
Apr 12 10:38:10 user nova-compute[71557]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 10:38:10 user nova-compute[71557]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 10:38:10 user nova-compute[71557]:       <entry name='version'>0.0.0</entry>
Apr 12 10:38:10 user nova-compute[71557]:       <entry name='serial'>f147b4ee-d130-41ae-a4db-bc248fb23266</entry>
Apr 12 10:38:10 user nova-compute[71557]:       <entry name='uuid'>f147b4ee-d130-41ae-a4db-bc248fb23266</entry>
Apr 12 10:38:10 user nova-compute[71557]:       <entry name='family'>Virtual Machine</entry>
Apr 12 10:38:10 user nova-compute[71557]:     </system>
Apr 12 10:38:10 user nova-compute[71557]:   </sysinfo>
Apr 12 10:38:10 user nova-compute[71557]:   <os>
Apr 12 10:38:10 user nova-compute[71557]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 10:38:10 user nova-compute[71557]:     <boot dev='hd'/>
Apr 12 10:38:10 user nova-compute[71557]:     <smbios mode='sysinfo'/>
Apr 12 10:38:10 user nova-compute[71557]:   </os>
Apr 12 10:38:10 user nova-compute[71557]:   <features>
Apr 12 10:38:10 user nova-compute[71557]:     <acpi/>
Apr 12 10:38:10 user nova-compute[71557]:     <apic/>
Apr 12 10:38:10 user nova-compute[71557]:     <vmcoreinfo state='on'/>
Apr 12 10:38:10 user nova-compute[71557]:   </features>
Apr 12 10:38:10 user nova-compute[71557]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 10:38:10 user nova-compute[71557]:     <model fallback='forbid'>Nehalem</model>
Apr 12 10:38:10 user nova-compute[71557]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 10:38:10 user nova-compute[71557]:     <feature policy='require' name='vme'/>
Apr 12 10:38:10 user nova-compute[71557]:     <feature policy='require' name='x2apic'/>
Apr 12 10:38:10 user nova-compute[71557]:     <feature policy='require' name='hypervisor'/>
Apr 12 10:38:10 user nova-compute[71557]:   </cpu>
Apr 12 10:38:10 user nova-compute[71557]:   <clock offset='utc'>
Apr 12 10:38:10 user nova-compute[71557]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 10:38:10 user nova-compute[71557]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 10:38:10 user nova-compute[71557]:     <timer name='hpet' present='no'/>
Apr 12 10:38:10 user nova-compute[71557]:   </clock>
Apr 12 10:38:10 user nova-compute[71557]:   <on_poweroff>destroy</on_poweroff>
Apr 12 10:38:10 user nova-compute[71557]:   <on_reboot>restart</on_reboot>
Apr 12 10:38:10 user nova-compute[71557]:   <on_crash>destroy</on_crash>
Apr 12 10:38:10 user nova-compute[71557]:   <devices>
Apr 12 10:38:10 user nova-compute[71557]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 10:38:10 user nova-compute[71557]:     <disk type='file' device='disk'>
Apr 12 10:38:10 user nova-compute[71557]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 10:38:10 user nova-compute[71557]:       <source file='/opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk' index='2'/>
Apr 12 10:38:10 user nova-compute[71557]:       <backingStore type='file' index='3'>
Apr 12 10:38:10 user nova-compute[71557]:         <format type='raw'/>
Apr 12 10:38:10 user nova-compute[71557]:         <source file='/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c'/>
Apr 12 10:38:10 user nova-compute[71557]:         <backingStore/>
Apr 12 10:38:10 user nova-compute[71557]:       </backingStore>
Apr 12 10:38:10 user nova-compute[71557]:       <target dev='vda' bus='virtio'/>
Apr 12 10:38:10 user nova-compute[71557]:       <alias name='virtio-disk0'/>
Apr 12 10:38:10 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 10:38:10 user nova-compute[71557]:     </disk>
Apr 12 10:38:10 user nova-compute[71557]:     <disk type='file' device='cdrom'>
Apr 12 10:38:10 user nova-compute[71557]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 10:38:10 user nova-compute[71557]:       <source file='/opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk.config' index='1'/>
Apr 12 10:38:10 user nova-compute[71557]:       <backingStore/>
Apr 12 10:38:10 user nova-compute[71557]:       <target dev='hda' bus='ide'/>
Apr 12 10:38:10 user nova-compute[71557]:       <readonly/>
Apr 12 10:38:10 user nova-compute[71557]:       <alias name='ide0-0-0'/>
Apr 12 10:38:10 user nova-compute[71557]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 10:38:10 user nova-compute[71557]:     </disk>
Apr 12 10:38:10 user nova-compute[71557]:     <controller type='usb' index='0' model='none'>
Apr 12 10:38:10 user nova-compute[71557]:       <alias name='usb'/>
Apr 12 10:38:10 user nova-compute[71557]:     </controller>
Apr 12 10:38:10 user nova-compute[71557]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 10:38:10 user nova-compute[71557]:       <alias name='pci.0'/>
Apr 12 10:38:10 user nova-compute[71557]:     </controller>
Apr 12 10:38:10 user nova-compute[71557]:     <controller type='ide' index='0'>
Apr 12 10:38:10 user nova-compute[71557]:       <alias name='ide'/>
Apr 12 10:38:10 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 10:38:10 user nova-compute[71557]:     </controller>
Apr 12 10:38:10 user nova-compute[71557]:     <interface type='ethernet'>
Apr 12 10:38:10 user nova-compute[71557]:       <mac address='fa:16:3e:2e:44:60'/>
Apr 12 10:38:10 user nova-compute[71557]:       <target dev='tap96998164-ac'/>
Apr 12 10:38:10 user nova-compute[71557]:       <model type='virtio'/>
Apr 12 10:38:10 user nova-compute[71557]:       <mtu size='1442'/>
Apr 12 10:38:10 user nova-compute[71557]:       <alias name='net0'/>
Apr 12 10:38:10 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 10:38:10 user nova-compute[71557]:     </interface>
Apr 12 10:38:10 user nova-compute[71557]:     <interface type='ethernet'>
Apr 12 10:38:10 user nova-compute[71557]:       <mac address='fa:16:3e:c4:14:86'/>
Apr 12 10:38:10 user nova-compute[71557]:       <target dev='tap3f75b48d-25'/>
Apr 12 10:38:10 user nova-compute[71557]:       <model type='virtio'/>
Apr 12 10:38:10 user nova-compute[71557]:       <mtu size='1442'/>
Apr 12 10:38:10 user nova-compute[71557]:       <alias name='net1'/>
Apr 12 10:38:10 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 12 10:38:10 user nova-compute[71557]:     </interface>
Apr 12 10:38:10 user nova-compute[71557]:     <serial type='pty'>
Apr 12 10:38:10 user nova-compute[71557]:       <source path='/dev/pts/9'/>
Apr 12 10:38:10 user nova-compute[71557]:       <log file='/opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/console.log' append='off'/>
Apr 12 10:38:10 user nova-compute[71557]:       <target type='isa-serial' port='0'>
Apr 12 10:38:10 user nova-compute[71557]:         <model name='isa-serial'/>
Apr 12 10:38:10 user nova-compute[71557]:       </target>
Apr 12 10:38:10 user nova-compute[71557]:       <alias name='serial0'/>
Apr 12 10:38:10 user nova-compute[71557]:     </serial>
Apr 12 10:38:10 user nova-compute[71557]:     <console type='pty' tty='/dev/pts/9'>
Apr 12 10:38:10 user nova-compute[71557]:       <source path='/dev/pts/9'/>
Apr 12 10:38:10 user nova-compute[71557]:       <log file='/opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/console.log' append='off'/>
Apr 12 10:38:10 user nova-compute[71557]:       <target type='serial' port='0'/>
Apr 12 10:38:10 user nova-compute[71557]:       <alias name='serial0'/>
Apr 12 10:38:10 user nova-compute[71557]:     </console>
Apr 12 10:38:10 user nova-compute[71557]:     <input type='mouse' bus='ps2'>
Apr 12 10:38:10 user nova-compute[71557]:       <alias name='input0'/>
Apr 12 10:38:10 user nova-compute[71557]:     </input>
Apr 12 10:38:10 user nova-compute[71557]:     <input type='keyboard' bus='ps2'>
Apr 12 10:38:10 user nova-compute[71557]:       <alias name='input1'/>
Apr 12 10:38:10 user nova-compute[71557]:     </input>
Apr 12 10:38:10 user nova-compute[71557]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Apr 12 10:38:10 user nova-compute[71557]:       <listen type='address' address='0.0.0.0'/>
Apr 12 10:38:10 user nova-compute[71557]:     </graphics>
Apr 12 10:38:10 user nova-compute[71557]:     <audio id='1' type='none'/>
Apr 12 10:38:10 user nova-compute[71557]:     <video>
Apr 12 10:38:10 user nova-compute[71557]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 10:38:10 user nova-compute[71557]:       <alias name='video0'/>
Apr 12 10:38:10 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 10:38:10 user nova-compute[71557]:     </video>
Apr 12 10:38:10 user nova-compute[71557]:     <memballoon model='virtio'>
Apr 12 10:38:10 user nova-compute[71557]:       <stats period='10'/>
Apr 12 10:38:10 user nova-compute[71557]:       <alias name='balloon0'/>
Apr 12 10:38:10 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 10:38:10 user nova-compute[71557]:     </memballoon>
Apr 12 10:38:10 user nova-compute[71557]:     <rng model='virtio'>
Apr 12 10:38:10 user nova-compute[71557]:       <backend model='random'>/dev/urandom</backend>
Apr 12 10:38:10 user nova-compute[71557]:       <alias name='rng0'/>
Apr 12 10:38:10 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 10:38:10 user nova-compute[71557]:     </rng>
Apr 12 10:38:10 user nova-compute[71557]:   </devices>
Apr 12 10:38:10 user nova-compute[71557]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 10:38:10 user nova-compute[71557]:     <label>libvirt-f147b4ee-d130-41ae-a4db-bc248fb23266</label>
Apr 12 10:38:10 user nova-compute[71557]:     <imagelabel>libvirt-f147b4ee-d130-41ae-a4db-bc248fb23266</imagelabel>
Apr 12 10:38:10 user nova-compute[71557]:   </seclabel>
Apr 12 10:38:10 user nova-compute[71557]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 10:38:10 user nova-compute[71557]:     <label>+64055:+108</label>
Apr 12 10:38:10 user nova-compute[71557]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 10:38:10 user nova-compute[71557]:   </seclabel>
Apr 12 10:38:10 user nova-compute[71557]: </domain>
Apr 12 10:38:10 user nova-compute[71557]:  {{(pid=71557) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 10:38:10 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Successfully detached device tap3f75b48d-25 from instance f147b4ee-d130-41ae-a4db-bc248fb23266 from the persistent domain config.
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] (1/8): Attempting to detach device tap3f75b48d-25 with device alias net1 from instance f147b4ee-d130-41ae-a4db-bc248fb23266 from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] detach device xml: <interface type="ethernet">
Apr 12 10:38:10 user nova-compute[71557]:   <mac address="fa:16:3e:c4:14:86"/>
Apr 12 10:38:10 user nova-compute[71557]:   <model type="virtio"/>
Apr 12 10:38:10 user nova-compute[71557]:   <mtu size="1442"/>
Apr 12 10:38:10 user nova-compute[71557]:   <target dev="tap3f75b48d-25"/>
Apr 12 10:38:10 user nova-compute[71557]: </interface>
Apr 12 10:38:10 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.network.neutron [req-c3ad85f9-36d9-46be-a477-81ead2fceeec req-c4b9ef76-1b39-4d60-8980-bdf0b1fa595c service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Updated VIF entry in instance network info cache for port fe31a29c-b57d-463d-98ba-6527848edeba. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG nova.network.neutron [req-c3ad85f9-36d9-46be-a477-81ead2fceeec req-c4b9ef76-1b39-4d60-8980-bdf0b1fa595c service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Updating instance_info_cache with network_info: [{"id": "fe31a29c-b57d-463d-98ba-6527848edeba", "address": "fa:16:3e:04:9a:84", "network": {"id": "487a3034-5a63-4896-a029-be581b719991", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-754944090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe31a29c-b5", "ovs_interfaceid": "fe31a29c-b57d-463d-98ba-6527848edeba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "address": "fa:16:3e:7f:41:2c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e2f100-f6", "ovs_interfaceid": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "address": "fa:16:3e:b0:8e:21", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307fee9a-af", "ovs_interfaceid": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1173b214-caa3-4d2b-9ee4-efe4ab063cac", "address": "fa:16:3e:c3:05:a8", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1173b214-ca", "ovs_interfaceid": "1173b214-caa3-4d2b-9ee4-efe4ab063cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "925f7823-924b-4df5-8bec-5f065331e4fe", "address": "fa:16:3e:41:4d:9c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap925f7823-92", "ovs_interfaceid": "925f7823-924b-4df5-8bec-5f065331e4fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23c5dfaa-4003-410d-836e-4218b879cf66", "address": "fa:16:3e:49:60:f7", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c5dfaa-40", "ovs_interfaceid": "23c5dfaa-4003-410d-836e-4218b879cf66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "address": "fa:16:3e:d3:ce:bd", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap718755e4-0a", "ovs_interfaceid": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:38:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c3ad85f9-36d9-46be-a477-81ead2fceeec req-c4b9ef76-1b39-4d60-8980-bdf0b1fa595c service nova] Releasing lock "refresh_cache-b9fd76e3-c7ed-4631-b056-3bd13439f7d3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.network.neutron [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Updating instance_info_cache with network_info: [{"id": "5eed0079-0c02-43b0-8124-4ef257a7eb1f", "address": "fa:16:3e:39:2a:b8", "network": {"id": "a5611852-639c-4e1f-8dbc-cc88bc5651d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1575956045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "16de154a6d344b18a939c6a1b1a679f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eed0079-0c", "ovs_interfaceid": "5eed0079-0c02-43b0-8124-4ef257a7eb1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Releasing lock "refresh_cache-a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Instance network_info: |[{"id": "5eed0079-0c02-43b0-8124-4ef257a7eb1f", "address": "fa:16:3e:39:2a:b8", "network": {"id": "a5611852-639c-4e1f-8dbc-cc88bc5651d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1575956045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "16de154a6d344b18a939c6a1b1a679f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eed0079-0c", "ovs_interfaceid": "5eed0079-0c02-43b0-8124-4ef257a7eb1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-043d8c22-b5de-4f42-a22b-b3d6d79070a4 req-c9d4377a-51b8-4ff7-8b00-b48255c39ddf service nova] Acquired lock "refresh_cache-a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.network.neutron [req-043d8c22-b5de-4f42-a22b-b3d6d79070a4 req-c9d4377a-51b8-4ff7-8b00-b48255c39ddf service nova] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Refreshing network info cache for port 5eed0079-0c02-43b0-8124-4ef257a7eb1f {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Start _get_guest_xml network_info=[{"id": "5eed0079-0c02-43b0-8124-4ef257a7eb1f", "address": "fa:16:3e:39:2a:b8", "network": {"id": "a5611852-639c-4e1f-8dbc-cc88bc5651d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1575956045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "16de154a6d344b18a939c6a1b1a679f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eed0079-0c", "ovs_interfaceid": "5eed0079-0c02-43b0-8124-4ef257a7eb1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:38:11 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:38:11 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:38:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1220560850',display_name='tempest-VolumesSnapshotTestJSON-instance-1220560850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1220560850',id=13,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16de154a6d344b18a939c6a1b1a679f5',ramdisk_id='',reservation_id='r-600v1esk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-858479648',owner_user_name='tempest-VolumesSnapshotTestJSON-858479648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:38:09Z,user_data=None,user_id='2c97c57a3e7142d088e1cf315f5d8d72',uuid=a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5eed0079-0c02-43b0-8124-4ef257a7eb1f", "address": "fa:16:3e:39:2a:b8", "network": {"id": "a5611852-639c-4e1f-8dbc-cc88bc5651d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1575956045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "16de154a6d344b18a939c6a1b1a679f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eed0079-0c", "ovs_interfaceid": "5eed0079-0c02-43b0-8124-4ef257a7eb1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Converting VIF {"id": "5eed0079-0c02-43b0-8124-4ef257a7eb1f", "address": "fa:16:3e:39:2a:b8", "network": {"id": "a5611852-639c-4e1f-8dbc-cc88bc5651d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1575956045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "16de154a6d344b18a939c6a1b1a679f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eed0079-0c", "ovs_interfaceid": "5eed0079-0c02-43b0-8124-4ef257a7eb1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:2a:b8,bridge_name='br-int',has_traffic_filtering=True,id=5eed0079-0c02-43b0-8124-4ef257a7eb1f,network=Network(a5611852-639c-4e1f-8dbc-cc88bc5651d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eed0079-0c') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.objects.instance [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lazy-loading 'pci_devices' on Instance uuid a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:38:11 user nova-compute[71557]:   <uuid>a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2</uuid>
Apr 12 10:38:11 user nova-compute[71557]:   <name>instance-0000000d</name>
Apr 12 10:38:11 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:38:11 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:38:11 user nova-compute[71557]:   <metadata>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:38:11 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:38:11 user nova-compute[71557]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1220560850</nova:name>
Apr 12 10:38:11 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:38:11</nova:creationTime>
Apr 12 10:38:11 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:38:11 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:38:11 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:38:11 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:38:11 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:38:11 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:38:11 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:38:11 user nova-compute[71557]:       <nova:owner>
Apr 12 10:38:11 user nova-compute[71557]:         <nova:user uuid="2c97c57a3e7142d088e1cf315f5d8d72">tempest-VolumesSnapshotTestJSON-858479648-project-member</nova:user>
Apr 12 10:38:11 user nova-compute[71557]:         <nova:project uuid="16de154a6d344b18a939c6a1b1a679f5">tempest-VolumesSnapshotTestJSON-858479648</nova:project>
Apr 12 10:38:11 user nova-compute[71557]:       </nova:owner>
Apr 12 10:38:11 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:38:11 user nova-compute[71557]:       <nova:ports>
Apr 12 10:38:11 user nova-compute[71557]:         <nova:port uuid="5eed0079-0c02-43b0-8124-4ef257a7eb1f">
Apr 12 10:38:11 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 10:38:11 user nova-compute[71557]:         </nova:port>
Apr 12 10:38:11 user nova-compute[71557]:       </nova:ports>
Apr 12 10:38:11 user nova-compute[71557]:     </nova:instance>
Apr 12 10:38:11 user nova-compute[71557]:   </metadata>
Apr 12 10:38:11 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:38:11 user nova-compute[71557]:     <system>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name="serial">a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2</entry>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name="uuid">a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2</entry>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:38:11 user nova-compute[71557]:     </system>
Apr 12 10:38:11 user nova-compute[71557]:   </sysinfo>
Apr 12 10:38:11 user nova-compute[71557]:   <os>
Apr 12 10:38:11 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:38:11 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:38:11 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:38:11 user nova-compute[71557]:   </os>
Apr 12 10:38:11 user nova-compute[71557]:   <features>
Apr 12 10:38:11 user nova-compute[71557]:     <acpi/>
Apr 12 10:38:11 user nova-compute[71557]:     <apic/>
Apr 12 10:38:11 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:38:11 user nova-compute[71557]:   </features>
Apr 12 10:38:11 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:38:11 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:38:11 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:38:11 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:38:11 user nova-compute[71557]:   </clock>
Apr 12 10:38:11 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:38:11 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:38:11 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:38:11 user nova-compute[71557]:   </cpu>
Apr 12 10:38:11 user nova-compute[71557]:   <devices>
Apr 12 10:38:11 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:38:11 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:38:11 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/disk"/>
Apr 12 10:38:11 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:38:11 user nova-compute[71557]:     </disk>
Apr 12 10:38:11 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:38:11 user nova-compute[71557]:       <mac address="fa:16:3e:39:2a:b8"/>
Apr 12 10:38:11 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:38:11 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:38:11 user nova-compute[71557]:       <target dev="tap5eed0079-0c"/>
Apr 12 10:38:11 user nova-compute[71557]:     </interface>
Apr 12 10:38:11 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:38:11 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/console.log" append="off"/>
Apr 12 10:38:11 user nova-compute[71557]:     </serial>
Apr 12 10:38:11 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:38:11 user nova-compute[71557]:     <video>
Apr 12 10:38:11 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:38:11 user nova-compute[71557]:     </video>
Apr 12 10:38:11 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:38:11 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:38:11 user nova-compute[71557]:     </rng>
Apr 12 10:38:11 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:38:11 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:38:11 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:38:11 user nova-compute[71557]:     </memballoon>
Apr 12 10:38:11 user nova-compute[71557]:   </devices>
Apr 12 10:38:11 user nova-compute[71557]: </domain>
Apr 12 10:38:11 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:38:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1220560850',display_name='tempest-VolumesSnapshotTestJSON-instance-1220560850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1220560850',id=13,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16de154a6d344b18a939c6a1b1a679f5',ramdisk_id='',reservation_id='r-600v1esk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-858479648',owner_user_name='tempest-VolumesSnapshotTestJSON-858479648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:38:09Z,user_data=None,user_id='2c97c57a3e7142d088e1cf315f5d8d72',uuid=a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5eed0079-0c02-43b0-8124-4ef257a7eb1f", "address": "fa:16:3e:39:2a:b8", "network": {"id": "a5611852-639c-4e1f-8dbc-cc88bc5651d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1575956045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "16de154a6d344b18a939c6a1b1a679f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eed0079-0c", "ovs_interfaceid": "5eed0079-0c02-43b0-8124-4ef257a7eb1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Converting VIF {"id": "5eed0079-0c02-43b0-8124-4ef257a7eb1f", "address": "fa:16:3e:39:2a:b8", "network": {"id": "a5611852-639c-4e1f-8dbc-cc88bc5651d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1575956045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "16de154a6d344b18a939c6a1b1a679f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eed0079-0c", "ovs_interfaceid": "5eed0079-0c02-43b0-8124-4ef257a7eb1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:2a:b8,bridge_name='br-int',has_traffic_filtering=True,id=5eed0079-0c02-43b0-8124-4ef257a7eb1f,network=Network(a5611852-639c-4e1f-8dbc-cc88bc5651d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eed0079-0c') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG os_vif [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:2a:b8,bridge_name='br-int',has_traffic_filtering=True,id=5eed0079-0c02-43b0-8124-4ef257a7eb1f,network=Network(a5611852-639c-4e1f-8dbc-cc88bc5651d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eed0079-0c') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681295891.1198902, f147b4ee-d130-41ae-a4db-bc248fb23266 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Start waiting for the detach event from libvirt for device tap3f75b48d-25 with device alias net1 for instance f147b4ee-d130-41ae-a4db-bc248fb23266 {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c4:14:86"/><model type="virtio"/><mtu size="1442"/><target dev="tap3f75b48d-25"/></interface> {{(pid=71557) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5eed0079-0c, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5eed0079-0c, col_values=(('external_ids', {'iface-id': '5eed0079-0c02-43b0-8124-4ef257a7eb1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:2a:b8', 'vm-uuid': 'a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c4:14:86"/><model type="virtio"/><mtu size="1442"/><target dev="tap3f75b48d-25"/></interface>not found in domain: <domain type='kvm' id='10'>
Apr 12 10:38:11 user nova-compute[71557]:   <name>instance-0000000a</name>
Apr 12 10:38:11 user nova-compute[71557]:   <uuid>f147b4ee-d130-41ae-a4db-bc248fb23266</uuid>
Apr 12 10:38:11 user nova-compute[71557]:   <metadata>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:38:11 user nova-compute[71557]:   <nova:package version="0.0.0"/>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:name>tempest-device-tagging-server-973136543</nova:name>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:creationTime>2023-04-12 10:37:56</nova:creationTime>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:flavor name="m1.nano">
Apr 12 10:38:11 user nova-compute[71557]:     <nova:memory>128</nova:memory>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:disk>1</nova:disk>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:swap>0</nova:swap>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:vcpus>1</nova:vcpus>
Apr 12 10:38:11 user nova-compute[71557]:   </nova:flavor>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:owner>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:user uuid="254d3560065c4d8a8aaf312870be2967">tempest-TaggedAttachmentsTest-2008645939-project-member</nova:user>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:project uuid="6981486a29b64ee7b9ef7cbf2ca852be">tempest-TaggedAttachmentsTest-2008645939</nova:project>
Apr 12 10:38:11 user nova-compute[71557]:   </nova:owner>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:ports>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:port uuid="96998164-acd9-4a18-b230-d63787eaf154">
Apr 12 10:38:11 user nova-compute[71557]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 10:38:11 user nova-compute[71557]:     </nova:port>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:port uuid="3f75b48d-25ad-47ff-ab8a-ee743607793a">
Apr 12 10:38:11 user nova-compute[71557]:       <nova:ip type="fixed" address="10.10.10.233" ipVersion="4"/>
Apr 12 10:38:11 user nova-compute[71557]:     </nova:port>
Apr 12 10:38:11 user nova-compute[71557]:   </nova:ports>
Apr 12 10:38:11 user nova-compute[71557]: </nova:instance>
Apr 12 10:38:11 user nova-compute[71557]:   </metadata>
Apr 12 10:38:11 user nova-compute[71557]:   <memory unit='KiB'>131072</memory>
Apr 12 10:38:11 user nova-compute[71557]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 10:38:11 user nova-compute[71557]:   <vcpu placement='static'>1</vcpu>
Apr 12 10:38:11 user nova-compute[71557]:   <resource>
Apr 12 10:38:11 user nova-compute[71557]:     <partition>/machine</partition>
Apr 12 10:38:11 user nova-compute[71557]:   </resource>
Apr 12 10:38:11 user nova-compute[71557]:   <sysinfo type='smbios'>
Apr 12 10:38:11 user nova-compute[71557]:     <system>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name='version'>0.0.0</entry>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name='serial'>f147b4ee-d130-41ae-a4db-bc248fb23266</entry>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name='uuid'>f147b4ee-d130-41ae-a4db-bc248fb23266</entry>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name='family'>Virtual Machine</entry>
Apr 12 10:38:11 user nova-compute[71557]:     </system>
Apr 12 10:38:11 user nova-compute[71557]:   </sysinfo>
Apr 12 10:38:11 user nova-compute[71557]:   <os>
Apr 12 10:38:11 user nova-compute[71557]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 10:38:11 user nova-compute[71557]:     <boot dev='hd'/>
Apr 12 10:38:11 user nova-compute[71557]:     <smbios mode='sysinfo'/>
Apr 12 10:38:11 user nova-compute[71557]:   </os>
Apr 12 10:38:11 user nova-compute[71557]:   <features>
Apr 12 10:38:11 user nova-compute[71557]:     <acpi/>
Apr 12 10:38:11 user nova-compute[71557]:     <apic/>
Apr 12 10:38:11 user nova-compute[71557]:     <vmcoreinfo state='on'/>
Apr 12 10:38:11 user nova-compute[71557]:   </features>
Apr 12 10:38:11 user nova-compute[71557]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 10:38:11 user nova-compute[71557]:     <model fallback='forbid'>Nehalem</model>
Apr 12 10:38:11 user nova-compute[71557]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 10:38:11 user nova-compute[71557]:     <feature policy='require' name='vme'/>
Apr 12 10:38:11 user nova-compute[71557]:     <feature policy='require' name='x2apic'/>
Apr 12 10:38:11 user nova-compute[71557]:     <feature policy='require' name='hypervisor'/>
Apr 12 10:38:11 user nova-compute[71557]:   </cpu>
Apr 12 10:38:11 user nova-compute[71557]:   <clock offset='utc'>
Apr 12 10:38:11 user nova-compute[71557]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 10:38:11 user nova-compute[71557]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 10:38:11 user nova-compute[71557]:     <timer name='hpet' present='no'/>
Apr 12 10:38:11 user nova-compute[71557]:   </clock>
Apr 12 10:38:11 user nova-compute[71557]:   <on_poweroff>destroy</on_poweroff>
Apr 12 10:38:11 user nova-compute[71557]:   <on_reboot>restart</on_reboot>
Apr 12 10:38:11 user nova-compute[71557]:   <on_crash>destroy</on_crash>
Apr 12 10:38:11 user nova-compute[71557]:   <devices>
Apr 12 10:38:11 user nova-compute[71557]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 10:38:11 user nova-compute[71557]:     <disk type='file' device='disk'>
Apr 12 10:38:11 user nova-compute[71557]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 10:38:11 user nova-compute[71557]:       <source file='/opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk' index='2'/>
Apr 12 10:38:11 user nova-compute[71557]:       <backingStore type='file' index='3'>
Apr 12 10:38:11 user nova-compute[71557]:         <format type='raw'/>
Apr 12 10:38:11 user nova-compute[71557]:         <source file='/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c'/>
Apr 12 10:38:11 user nova-compute[71557]:         <backingStore/>
Apr 12 10:38:11 user nova-compute[71557]:       </backingStore>
Apr 12 10:38:11 user nova-compute[71557]:       <target dev='vda' bus='virtio'/>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='virtio-disk0'/>
Apr 12 10:38:11 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </disk>
Apr 12 10:38:11 user nova-compute[71557]:     <disk type='file' device='cdrom'>
Apr 12 10:38:11 user nova-compute[71557]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 10:38:11 user nova-compute[71557]:       <source file='/opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk.config' index='1'/>
Apr 12 10:38:11 user nova-compute[71557]:       <backingStore/>
Apr 12 10:38:11 user nova-compute[71557]:       <target dev='hda' bus='ide'/>
Apr 12 10:38:11 user nova-compute[71557]:       <readonly/>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='ide0-0-0'/>
Apr 12 10:38:11 user nova-compute[71557]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </disk>
Apr 12 10:38:11 user nova-compute[71557]:     <controller type='usb' index='0' model='none'>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='usb'/>
Apr 12 10:38:11 user nova-compute[71557]:     </controller>
Apr 12 10:38:11 user nova-compute[71557]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='pci.0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </controller>
Apr 12 10:38:11 user nova-compute[71557]:     <controller type='ide' index='0'>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='ide'/>
Apr 12 10:38:11 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 10:38:11 user nova-compute[71557]:     </controller>
Apr 12 10:38:11 user nova-compute[71557]:     <interface type='ethernet'>
Apr 12 10:38:11 user nova-compute[71557]:       <mac address='fa:16:3e:2e:44:60'/>
Apr 12 10:38:11 user nova-compute[71557]:       <target dev='tap96998164-ac'/>
Apr 12 10:38:11 user nova-compute[71557]:       <model type='virtio'/>
Apr 12 10:38:11 user nova-compute[71557]:       <mtu size='1442'/>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='net0'/>
Apr 12 10:38:11 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </interface>
Apr 12 10:38:11 user nova-compute[71557]:     <serial type='pty'>
Apr 12 10:38:11 user nova-compute[71557]:       <source path='/dev/pts/9'/>
Apr 12 10:38:11 user nova-compute[71557]:       <log file='/opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/console.log' append='off'/>
Apr 12 10:38:11 user nova-compute[71557]:       <target type='isa-serial' port='0'>
Apr 12 10:38:11 user nova-compute[71557]:         <model name='isa-serial'/>
Apr 12 10:38:11 user nova-compute[71557]:       </target>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='serial0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </serial>
Apr 12 10:38:11 user nova-compute[71557]:     <console type='pty' tty='/dev/pts/9'>
Apr 12 10:38:11 user nova-compute[71557]:       <source path='/dev/pts/9'/>
Apr 12 10:38:11 user nova-compute[71557]:       <log file='/opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/console.log' append='off'/>
Apr 12 10:38:11 user nova-compute[71557]:       <target type='serial' port='0'/>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='serial0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </console>
Apr 12 10:38:11 user nova-compute[71557]:     <input type='mouse' bus='ps2'>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='input0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </input>
Apr 12 10:38:11 user nova-compute[71557]:     <input type='keyboard' bus='ps2'>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='input1'/>
Apr 12 10:38:11 user nova-compute[71557]:     </input>
Apr 12 10:38:11 user nova-compute[71557]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Apr 12 10:38:11 user nova-compute[71557]:       <listen type='address' address='0.0.0.0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </graphics>
Apr 12 10:38:11 user nova-compute[71557]:     <audio id='1' type='none'/>
Apr 12 10:38:11 user nova-compute[71557]:     <video>
Apr 12 10:38:11 user nova-compute[71557]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='video0'/>
Apr 12 10:38:11 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </video>
Apr 12 10:38:11 user nova-compute[71557]:     <memballoon model='virtio'>
Apr 12 10:38:11 user nova-compute[71557]:       <stats period='10'/>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='balloon0'/>
Apr 12 10:38:11 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </memballoon>
Apr 12 10:38:11 user nova-compute[71557]:     <rng model='virtio'>
Apr 12 10:38:11 user nova-compute[71557]:       <backend model='random'>/dev/urandom</backend>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='rng0'/>
Apr 12 10:38:11 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </rng>
Apr 12 10:38:11 user nova-compute[71557]:   </devices>
Apr 12 10:38:11 user nova-compute[71557]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 10:38:11 user nova-compute[71557]:     <label>libvirt-f147b4ee-d130-41ae-a4db-bc248fb23266</label>
Apr 12 10:38:11 user nova-compute[71557]:     <imagelabel>libvirt-f147b4ee-d130-41ae-a4db-bc248fb23266</imagelabel>
Apr 12 10:38:11 user nova-compute[71557]:   </seclabel>
Apr 12 10:38:11 user nova-compute[71557]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 10:38:11 user nova-compute[71557]:     <label>+64055:+108</label>
Apr 12 10:38:11 user nova-compute[71557]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 10:38:11 user nova-compute[71557]:   </seclabel>
Apr 12 10:38:11 user nova-compute[71557]: </domain>
Apr 12 10:38:11 user nova-compute[71557]:  {{(pid=71557) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 10:38:11 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Successfully detached device tap3f75b48d-25 from instance f147b4ee-d130-41ae-a4db-bc248fb23266 from the live domain config.
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973136543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-973136543',id=10,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdimvfCdLuB4VkmLV8sKAN/mnwsyMwY8NOOti+AyTKIr7DOlGneUneWZujzSPReHJ3Bkx1IiksPqGfbsqao0C74w5qd657VSCv5dx2mJ7By8lLfjmYEB3fpEh2Gj0rqkQ==',key_name='tempest-keypair-1041772862',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:36:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6981486a29b64ee7b9ef7cbf2ca852be',ramdisk_id='',reservation_id='r-c2o3o5pa',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2008645939',owner_user_name='tempest-TaggedAttachmentsTest-2008645939-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='254d3560065c4d8a8aaf312870be2967',uuid=f147b4ee-d130-41ae-a4db-bc248fb23266,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "address": "fa:16:3e:c4:14:86", "network": {"id": "8eeeb207-87de-47b4-ad69-ef653e7e4ee3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-998224895", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f75b48d-25", "ovs_interfaceid": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Converting VIF {"id": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "address": "fa:16:3e:c4:14:86", "network": {"id": "8eeeb207-87de-47b4-ad69-ef653e7e4ee3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-998224895", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f75b48d-25", "ovs_interfaceid": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:86,bridge_name='br-int',has_traffic_filtering=True,id=3f75b48d-25ad-47ff-ab8a-ee743607793a,network=Network(8eeeb207-87de-47b4-ad69-ef653e7e4ee3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f75b48d-25') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG os_vif [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:86,bridge_name='br-int',has_traffic_filtering=True,id=3f75b48d-25ad-47ff-ab8a-ee743607793a,network=Network(8eeeb207-87de-47b4-ad69-ef653e7e4ee3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f75b48d-25') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:11 user nova-compute[71557]: INFO os_vif [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:2a:b8,bridge_name='br-int',has_traffic_filtering=True,id=5eed0079-0c02-43b0-8124-4ef257a7eb1f,network=Network(a5611852-639c-4e1f-8dbc-cc88bc5651d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eed0079-0c')
Apr 12 10:38:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f75b48d-25, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:11 user nova-compute[71557]: INFO os_vif [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:86,bridge_name='br-int',has_traffic_filtering=True,id=3f75b48d-25ad-47ff-ab8a-ee743607793a,network=Network(8eeeb207-87de-47b4-ad69-ef653e7e4ee3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f75b48d-25')
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:38:11 user nova-compute[71557]:   <nova:package version="0.0.0"/>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:name>tempest-device-tagging-server-973136543</nova:name>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:creationTime>2023-04-12 10:38:11</nova:creationTime>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:flavor name="m1.nano">
Apr 12 10:38:11 user nova-compute[71557]:     <nova:memory>128</nova:memory>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:disk>1</nova:disk>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:swap>0</nova:swap>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:vcpus>1</nova:vcpus>
Apr 12 10:38:11 user nova-compute[71557]:   </nova:flavor>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:owner>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:user uuid="254d3560065c4d8a8aaf312870be2967">tempest-TaggedAttachmentsTest-2008645939-project-member</nova:user>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:project uuid="6981486a29b64ee7b9ef7cbf2ca852be">tempest-TaggedAttachmentsTest-2008645939</nova:project>
Apr 12 10:38:11 user nova-compute[71557]:   </nova:owner>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:ports>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:port uuid="96998164-acd9-4a18-b230-d63787eaf154">
Apr 12 10:38:11 user nova-compute[71557]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 10:38:11 user nova-compute[71557]:     </nova:port>
Apr 12 10:38:11 user nova-compute[71557]:   </nova:ports>
Apr 12 10:38:11 user nova-compute[71557]: </nova:instance>
Apr 12 10:38:11 user nova-compute[71557]:  {{(pid=71557) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] No VIF found with MAC fa:16:3e:39:2a:b8, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.network.neutron [req-043d8c22-b5de-4f42-a22b-b3d6d79070a4 req-c9d4377a-51b8-4ff7-8b00-b48255c39ddf service nova] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Updated VIF entry in instance network info cache for port 5eed0079-0c02-43b0-8124-4ef257a7eb1f. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.network.neutron [req-043d8c22-b5de-4f42-a22b-b3d6d79070a4 req-c9d4377a-51b8-4ff7-8b00-b48255c39ddf service nova] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Updating instance_info_cache with network_info: [{"id": "5eed0079-0c02-43b0-8124-4ef257a7eb1f", "address": "fa:16:3e:39:2a:b8", "network": {"id": "a5611852-639c-4e1f-8dbc-cc88bc5651d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1575956045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "16de154a6d344b18a939c6a1b1a679f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eed0079-0c", "ovs_interfaceid": "5eed0079-0c02-43b0-8124-4ef257a7eb1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-043d8c22-b5de-4f42-a22b-b3d6d79070a4 req-c9d4377a-51b8-4ff7-8b00-b48255c39ddf service nova] Releasing lock "refresh_cache-a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.compute.manager [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Received event network-vif-deleted-3f75b48d-25ad-47ff-ab8a-ee743607793a {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:11 user nova-compute[71557]: INFO nova.compute.manager [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Neutron deleted interface 3f75b48d-25ad-47ff-ab8a-ee743607793a; detaching it from the instance and deleting it from the info cache
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.network.neutron [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Updating instance_info_cache with network_info: [{"id": "96998164-acd9-4a18-b230-d63787eaf154", "address": "fa:16:3e:2e:44:60", "network": {"id": "4f4a6f13-7642-4157-ba75-be13336c456e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-673330570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96998164-ac", "ovs_interfaceid": "96998164-acd9-4a18-b230-d63787eaf154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "refresh_cache-f147b4ee-d130-41ae-a4db-bc248fb23266" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquired lock "refresh_cache-f147b4ee-d130-41ae-a4db-bc248fb23266" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.network.neutron [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.objects.instance [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] Lazy-loading 'system_metadata' on Instance uuid f147b4ee-d130-41ae-a4db-bc248fb23266 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.objects.instance [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] Lazy-loading 'flavor' on Instance uuid f147b4ee-d130-41ae-a4db-bc248fb23266 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:11 user nova-compute[71557]: INFO nova.compute.manager [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Terminating instance
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.compute.manager [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973136543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-973136543',id=10,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdimvfCdLuB4VkmLV8sKAN/mnwsyMwY8NOOti+AyTKIr7DOlGneUneWZujzSPReHJ3Bkx1IiksPqGfbsqao0C74w5qd657VSCv5dx2mJ7By8lLfjmYEB3fpEh2Gj0rqkQ==',key_name='tempest-keypair-1041772862',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:36:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6981486a29b64ee7b9ef7cbf2ca852be',ramdisk_id='',reservation_id='r-c2o3o5pa',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2008645939',owner_user_name='tempest-TaggedAttachmentsTest-2008645939-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='254d3560065c4d8a8aaf312870be2967',uuid=f147b4ee-d130-41ae-a4db-bc248fb23266,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "address": "fa:16:3e:c4:14:86", "network": {"id": "8eeeb207-87de-47b4-ad69-ef653e7e4ee3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-998224895", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f75b48d-25", "ovs_interfaceid": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.network.os_vif_util [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] Converting VIF {"id": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "address": "fa:16:3e:c4:14:86", "network": {"id": "8eeeb207-87de-47b4-ad69-ef653e7e4ee3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-998224895", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f75b48d-25", "ovs_interfaceid": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.network.os_vif_util [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:86,bridge_name='br-int',has_traffic_filtering=True,id=3f75b48d-25ad-47ff-ab8a-ee743607793a,network=Network(8eeeb207-87de-47b4-ad69-ef653e7e4ee3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f75b48d-25') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c4:14:86"/><model type="virtio"/><mtu size="1442"/><target dev="tap3f75b48d-25"/></interface> {{(pid=71557) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c4:14:86"/><model type="virtio"/><mtu size="1442"/><target dev="tap3f75b48d-25"/></interface>not found in domain: <domain type='kvm' id='10'>
Apr 12 10:38:11 user nova-compute[71557]:   <name>instance-0000000a</name>
Apr 12 10:38:11 user nova-compute[71557]:   <uuid>f147b4ee-d130-41ae-a4db-bc248fb23266</uuid>
Apr 12 10:38:11 user nova-compute[71557]:   <metadata>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:38:11 user nova-compute[71557]:   <nova:package version="0.0.0"/>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:name>tempest-device-tagging-server-973136543</nova:name>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:creationTime>2023-04-12 10:38:11</nova:creationTime>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:flavor name="m1.nano">
Apr 12 10:38:11 user nova-compute[71557]:     <nova:memory>128</nova:memory>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:disk>1</nova:disk>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:swap>0</nova:swap>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:vcpus>1</nova:vcpus>
Apr 12 10:38:11 user nova-compute[71557]:   </nova:flavor>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:owner>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:user uuid="254d3560065c4d8a8aaf312870be2967">tempest-TaggedAttachmentsTest-2008645939-project-member</nova:user>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:project uuid="6981486a29b64ee7b9ef7cbf2ca852be">tempest-TaggedAttachmentsTest-2008645939</nova:project>
Apr 12 10:38:11 user nova-compute[71557]:   </nova:owner>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:ports>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:port uuid="96998164-acd9-4a18-b230-d63787eaf154">
Apr 12 10:38:11 user nova-compute[71557]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 10:38:11 user nova-compute[71557]:     </nova:port>
Apr 12 10:38:11 user nova-compute[71557]:   </nova:ports>
Apr 12 10:38:11 user nova-compute[71557]: </nova:instance>
Apr 12 10:38:11 user nova-compute[71557]:   </metadata>
Apr 12 10:38:11 user nova-compute[71557]:   <memory unit='KiB'>131072</memory>
Apr 12 10:38:11 user nova-compute[71557]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 10:38:11 user nova-compute[71557]:   <vcpu placement='static'>1</vcpu>
Apr 12 10:38:11 user nova-compute[71557]:   <resource>
Apr 12 10:38:11 user nova-compute[71557]:     <partition>/machine</partition>
Apr 12 10:38:11 user nova-compute[71557]:   </resource>
Apr 12 10:38:11 user nova-compute[71557]:   <sysinfo type='smbios'>
Apr 12 10:38:11 user nova-compute[71557]:     <system>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name='version'>0.0.0</entry>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name='serial'>f147b4ee-d130-41ae-a4db-bc248fb23266</entry>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name='uuid'>f147b4ee-d130-41ae-a4db-bc248fb23266</entry>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name='family'>Virtual Machine</entry>
Apr 12 10:38:11 user nova-compute[71557]:     </system>
Apr 12 10:38:11 user nova-compute[71557]:   </sysinfo>
Apr 12 10:38:11 user nova-compute[71557]:   <os>
Apr 12 10:38:11 user nova-compute[71557]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 10:38:11 user nova-compute[71557]:     <boot dev='hd'/>
Apr 12 10:38:11 user nova-compute[71557]:     <smbios mode='sysinfo'/>
Apr 12 10:38:11 user nova-compute[71557]:   </os>
Apr 12 10:38:11 user nova-compute[71557]:   <features>
Apr 12 10:38:11 user nova-compute[71557]:     <acpi/>
Apr 12 10:38:11 user nova-compute[71557]:     <apic/>
Apr 12 10:38:11 user nova-compute[71557]:     <vmcoreinfo state='on'/>
Apr 12 10:38:11 user nova-compute[71557]:   </features>
Apr 12 10:38:11 user nova-compute[71557]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 10:38:11 user nova-compute[71557]:     <model fallback='forbid'>Nehalem</model>
Apr 12 10:38:11 user nova-compute[71557]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 10:38:11 user nova-compute[71557]:     <feature policy='require' name='vme'/>
Apr 12 10:38:11 user nova-compute[71557]:     <feature policy='require' name='x2apic'/>
Apr 12 10:38:11 user nova-compute[71557]:     <feature policy='require' name='hypervisor'/>
Apr 12 10:38:11 user nova-compute[71557]:   </cpu>
Apr 12 10:38:11 user nova-compute[71557]:   <clock offset='utc'>
Apr 12 10:38:11 user nova-compute[71557]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 10:38:11 user nova-compute[71557]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 10:38:11 user nova-compute[71557]:     <timer name='hpet' present='no'/>
Apr 12 10:38:11 user nova-compute[71557]:   </clock>
Apr 12 10:38:11 user nova-compute[71557]:   <on_poweroff>destroy</on_poweroff>
Apr 12 10:38:11 user nova-compute[71557]:   <on_reboot>restart</on_reboot>
Apr 12 10:38:11 user nova-compute[71557]:   <on_crash>destroy</on_crash>
Apr 12 10:38:11 user nova-compute[71557]:   <devices>
Apr 12 10:38:11 user nova-compute[71557]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 10:38:11 user nova-compute[71557]:     <disk type='file' device='disk'>
Apr 12 10:38:11 user nova-compute[71557]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 10:38:11 user nova-compute[71557]:       <source file='/opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk' index='2'/>
Apr 12 10:38:11 user nova-compute[71557]:       <backingStore type='file' index='3'>
Apr 12 10:38:11 user nova-compute[71557]:         <format type='raw'/>
Apr 12 10:38:11 user nova-compute[71557]:         <source file='/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c'/>
Apr 12 10:38:11 user nova-compute[71557]:         <backingStore/>
Apr 12 10:38:11 user nova-compute[71557]:       </backingStore>
Apr 12 10:38:11 user nova-compute[71557]:       <target dev='vda' bus='virtio'/>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='virtio-disk0'/>
Apr 12 10:38:11 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </disk>
Apr 12 10:38:11 user nova-compute[71557]:     <disk type='file' device='cdrom'>
Apr 12 10:38:11 user nova-compute[71557]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 10:38:11 user nova-compute[71557]:       <source file='/opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk.config' index='1'/>
Apr 12 10:38:11 user nova-compute[71557]:       <backingStore/>
Apr 12 10:38:11 user nova-compute[71557]:       <target dev='hda' bus='ide'/>
Apr 12 10:38:11 user nova-compute[71557]:       <readonly/>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='ide0-0-0'/>
Apr 12 10:38:11 user nova-compute[71557]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </disk>
Apr 12 10:38:11 user nova-compute[71557]:     <controller type='usb' index='0' model='none'>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='usb'/>
Apr 12 10:38:11 user nova-compute[71557]:     </controller>
Apr 12 10:38:11 user nova-compute[71557]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='pci.0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </controller>
Apr 12 10:38:11 user nova-compute[71557]:     <controller type='ide' index='0'>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='ide'/>
Apr 12 10:38:11 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 10:38:11 user nova-compute[71557]:     </controller>
Apr 12 10:38:11 user nova-compute[71557]:     <interface type='ethernet'>
Apr 12 10:38:11 user nova-compute[71557]:       <mac address='fa:16:3e:2e:44:60'/>
Apr 12 10:38:11 user nova-compute[71557]:       <target dev='tap96998164-ac'/>
Apr 12 10:38:11 user nova-compute[71557]:       <model type='virtio'/>
Apr 12 10:38:11 user nova-compute[71557]:       <mtu size='1442'/>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='net0'/>
Apr 12 10:38:11 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </interface>
Apr 12 10:38:11 user nova-compute[71557]:     <serial type='pty'>
Apr 12 10:38:11 user nova-compute[71557]:       <source path='/dev/pts/9'/>
Apr 12 10:38:11 user nova-compute[71557]:       <log file='/opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/console.log' append='off'/>
Apr 12 10:38:11 user nova-compute[71557]:       <target type='isa-serial' port='0'>
Apr 12 10:38:11 user nova-compute[71557]:         <model name='isa-serial'/>
Apr 12 10:38:11 user nova-compute[71557]:       </target>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='serial0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </serial>
Apr 12 10:38:11 user nova-compute[71557]:     <console type='pty' tty='/dev/pts/9'>
Apr 12 10:38:11 user nova-compute[71557]:       <source path='/dev/pts/9'/>
Apr 12 10:38:11 user nova-compute[71557]:       <log file='/opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/console.log' append='off'/>
Apr 12 10:38:11 user nova-compute[71557]:       <target type='serial' port='0'/>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='serial0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </console>
Apr 12 10:38:11 user nova-compute[71557]:     <input type='mouse' bus='ps2'>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='input0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </input>
Apr 12 10:38:11 user nova-compute[71557]:     <input type='keyboard' bus='ps2'>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='input1'/>
Apr 12 10:38:11 user nova-compute[71557]:     </input>
Apr 12 10:38:11 user nova-compute[71557]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Apr 12 10:38:11 user nova-compute[71557]:       <listen type='address' address='0.0.0.0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </graphics>
Apr 12 10:38:11 user nova-compute[71557]:     <audio id='1' type='none'/>
Apr 12 10:38:11 user nova-compute[71557]:     <video>
Apr 12 10:38:11 user nova-compute[71557]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='video0'/>
Apr 12 10:38:11 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </video>
Apr 12 10:38:11 user nova-compute[71557]:     <memballoon model='virtio'>
Apr 12 10:38:11 user nova-compute[71557]:       <stats period='10'/>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='balloon0'/>
Apr 12 10:38:11 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </memballoon>
Apr 12 10:38:11 user nova-compute[71557]:     <rng model='virtio'>
Apr 12 10:38:11 user nova-compute[71557]:       <backend model='random'>/dev/urandom</backend>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='rng0'/>
Apr 12 10:38:11 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </rng>
Apr 12 10:38:11 user nova-compute[71557]:   </devices>
Apr 12 10:38:11 user nova-compute[71557]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 10:38:11 user nova-compute[71557]:     <label>libvirt-f147b4ee-d130-41ae-a4db-bc248fb23266</label>
Apr 12 10:38:11 user nova-compute[71557]:     <imagelabel>libvirt-f147b4ee-d130-41ae-a4db-bc248fb23266</imagelabel>
Apr 12 10:38:11 user nova-compute[71557]:   </seclabel>
Apr 12 10:38:11 user nova-compute[71557]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 10:38:11 user nova-compute[71557]:     <label>+64055:+108</label>
Apr 12 10:38:11 user nova-compute[71557]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 10:38:11 user nova-compute[71557]:   </seclabel>
Apr 12 10:38:11 user nova-compute[71557]: </domain>
Apr 12 10:38:11 user nova-compute[71557]:  {{(pid=71557) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c4:14:86"/><model type="virtio"/><mtu size="1442"/><target dev="tap3f75b48d-25"/></interface> {{(pid=71557) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c4:14:86"/><model type="virtio"/><mtu size="1442"/><target dev="tap3f75b48d-25"/></interface>not found in domain: <domain type='kvm' id='10'>
Apr 12 10:38:11 user nova-compute[71557]:   <name>instance-0000000a</name>
Apr 12 10:38:11 user nova-compute[71557]:   <uuid>f147b4ee-d130-41ae-a4db-bc248fb23266</uuid>
Apr 12 10:38:11 user nova-compute[71557]:   <metadata>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:38:11 user nova-compute[71557]:   <nova:package version="0.0.0"/>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:name>tempest-device-tagging-server-973136543</nova:name>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:creationTime>2023-04-12 10:38:11</nova:creationTime>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:flavor name="m1.nano">
Apr 12 10:38:11 user nova-compute[71557]:     <nova:memory>128</nova:memory>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:disk>1</nova:disk>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:swap>0</nova:swap>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:vcpus>1</nova:vcpus>
Apr 12 10:38:11 user nova-compute[71557]:   </nova:flavor>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:owner>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:user uuid="254d3560065c4d8a8aaf312870be2967">tempest-TaggedAttachmentsTest-2008645939-project-member</nova:user>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:project uuid="6981486a29b64ee7b9ef7cbf2ca852be">tempest-TaggedAttachmentsTest-2008645939</nova:project>
Apr 12 10:38:11 user nova-compute[71557]:   </nova:owner>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:ports>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:port uuid="96998164-acd9-4a18-b230-d63787eaf154">
Apr 12 10:38:11 user nova-compute[71557]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 10:38:11 user nova-compute[71557]:     </nova:port>
Apr 12 10:38:11 user nova-compute[71557]:   </nova:ports>
Apr 12 10:38:11 user nova-compute[71557]: </nova:instance>
Apr 12 10:38:11 user nova-compute[71557]:   </metadata>
Apr 12 10:38:11 user nova-compute[71557]:   <memory unit='KiB'>131072</memory>
Apr 12 10:38:11 user nova-compute[71557]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 10:38:11 user nova-compute[71557]:   <vcpu placement='static'>1</vcpu>
Apr 12 10:38:11 user nova-compute[71557]:   <resource>
Apr 12 10:38:11 user nova-compute[71557]:     <partition>/machine</partition>
Apr 12 10:38:11 user nova-compute[71557]:   </resource>
Apr 12 10:38:11 user nova-compute[71557]:   <sysinfo type='smbios'>
Apr 12 10:38:11 user nova-compute[71557]:     <system>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name='version'>0.0.0</entry>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name='serial'>f147b4ee-d130-41ae-a4db-bc248fb23266</entry>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name='uuid'>f147b4ee-d130-41ae-a4db-bc248fb23266</entry>
Apr 12 10:38:11 user nova-compute[71557]:       <entry name='family'>Virtual Machine</entry>
Apr 12 10:38:11 user nova-compute[71557]:     </system>
Apr 12 10:38:11 user nova-compute[71557]:   </sysinfo>
Apr 12 10:38:11 user nova-compute[71557]:   <os>
Apr 12 10:38:11 user nova-compute[71557]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 10:38:11 user nova-compute[71557]:     <boot dev='hd'/>
Apr 12 10:38:11 user nova-compute[71557]:     <smbios mode='sysinfo'/>
Apr 12 10:38:11 user nova-compute[71557]:   </os>
Apr 12 10:38:11 user nova-compute[71557]:   <features>
Apr 12 10:38:11 user nova-compute[71557]:     <acpi/>
Apr 12 10:38:11 user nova-compute[71557]:     <apic/>
Apr 12 10:38:11 user nova-compute[71557]:     <vmcoreinfo state='on'/>
Apr 12 10:38:11 user nova-compute[71557]:   </features>
Apr 12 10:38:11 user nova-compute[71557]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 10:38:11 user nova-compute[71557]:     <model fallback='forbid'>Nehalem</model>
Apr 12 10:38:11 user nova-compute[71557]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 10:38:11 user nova-compute[71557]:     <feature policy='require' name='vme'/>
Apr 12 10:38:11 user nova-compute[71557]:     <feature policy='require' name='x2apic'/>
Apr 12 10:38:11 user nova-compute[71557]:     <feature policy='require' name='hypervisor'/>
Apr 12 10:38:11 user nova-compute[71557]:   </cpu>
Apr 12 10:38:11 user nova-compute[71557]:   <clock offset='utc'>
Apr 12 10:38:11 user nova-compute[71557]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 10:38:11 user nova-compute[71557]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 10:38:11 user nova-compute[71557]:     <timer name='hpet' present='no'/>
Apr 12 10:38:11 user nova-compute[71557]:   </clock>
Apr 12 10:38:11 user nova-compute[71557]:   <on_poweroff>destroy</on_poweroff>
Apr 12 10:38:11 user nova-compute[71557]:   <on_reboot>restart</on_reboot>
Apr 12 10:38:11 user nova-compute[71557]:   <on_crash>destroy</on_crash>
Apr 12 10:38:11 user nova-compute[71557]:   <devices>
Apr 12 10:38:11 user nova-compute[71557]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 10:38:11 user nova-compute[71557]:     <disk type='file' device='disk'>
Apr 12 10:38:11 user nova-compute[71557]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 10:38:11 user nova-compute[71557]:       <source file='/opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk' index='2'/>
Apr 12 10:38:11 user nova-compute[71557]:       <backingStore type='file' index='3'>
Apr 12 10:38:11 user nova-compute[71557]:         <format type='raw'/>
Apr 12 10:38:11 user nova-compute[71557]:         <source file='/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c'/>
Apr 12 10:38:11 user nova-compute[71557]:         <backingStore/>
Apr 12 10:38:11 user nova-compute[71557]:       </backingStore>
Apr 12 10:38:11 user nova-compute[71557]:       <target dev='vda' bus='virtio'/>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='virtio-disk0'/>
Apr 12 10:38:11 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </disk>
Apr 12 10:38:11 user nova-compute[71557]:     <disk type='file' device='cdrom'>
Apr 12 10:38:11 user nova-compute[71557]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 10:38:11 user nova-compute[71557]:       <source file='/opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk.config' index='1'/>
Apr 12 10:38:11 user nova-compute[71557]:       <backingStore/>
Apr 12 10:38:11 user nova-compute[71557]:       <target dev='hda' bus='ide'/>
Apr 12 10:38:11 user nova-compute[71557]:       <readonly/>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='ide0-0-0'/>
Apr 12 10:38:11 user nova-compute[71557]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </disk>
Apr 12 10:38:11 user nova-compute[71557]:     <controller type='usb' index='0' model='none'>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='usb'/>
Apr 12 10:38:11 user nova-compute[71557]:     </controller>
Apr 12 10:38:11 user nova-compute[71557]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='pci.0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </controller>
Apr 12 10:38:11 user nova-compute[71557]:     <controller type='ide' index='0'>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='ide'/>
Apr 12 10:38:11 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 10:38:11 user nova-compute[71557]:     </controller>
Apr 12 10:38:11 user nova-compute[71557]:     <interface type='ethernet'>
Apr 12 10:38:11 user nova-compute[71557]:       <mac address='fa:16:3e:2e:44:60'/>
Apr 12 10:38:11 user nova-compute[71557]:       <target dev='tap96998164-ac'/>
Apr 12 10:38:11 user nova-compute[71557]:       <model type='virtio'/>
Apr 12 10:38:11 user nova-compute[71557]:       <mtu size='1442'/>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='net0'/>
Apr 12 10:38:11 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </interface>
Apr 12 10:38:11 user nova-compute[71557]:     <serial type='pty'>
Apr 12 10:38:11 user nova-compute[71557]:       <source path='/dev/pts/9'/>
Apr 12 10:38:11 user nova-compute[71557]:       <log file='/opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/console.log' append='off'/>
Apr 12 10:38:11 user nova-compute[71557]:       <target type='isa-serial' port='0'>
Apr 12 10:38:11 user nova-compute[71557]:         <model name='isa-serial'/>
Apr 12 10:38:11 user nova-compute[71557]:       </target>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='serial0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </serial>
Apr 12 10:38:11 user nova-compute[71557]:     <console type='pty' tty='/dev/pts/9'>
Apr 12 10:38:11 user nova-compute[71557]:       <source path='/dev/pts/9'/>
Apr 12 10:38:11 user nova-compute[71557]:       <log file='/opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/console.log' append='off'/>
Apr 12 10:38:11 user nova-compute[71557]:       <target type='serial' port='0'/>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='serial0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </console>
Apr 12 10:38:11 user nova-compute[71557]:     <input type='mouse' bus='ps2'>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='input0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </input>
Apr 12 10:38:11 user nova-compute[71557]:     <input type='keyboard' bus='ps2'>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='input1'/>
Apr 12 10:38:11 user nova-compute[71557]:     </input>
Apr 12 10:38:11 user nova-compute[71557]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Apr 12 10:38:11 user nova-compute[71557]:       <listen type='address' address='0.0.0.0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </graphics>
Apr 12 10:38:11 user nova-compute[71557]:     <audio id='1' type='none'/>
Apr 12 10:38:11 user nova-compute[71557]:     <video>
Apr 12 10:38:11 user nova-compute[71557]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='video0'/>
Apr 12 10:38:11 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </video>
Apr 12 10:38:11 user nova-compute[71557]:     <memballoon model='virtio'>
Apr 12 10:38:11 user nova-compute[71557]:       <stats period='10'/>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='balloon0'/>
Apr 12 10:38:11 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </memballoon>
Apr 12 10:38:11 user nova-compute[71557]:     <rng model='virtio'>
Apr 12 10:38:11 user nova-compute[71557]:       <backend model='random'>/dev/urandom</backend>
Apr 12 10:38:11 user nova-compute[71557]:       <alias name='rng0'/>
Apr 12 10:38:11 user nova-compute[71557]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 10:38:11 user nova-compute[71557]:     </rng>
Apr 12 10:38:11 user nova-compute[71557]:   </devices>
Apr 12 10:38:11 user nova-compute[71557]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 10:38:11 user nova-compute[71557]:     <label>libvirt-f147b4ee-d130-41ae-a4db-bc248fb23266</label>
Apr 12 10:38:11 user nova-compute[71557]:     <imagelabel>libvirt-f147b4ee-d130-41ae-a4db-bc248fb23266</imagelabel>
Apr 12 10:38:11 user nova-compute[71557]:   </seclabel>
Apr 12 10:38:11 user nova-compute[71557]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 10:38:11 user nova-compute[71557]:     <label>+64055:+108</label>
Apr 12 10:38:11 user nova-compute[71557]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 10:38:11 user nova-compute[71557]:   </seclabel>
Apr 12 10:38:11 user nova-compute[71557]: </domain>
Apr 12 10:38:11 user nova-compute[71557]:  {{(pid=71557) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 10:38:11 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Detaching interface fa:16:3e:c4:14:86 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap3f75b48d-25' not found.
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973136543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-973136543',id=10,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdimvfCdLuB4VkmLV8sKAN/mnwsyMwY8NOOti+AyTKIr7DOlGneUneWZujzSPReHJ3Bkx1IiksPqGfbsqao0C74w5qd657VSCv5dx2mJ7By8lLfjmYEB3fpEh2Gj0rqkQ==',key_name='tempest-keypair-1041772862',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:36:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6981486a29b64ee7b9ef7cbf2ca852be',ramdisk_id='',reservation_id='r-c2o3o5pa',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2008645939',owner_user_name='tempest-TaggedAttachmentsTest-2008645939-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='254d3560065c4d8a8aaf312870be2967',uuid=f147b4ee-d130-41ae-a4db-bc248fb23266,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "address": "fa:16:3e:c4:14:86", "network": {"id": "8eeeb207-87de-47b4-ad69-ef653e7e4ee3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-998224895", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f75b48d-25", "ovs_interfaceid": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.network.os_vif_util [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] Converting VIF {"id": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "address": "fa:16:3e:c4:14:86", "network": {"id": "8eeeb207-87de-47b4-ad69-ef653e7e4ee3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-998224895", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f75b48d-25", "ovs_interfaceid": "3f75b48d-25ad-47ff-ab8a-ee743607793a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.network.os_vif_util [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:86,bridge_name='br-int',has_traffic_filtering=True,id=3f75b48d-25ad-47ff-ab8a-ee743607793a,network=Network(8eeeb207-87de-47b4-ad69-ef653e7e4ee3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f75b48d-25') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG os_vif [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:86,bridge_name='br-int',has_traffic_filtering=True,id=3f75b48d-25ad-47ff-ab8a-ee743607793a,network=Network(8eeeb207-87de-47b4-ad69-ef653e7e4ee3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f75b48d-25') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f75b48d-25, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:38:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:38:11 user nova-compute[71557]: INFO os_vif [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:14:86,bridge_name='br-int',has_traffic_filtering=True,id=3f75b48d-25ad-47ff-ab8a-ee743607793a,network=Network(8eeeb207-87de-47b4-ad69-ef653e7e4ee3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f75b48d-25')
Apr 12 10:38:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [req-5ab0ac64-7553-4249-9385-e012b513a215 req-c747cbee-35e7-4542-8459-6447bb2bc192 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:38:11 user nova-compute[71557]:   <nova:package version="0.0.0"/>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:name>tempest-device-tagging-server-973136543</nova:name>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:creationTime>2023-04-12 10:38:11</nova:creationTime>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:flavor name="m1.nano">
Apr 12 10:38:11 user nova-compute[71557]:     <nova:memory>128</nova:memory>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:disk>1</nova:disk>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:swap>0</nova:swap>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:vcpus>1</nova:vcpus>
Apr 12 10:38:11 user nova-compute[71557]:   </nova:flavor>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:owner>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:user uuid="254d3560065c4d8a8aaf312870be2967">tempest-TaggedAttachmentsTest-2008645939-project-member</nova:user>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:project uuid="6981486a29b64ee7b9ef7cbf2ca852be">tempest-TaggedAttachmentsTest-2008645939</nova:project>
Apr 12 10:38:11 user nova-compute[71557]:   </nova:owner>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:38:11 user nova-compute[71557]:   <nova:ports>
Apr 12 10:38:11 user nova-compute[71557]:     <nova:port uuid="96998164-acd9-4a18-b230-d63787eaf154">
Apr 12 10:38:11 user nova-compute[71557]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 10:38:11 user nova-compute[71557]:     </nova:port>
Apr 12 10:38:11 user nova-compute[71557]:   </nova:ports>
Apr 12 10:38:11 user nova-compute[71557]: </nova:instance>
Apr 12 10:38:11 user nova-compute[71557]:  {{(pid=71557) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-e98beaec-acb8-4047-add8-1161dcdfd569 req-ab80f350-be47-4f24-92f1-73cfc541f5f0 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Received event network-vif-unplugged-3f75b48d-25ad-47ff-ab8a-ee743607793a {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e98beaec-acb8-4047-add8-1161dcdfd569 req-ab80f350-be47-4f24-92f1-73cfc541f5f0 service nova] Acquiring lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e98beaec-acb8-4047-add8-1161dcdfd569 req-ab80f350-be47-4f24-92f1-73cfc541f5f0 service nova] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e98beaec-acb8-4047-add8-1161dcdfd569 req-ab80f350-be47-4f24-92f1-73cfc541f5f0 service nova] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-e98beaec-acb8-4047-add8-1161dcdfd569 req-ab80f350-be47-4f24-92f1-73cfc541f5f0 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] No waiting events found dispatching network-vif-unplugged-3f75b48d-25ad-47ff-ab8a-ee743607793a {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:12 user nova-compute[71557]: WARNING nova.compute.manager [req-e98beaec-acb8-4047-add8-1161dcdfd569 req-ab80f350-be47-4f24-92f1-73cfc541f5f0 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Received unexpected event network-vif-unplugged-3f75b48d-25ad-47ff-ab8a-ee743607793a for instance with vm_state active and task_state None.
Apr 12 10:38:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-e98beaec-acb8-4047-add8-1161dcdfd569 req-ab80f350-be47-4f24-92f1-73cfc541f5f0 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Received event network-vif-plugged-3f75b48d-25ad-47ff-ab8a-ee743607793a {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e98beaec-acb8-4047-add8-1161dcdfd569 req-ab80f350-be47-4f24-92f1-73cfc541f5f0 service nova] Acquiring lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e98beaec-acb8-4047-add8-1161dcdfd569 req-ab80f350-be47-4f24-92f1-73cfc541f5f0 service nova] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e98beaec-acb8-4047-add8-1161dcdfd569 req-ab80f350-be47-4f24-92f1-73cfc541f5f0 service nova] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-e98beaec-acb8-4047-add8-1161dcdfd569 req-ab80f350-be47-4f24-92f1-73cfc541f5f0 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] No waiting events found dispatching network-vif-plugged-3f75b48d-25ad-47ff-ab8a-ee743607793a {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:12 user nova-compute[71557]: WARNING nova.compute.manager [req-e98beaec-acb8-4047-add8-1161dcdfd569 req-ab80f350-be47-4f24-92f1-73cfc541f5f0 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Received unexpected event network-vif-plugged-3f75b48d-25ad-47ff-ab8a-ee743607793a for instance with vm_state active and task_state None.
Apr 12 10:38:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG nova.network.neutron [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Updating instance_info_cache with network_info: [{"id": "96998164-acd9-4a18-b230-d63787eaf154", "address": "fa:16:3e:2e:44:60", "network": {"id": "4f4a6f13-7642-4157-ba75-be13336c456e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-673330570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96998164-ac", "ovs_interfaceid": "96998164-acd9-4a18-b230-d63787eaf154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Releasing lock "refresh_cache-f147b4ee-d130-41ae-a4db-bc248fb23266" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-84c3eb11-4fbf-4b17-90dd-c1ef7a437ca3 req-2e33f934-5c24-4977-bc0b-28407b8b47a6 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-unplugged-fe31a29c-b57d-463d-98ba-6527848edeba {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-84c3eb11-4fbf-4b17-90dd-c1ef7a437ca3 req-2e33f934-5c24-4977-bc0b-28407b8b47a6 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-84c3eb11-4fbf-4b17-90dd-c1ef7a437ca3 req-2e33f934-5c24-4977-bc0b-28407b8b47a6 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-84c3eb11-4fbf-4b17-90dd-c1ef7a437ca3 req-2e33f934-5c24-4977-bc0b-28407b8b47a6 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-84c3eb11-4fbf-4b17-90dd-c1ef7a437ca3 req-2e33f934-5c24-4977-bc0b-28407b8b47a6 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-unplugged-fe31a29c-b57d-463d-98ba-6527848edeba {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-84c3eb11-4fbf-4b17-90dd-c1ef7a437ca3 req-2e33f934-5c24-4977-bc0b-28407b8b47a6 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-unplugged-fe31a29c-b57d-463d-98ba-6527848edeba for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-84c3eb11-4fbf-4b17-90dd-c1ef7a437ca3 req-2e33f934-5c24-4977-bc0b-28407b8b47a6 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-plugged-fe31a29c-b57d-463d-98ba-6527848edeba {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-84c3eb11-4fbf-4b17-90dd-c1ef7a437ca3 req-2e33f934-5c24-4977-bc0b-28407b8b47a6 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-84c3eb11-4fbf-4b17-90dd-c1ef7a437ca3 req-2e33f934-5c24-4977-bc0b-28407b8b47a6 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-84c3eb11-4fbf-4b17-90dd-c1ef7a437ca3 req-2e33f934-5c24-4977-bc0b-28407b8b47a6 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-84c3eb11-4fbf-4b17-90dd-c1ef7a437ca3 req-2e33f934-5c24-4977-bc0b-28407b8b47a6 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-plugged-fe31a29c-b57d-463d-98ba-6527848edeba {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:12 user nova-compute[71557]: WARNING nova.compute.manager [req-84c3eb11-4fbf-4b17-90dd-c1ef7a437ca3 req-2e33f934-5c24-4977-bc0b-28407b8b47a6 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received unexpected event network-vif-plugged-fe31a29c-b57d-463d-98ba-6527848edeba for instance with vm_state active and task_state deleting.
Apr 12 10:38:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-03634afc-4aee-4999-bf7e-4f554c0cfb2a tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "interface-f147b4ee-d130-41ae-a4db-bc248fb23266-3f75b48d-25ad-47ff-ab8a-ee743607793a" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.892s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:13 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Instance destroyed successfully.
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.objects.instance [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lazy-loading 'resources' on Instance uuid b9fd76e3-c7ed-4631-b056-3bd13439f7d3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-294974011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-294974011',id=11,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBbhZM6FHyb7OoBiL7tXVD9RTsDb5IWjWMgDXbi5oOKRJjUMkLSqayOoq+9fpq9oQu4F57O2IwTtOYZdDfjQCXB2a+FJKKNCs+mfOi/2wgZGCXUo+TcvBLhs27dkbJDg==',key_name='tempest-keypair-1600069342',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fcfbd94249342b2a436d2592e0dc9bf',ramdisk_id='',reservation_id='r-lwww07gj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-639083036',owner_user_name='tempest-TaggedBootDevicesTest_v242-639083036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:36:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='949ebef2d45b4d64a89a11d837dfffd3',uuid=b9fd76e3-c7ed-4631-b056-3bd13439f7d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe31a29c-b57d-463d-98ba-6527848edeba", "address": "fa:16:3e:04:9a:84", "network": {"id": "487a3034-5a63-4896-a029-be581b719991", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-754944090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe31a29c-b5", "ovs_interfaceid": "fe31a29c-b57d-463d-98ba-6527848edeba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converting VIF {"id": "fe31a29c-b57d-463d-98ba-6527848edeba", "address": "fa:16:3e:04:9a:84", "network": {"id": "487a3034-5a63-4896-a029-be581b719991", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-754944090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe31a29c-b5", "ovs_interfaceid": "fe31a29c-b57d-463d-98ba-6527848edeba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:9a:84,bridge_name='br-int',has_traffic_filtering=True,id=fe31a29c-b57d-463d-98ba-6527848edeba,network=Network(487a3034-5a63-4896-a029-be581b719991),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe31a29c-b5') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG os_vif [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:9a:84,bridge_name='br-int',has_traffic_filtering=True,id=fe31a29c-b57d-463d-98ba-6527848edeba,network=Network(487a3034-5a63-4896-a029-be581b719991),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe31a29c-b5') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe31a29c-b5, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:13 user nova-compute[71557]: INFO os_vif [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:9a:84,bridge_name='br-int',has_traffic_filtering=True,id=fe31a29c-b57d-463d-98ba-6527848edeba,network=Network(487a3034-5a63-4896-a029-be581b719991),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe31a29c-b5')
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-294974011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-294974011',id=11,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBbhZM6FHyb7OoBiL7tXVD9RTsDb5IWjWMgDXbi5oOKRJjUMkLSqayOoq+9fpq9oQu4F57O2IwTtOYZdDfjQCXB2a+FJKKNCs+mfOi/2wgZGCXUo+TcvBLhs27dkbJDg==',key_name='tempest-keypair-1600069342',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fcfbd94249342b2a436d2592e0dc9bf',ramdisk_id='',reservation_id='r-lwww07gj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-639083036',owner_user_name='tempest-TaggedBootDevicesTest_v242-639083036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:36:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='949ebef2d45b4d64a89a11d837dfffd3',uuid=b9fd76e3-c7ed-4631-b056-3bd13439f7d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "address": "fa:16:3e:7f:41:2c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e2f100-f6", "ovs_interfaceid": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converting VIF {"id": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "address": "fa:16:3e:7f:41:2c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e2f100-f6", "ovs_interfaceid": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:41:2c,bridge_name='br-int',has_traffic_filtering=True,id=c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc5e2f100-f6') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG os_vif [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:41:2c,bridge_name='br-int',has_traffic_filtering=True,id=c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc5e2f100-f6') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-unplugged-1173b214-caa3-4d2b-9ee4-efe4ab063cac {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-unplugged-1173b214-caa3-4d2b-9ee4-efe4ab063cac {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-unplugged-1173b214-caa3-4d2b-9ee4-efe4ab063cac for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-plugged-1173b214-caa3-4d2b-9ee4-efe4ab063cac {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-plugged-1173b214-caa3-4d2b-9ee4-efe4ab063cac {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:13 user nova-compute[71557]: WARNING nova.compute.manager [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received unexpected event network-vif-plugged-1173b214-caa3-4d2b-9ee4-efe4ab063cac for instance with vm_state active and task_state deleting.
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-unplugged-925f7823-924b-4df5-8bec-5f065331e4fe {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-unplugged-925f7823-924b-4df5-8bec-5f065331e4fe {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-unplugged-925f7823-924b-4df5-8bec-5f065331e4fe for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-plugged-925f7823-924b-4df5-8bec-5f065331e4fe {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-plugged-925f7823-924b-4df5-8bec-5f065331e4fe {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:13 user nova-compute[71557]: WARNING nova.compute.manager [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received unexpected event network-vif-plugged-925f7823-924b-4df5-8bec-5f065331e4fe for instance with vm_state active and task_state deleting.
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-unplugged-23c5dfaa-4003-410d-836e-4218b879cf66 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-unplugged-23c5dfaa-4003-410d-836e-4218b879cf66 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-unplugged-23c5dfaa-4003-410d-836e-4218b879cf66 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-plugged-23c5dfaa-4003-410d-836e-4218b879cf66 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-plugged-23c5dfaa-4003-410d-836e-4218b879cf66 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:13 user nova-compute[71557]: WARNING nova.compute.manager [req-d3dfc7c0-14fa-4bb3-9462-082d1ba6a085 req-3af30118-ea5f-421a-ab48-5c78ef1bf545 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received unexpected event network-vif-plugged-23c5dfaa-4003-410d-836e-4218b879cf66 for instance with vm_state active and task_state deleting.
Apr 12 10:38:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5e2f100-f6, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:13 user nova-compute[71557]: INFO os_vif [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:41:2c,bridge_name='br-int',has_traffic_filtering=True,id=c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc5e2f100-f6')
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-294974011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-294974011',id=11,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBbhZM6FHyb7OoBiL7tXVD9RTsDb5IWjWMgDXbi5oOKRJjUMkLSqayOoq+9fpq9oQu4F57O2IwTtOYZdDfjQCXB2a+FJKKNCs+mfOi/2wgZGCXUo+TcvBLhs27dkbJDg==',key_name='tempest-keypair-1600069342',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fcfbd94249342b2a436d2592e0dc9bf',ramdisk_id='',reservation_id='r-lwww07gj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-639083036',owner_user_name='tempest-TaggedBootDevicesTest_v242-639083036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:36:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='949ebef2d45b4d64a89a11d837dfffd3',uuid=b9fd76e3-c7ed-4631-b056-3bd13439f7d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "address": "fa:16:3e:b0:8e:21", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307fee9a-af", "ovs_interfaceid": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converting VIF {"id": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "address": "fa:16:3e:b0:8e:21", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307fee9a-af", "ovs_interfaceid": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8e:21,bridge_name='br-int',has_traffic_filtering=True,id=307fee9a-af5f-45a9-b678-7cb16cfad99d,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap307fee9a-af') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG os_vif [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8e:21,bridge_name='br-int',has_traffic_filtering=True,id=307fee9a-af5f-45a9-b678-7cb16cfad99d,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap307fee9a-af') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap307fee9a-af, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:14 user nova-compute[71557]: INFO os_vif [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8e:21,bridge_name='br-int',has_traffic_filtering=True,id=307fee9a-af5f-45a9-b678-7cb16cfad99d,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap307fee9a-af')
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-294974011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-294974011',id=11,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBbhZM6FHyb7OoBiL7tXVD9RTsDb5IWjWMgDXbi5oOKRJjUMkLSqayOoq+9fpq9oQu4F57O2IwTtOYZdDfjQCXB2a+FJKKNCs+mfOi/2wgZGCXUo+TcvBLhs27dkbJDg==',key_name='tempest-keypair-1600069342',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fcfbd94249342b2a436d2592e0dc9bf',ramdisk_id='',reservation_id='r-lwww07gj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-639083036',owner_user_name='tempest-TaggedBootDevicesTest_v242-639083036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:36:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='949ebef2d45b4d64a89a11d837dfffd3',uuid=b9fd76e3-c7ed-4631-b056-3bd13439f7d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1173b214-caa3-4d2b-9ee4-efe4ab063cac", "address": "fa:16:3e:c3:05:a8", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1173b214-ca", "ovs_interfaceid": "1173b214-caa3-4d2b-9ee4-efe4ab063cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converting VIF {"id": "1173b214-caa3-4d2b-9ee4-efe4ab063cac", "address": "fa:16:3e:c3:05:a8", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1173b214-ca", "ovs_interfaceid": "1173b214-caa3-4d2b-9ee4-efe4ab063cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:05:a8,bridge_name='br-int',has_traffic_filtering=True,id=1173b214-caa3-4d2b-9ee4-efe4ab063cac,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1173b214-ca') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_vif [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:05:a8,bridge_name='br-int',has_traffic_filtering=True,id=1173b214-caa3-4d2b-9ee4-efe4ab063cac,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1173b214-ca') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1173b214-ca, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:14 user nova-compute[71557]: INFO os_vif [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:05:a8,bridge_name='br-int',has_traffic_filtering=True,id=1173b214-caa3-4d2b-9ee4-efe4ab063cac,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1173b214-ca')
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-294974011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-294974011',id=11,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBbhZM6FHyb7OoBiL7tXVD9RTsDb5IWjWMgDXbi5oOKRJjUMkLSqayOoq+9fpq9oQu4F57O2IwTtOYZdDfjQCXB2a+FJKKNCs+mfOi/2wgZGCXUo+TcvBLhs27dkbJDg==',key_name='tempest-keypair-1600069342',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fcfbd94249342b2a436d2592e0dc9bf',ramdisk_id='',reservation_id='r-lwww07gj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-639083036',owner_user_name='tempest-TaggedBootDevicesTest_v242-639083036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:36:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='949ebef2d45b4d64a89a11d837dfffd3',uuid=b9fd76e3-c7ed-4631-b056-3bd13439f7d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "925f7823-924b-4df5-8bec-5f065331e4fe", "address": "fa:16:3e:41:4d:9c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap925f7823-92", "ovs_interfaceid": "925f7823-924b-4df5-8bec-5f065331e4fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converting VIF {"id": "925f7823-924b-4df5-8bec-5f065331e4fe", "address": "fa:16:3e:41:4d:9c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap925f7823-92", "ovs_interfaceid": "925f7823-924b-4df5-8bec-5f065331e4fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:4d:9c,bridge_name='br-int',has_traffic_filtering=True,id=925f7823-924b-4df5-8bec-5f065331e4fe,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap925f7823-92') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_vif [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:4d:9c,bridge_name='br-int',has_traffic_filtering=True,id=925f7823-924b-4df5-8bec-5f065331e4fe,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap925f7823-92') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap925f7823-92, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:14 user nova-compute[71557]: INFO os_vif [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:4d:9c,bridge_name='br-int',has_traffic_filtering=True,id=925f7823-924b-4df5-8bec-5f065331e4fe,network=Network(5c74f6a2-2fbf-4117-85df-6a7abb02577c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap925f7823-92')
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-294974011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-294974011',id=11,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBbhZM6FHyb7OoBiL7tXVD9RTsDb5IWjWMgDXbi5oOKRJjUMkLSqayOoq+9fpq9oQu4F57O2IwTtOYZdDfjQCXB2a+FJKKNCs+mfOi/2wgZGCXUo+TcvBLhs27dkbJDg==',key_name='tempest-keypair-1600069342',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fcfbd94249342b2a436d2592e0dc9bf',ramdisk_id='',reservation_id='r-lwww07gj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-639083036',owner_user_name='tempest-TaggedBootDevicesTest_v242-639083036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:36:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='949ebef2d45b4d64a89a11d837dfffd3',uuid=b9fd76e3-c7ed-4631-b056-3bd13439f7d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23c5dfaa-4003-410d-836e-4218b879cf66", "address": "fa:16:3e:49:60:f7", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c5dfaa-40", "ovs_interfaceid": "23c5dfaa-4003-410d-836e-4218b879cf66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converting VIF {"id": "23c5dfaa-4003-410d-836e-4218b879cf66", "address": "fa:16:3e:49:60:f7", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c5dfaa-40", "ovs_interfaceid": "23c5dfaa-4003-410d-836e-4218b879cf66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:60:f7,bridge_name='br-int',has_traffic_filtering=True,id=23c5dfaa-4003-410d-836e-4218b879cf66,network=Network(47aa3673-739f-40a5-90b5-9bdc59b7590c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c5dfaa-40') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_vif [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:60:f7,bridge_name='br-int',has_traffic_filtering=True,id=23c5dfaa-4003-410d-836e-4218b879cf66,network=Network(47aa3673-739f-40a5-90b5-9bdc59b7590c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c5dfaa-40') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23c5dfaa-40, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:14 user nova-compute[71557]: INFO os_vif [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:60:f7,bridge_name='br-int',has_traffic_filtering=True,id=23c5dfaa-4003-410d-836e-4218b879cf66,network=Network(47aa3673-739f-40a5-90b5-9bdc59b7590c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c5dfaa-40')
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-294974011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-294974011',id=11,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmBbhZM6FHyb7OoBiL7tXVD9RTsDb5IWjWMgDXbi5oOKRJjUMkLSqayOoq+9fpq9oQu4F57O2IwTtOYZdDfjQCXB2a+FJKKNCs+mfOi/2wgZGCXUo+TcvBLhs27dkbJDg==',key_name='tempest-keypair-1600069342',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fcfbd94249342b2a436d2592e0dc9bf',ramdisk_id='',reservation_id='r-lwww07gj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-639083036',owner_user_name='tempest-TaggedBootDevicesTest_v242-639083036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:36:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='949ebef2d45b4d64a89a11d837dfffd3',uuid=b9fd76e3-c7ed-4631-b056-3bd13439f7d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "address": "fa:16:3e:d3:ce:bd", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap718755e4-0a", "ovs_interfaceid": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converting VIF {"id": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "address": "fa:16:3e:d3:ce:bd", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap718755e4-0a", "ovs_interfaceid": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ce:bd,bridge_name='br-int',has_traffic_filtering=True,id=718755e4-0ae2-47c0-b5c9-630c5df1e840,network=Network(47aa3673-739f-40a5-90b5-9bdc59b7590c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap718755e4-0a') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_vif [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ce:bd,bridge_name='br-int',has_traffic_filtering=True,id=718755e4-0ae2-47c0-b5c9-630c5df1e840,network=Network(47aa3673-739f-40a5-90b5-9bdc59b7590c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap718755e4-0a') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap718755e4-0a, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:38:14 user nova-compute[71557]: INFO os_vif [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ce:bd,bridge_name='br-int',has_traffic_filtering=True,id=718755e4-0ae2-47c0-b5c9-630c5df1e840,network=Network(47aa3673-739f-40a5-90b5-9bdc59b7590c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap718755e4-0a')
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYhORJSe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:38:14 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a87598-17a9-4c73-ae96-90cc7b498648]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:38:14 user nova-compute[71557]: No targets found.
Apr 12 10:38:14 user nova-compute[71557]: iSNS:
Apr 12 10:38:14 user nova-compute[71557]: No targets found.
Apr 12 10:38:14 user nova-compute[71557]: STATIC:
Apr 12 10:38:14 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca
Apr 12 10:38:14 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:14 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:14 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771
Apr 12 10:38:14 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:14 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:14 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd
Apr 12 10:38:14 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:14 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:14 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f
Apr 12 10:38:14 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:14 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:14 user nova-compute[71557]: FIRMWARE:
Apr 12 10:38:14 user nova-compute[71557]: No targets found.
Apr 12 10:38:14 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:38:14 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:38:14 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5467a8c2-4e93-4270-aa03-c0ba04c9e26d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5158c4-ccd9-4cae-8e3c-14f1652af1e0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:38:14 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:38:14 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:38:14 user nova-compute[71557]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:38:14 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd (non-flash)
Apr 12 10:38:14 user nova-compute[71557]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:38:14 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:38:14 user nova-compute[71557]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:38:14 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd448cd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd'): ({'sdb'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Removing single pathed devices sdb {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfebdcb-13fc-4ffe-88e9-9096712b36b4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a586c15c-4718-4961-a41c-e0fb23b8c382]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Flushing IO for device /dev/sdb {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fac932-08ea-4de0-9635-95064d11a48f]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c45065-cf79-4f55-a51c-8bd92596c5c4]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[96396b1a-6045-4b55-89f8-14ed3e2ada55]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-unplugged-c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-unplugged-c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-unplugged-c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-plugged-c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-plugged-c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:14 user nova-compute[71557]: WARNING nova.compute.manager [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received unexpected event network-vif-plugged-c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5 for instance with vm_state active and task_state deleting.
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-unplugged-307fee9a-af5f-45a9-b678-7cb16cfad99d {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-unplugged-307fee9a-af5f-45a9-b678-7cb16cfad99d {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-unplugged-307fee9a-af5f-45a9-b678-7cb16cfad99d for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-plugged-307fee9a-af5f-45a9-b678-7cb16cfad99d {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-plugged-307fee9a-af5f-45a9-b678-7cb16cfad99d {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:14 user nova-compute[71557]: WARNING nova.compute.manager [req-4636824f-2ec8-4656-85ed-13395a617b43 req-4473add1-9171-4d92-8d3f-8671ac904b95 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received unexpected event network-vif-plugged-307fee9a-af5f-45a9-b678-7cb16cfad99d for instance with vm_state active and task_state deleting.
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa79c8d-8cd5-4b0c-9c39-5923ee130f17]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd, portal: 172.16.0.220,3260]
Apr 12 10:38:14 user nova-compute[71557]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd, portal: 172.16.0.220,3260] successful.
Apr 12 10:38:14 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0f4b62-8be6-4cd9-806c-d59f3f9a7fbd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4a4f65-b6a1-4264-908b-a25e4e74fb95]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] <== disconnect_volume: return (300ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usCHNVDL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:38:14 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a574152-5080-4f16-9385-c46b8f0cd4ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:38:14 user nova-compute[71557]: No targets found.
Apr 12 10:38:14 user nova-compute[71557]: iSNS:
Apr 12 10:38:14 user nova-compute[71557]: No targets found.
Apr 12 10:38:14 user nova-compute[71557]: STATIC:
Apr 12 10:38:14 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca
Apr 12 10:38:14 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:14 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:14 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771
Apr 12 10:38:14 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:14 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:14 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f
Apr 12 10:38:14 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:14 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:14 user nova-compute[71557]: FIRMWARE:
Apr 12 10:38:14 user nova-compute[71557]: No targets found.
Apr 12 10:38:14 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:38:14 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:38:14 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a9070a-ee44-4149-bc13-11f0614d673e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[96717b4d-c10a-4385-95ad-d10ba2fdaec1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:38:14 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:38:14 user nova-compute[71557]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:38:14 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:38:14 user nova-compute[71557]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca (non-flash)
Apr 12 10:38:14 user nova-compute[71557]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:38:14 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd462df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca'): ({'sdd'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Removing single pathed devices sdd {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0b324c-2465-486f-a8a3-8c3a9ddf7017]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[889565ac-d238-4fdb-ad61-465ce8ec4359]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Flushing IO for device /dev/sdd {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.011s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79768e8-d9c0-4181-8adf-22567587d857]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a004f25d-a376-4bed-838d-df61d58e3f91]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] SCSI volumes sdd have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb28ea43-9ad5-43ea-b817-d55193a38249]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[30686def-51bc-4bda-8646-85e85b259f07]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca, portal: 172.16.0.220,3260]
Apr 12 10:38:14 user nova-compute[71557]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca, portal: 172.16.0.220,3260] successful.
Apr 12 10:38:14 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b206a0b-d64c-4f10-b072-f1473bf5f2ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[49569dd2-8ef2-4318-b695-355ff8d92bf9]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] <== disconnect_volume: return (300ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GmHtNICB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:38:14 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6de8a4a-dd90-48da-a961-95325bb4665e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:38:14 user nova-compute[71557]: No targets found.
Apr 12 10:38:14 user nova-compute[71557]: iSNS:
Apr 12 10:38:14 user nova-compute[71557]: No targets found.
Apr 12 10:38:14 user nova-compute[71557]: STATIC:
Apr 12 10:38:14 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771
Apr 12 10:38:14 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:14 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:14 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f
Apr 12 10:38:14 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:14 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:14 user nova-compute[71557]: FIRMWARE:
Apr 12 10:38:14 user nova-compute[71557]: No targets found.
Apr 12 10:38:14 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:38:14 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:38:14 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1a6e67-26f8-4d31-8354-3cc702c84b3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[20185d88-2e1c-4470-97e4-67c75bee3430]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:38:14 user nova-compute[71557]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:38:14 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f (non-flash)
Apr 12 10:38:14 user nova-compute[71557]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:38:14 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fe12977f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f'): ({'sdc'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Removing single pathed devices sdc {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[693903b0-1321-4146-938c-1eed4572bf06]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a843472b-624d-4ea3-8aab-fde324f4d55b]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Flushing IO for device /dev/sdc {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295894.8919044, a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:38:14 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] VM Resumed (Lifecycle Event)
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryHjCUZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ea55f551-968e-4ece-a37a-c4128ce5e8cb', 'attached_at': '', 'detached_at': '', 'volume_id': '2c1f53d0-46d5-4944-89d3-f0793ff3fbf4', 'serial': '2c1f53d0-46d5-4944-89d3-f0793ff3fbf4'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CYKBFxrG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '63298498-6bc0-47a0-b48e-815852c52771'}, 'status': 'reserved', 'instance': 'ea55f551-968e-4ece-a37a-c4128ce5e8cb', 'attached_at': '', 'detached_at': '', 'volume_id': '63298498-6bc0-47a0-b48e-815852c52771', 'serial'} {{(pid=71557) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryHjCUZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:38:14 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:38:14 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Instance spawned successfully.
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c99cf65-1a22-416c-8c83-78b560c36f8a]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:14 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295894.892704, a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:38:14 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] VM Started (Lifecycle Event)
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-16fd1893-5d5e-41e7-b65c-990fea2043ac req-aecaed96-9561-4378-b4c8-704a0cba68eb service nova] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Received event network-vif-plugged-5eed0079-0c02-43b0-8124-4ef257a7eb1f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-16fd1893-5d5e-41e7-b65c-990fea2043ac req-aecaed96-9561-4378-b4c8-704a0cba68eb service nova] Acquiring lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-16fd1893-5d5e-41e7-b65c-990fea2043ac req-aecaed96-9561-4378-b4c8-704a0cba68eb service nova] Lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-16fd1893-5d5e-41e7-b65c-990fea2043ac req-aecaed96-9561-4378-b4c8-704a0cba68eb service nova] Lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-16fd1893-5d5e-41e7-b65c-990fea2043ac req-aecaed96-9561-4378-b4c8-704a0cba68eb service nova] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] No waiting events found dispatching network-vif-plugged-5eed0079-0c02-43b0-8124-4ef257a7eb1f {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:14 user nova-compute[71557]: WARNING nova.compute.manager [req-16fd1893-5d5e-41e7-b65c-990fea2043ac req-aecaed96-9561-4378-b4c8-704a0cba68eb service nova] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Received unexpected event network-vif-plugged-5eed0079-0c02-43b0-8124-4ef257a7eb1f for instance with vm_state building and task_state spawning.
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-16fd1893-5d5e-41e7-b65c-990fea2043ac req-aecaed96-9561-4378-b4c8-704a0cba68eb service nova] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Received event network-vif-plugged-5eed0079-0c02-43b0-8124-4ef257a7eb1f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-16fd1893-5d5e-41e7-b65c-990fea2043ac req-aecaed96-9561-4378-b4c8-704a0cba68eb service nova] Acquiring lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-16fd1893-5d5e-41e7-b65c-990fea2043ac req-aecaed96-9561-4378-b4c8-704a0cba68eb service nova] Lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-16fd1893-5d5e-41e7-b65c-990fea2043ac req-aecaed96-9561-4378-b4c8-704a0cba68eb service nova] Lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-16fd1893-5d5e-41e7-b65c-990fea2043ac req-aecaed96-9561-4378-b4c8-704a0cba68eb service nova] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] No waiting events found dispatching network-vif-plugged-5eed0079-0c02-43b0-8124-4ef257a7eb1f {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:14 user nova-compute[71557]: WARNING nova.compute.manager [req-16fd1893-5d5e-41e7-b65c-990fea2043ac req-aecaed96-9561-4378-b4c8-704a0cba68eb service nova] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Received unexpected event network-vif-plugged-5eed0079-0c02-43b0-8124-4ef257a7eb1f for instance with vm_state building and task_state spawning.
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e9c35a-f551-4d6b-8393-e0febc941501]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] SCSI volumes sdc have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[741afff0-d775-4e15-ba69-50a37e88b099]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:14 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:38:15 user nova-compute[71557]: INFO nova.compute.manager [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Took 5.85 seconds to spawn the instance on the hypervisor.
Apr 12 10:38:15 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95c7c38-6de4-4847-9bd1-284cbed6a816]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f, portal: 172.16.0.220,3260]
Apr 12 10:38:15 user nova-compute[71557]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f, portal: 172.16.0.220,3260] successful.
Apr 12 10:38:15 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb1f25c3-c274-4c2d-b5be-af3f13f3e84f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b2beea-ed39-4cbf-87ee-3ae469d0970c]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] <== disconnect_volume: return (317ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:38:15 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Deleting instance files /opt/stack/data/nova/instances/b9fd76e3-c7ed-4631-b056-3bd13439f7d3_del
Apr 12 10:38:15 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Deletion of /opt/stack/data/nova/instances/b9fd76e3-c7ed-4631-b056-3bd13439f7d3_del complete
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.187s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:38:15 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:38:15 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d13ef0-d3d2-433f-8b4a-2fa3d5f4d815]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:38:15 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:15 user nova-compute[71557]: INFO nova.compute.manager [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Took 6.65 seconds to build instance.
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[853f0c8a-3b9e-443c-a2a0-6240db091226]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4] added
Apr 12 10:38:15 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c4b01caf-5e1b-4450-85b1-fe2ddc8d1de7 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.755s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:15 user nova-compute[71557]: INFO nova.compute.manager [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Took 3.25 seconds to destroy the instance on the hypervisor.
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0ce1f0-57f2-4bc0-ad6e-dbbe97a037ab]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c639d78-118e-475a-8aa8-b8bbd0769859]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ryHjCUZE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ryHjCUZE" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e2f1ae-b76a-4f86-a3a0-fbf72f588766]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ryHjCUZE'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[964cf431-8718-4db8-9807-93fec68bf453]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b7c0d2-66d8-4d15-ba3c-f82b0e4e88c6]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:38:15 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:38:15 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c41c20-b013-4cab-8629-6b4991bc0902]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4, portal: 172.16.0.220,3260]
Apr 12 10:38:15 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4, portal: 172.16.0.220,3260] successful.
Apr 12 10:38:15 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[120be009-9d70-4e34-9f57-419f0680ad34]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcf5f0c-8447-4010-89ba-3d49c62d8e3d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:38:15 user nova-compute[71557]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:38:15 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:38:15 user nova-compute[71557]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:38:15 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[47003d35-5682-4290-9bb3-1dd2588f32f5]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryHjCUZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-b0a87c0e-4fd0-4fb9-95a6-7f14b538ee86 req-48f39f52-aa61-4051-a590-b59f4a89b1b3 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-unplugged-718755e4-0ae2-47c0-b5c9-630c5df1e840 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b0a87c0e-4fd0-4fb9-95a6-7f14b538ee86 req-48f39f52-aa61-4051-a590-b59f4a89b1b3 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b0a87c0e-4fd0-4fb9-95a6-7f14b538ee86 req-48f39f52-aa61-4051-a590-b59f4a89b1b3 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b0a87c0e-4fd0-4fb9-95a6-7f14b538ee86 req-48f39f52-aa61-4051-a590-b59f4a89b1b3 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-b0a87c0e-4fd0-4fb9-95a6-7f14b538ee86 req-48f39f52-aa61-4051-a590-b59f4a89b1b3 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-unplugged-718755e4-0ae2-47c0-b5c9-630c5df1e840 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-b0a87c0e-4fd0-4fb9-95a6-7f14b538ee86 req-48f39f52-aa61-4051-a590-b59f4a89b1b3 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-unplugged-718755e4-0ae2-47c0-b5c9-630c5df1e840 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-b0a87c0e-4fd0-4fb9-95a6-7f14b538ee86 req-48f39f52-aa61-4051-a590-b59f4a89b1b3 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-plugged-718755e4-0ae2-47c0-b5c9-630c5df1e840 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b0a87c0e-4fd0-4fb9-95a6-7f14b538ee86 req-48f39f52-aa61-4051-a590-b59f4a89b1b3 service nova] Acquiring lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b0a87c0e-4fd0-4fb9-95a6-7f14b538ee86 req-48f39f52-aa61-4051-a590-b59f4a89b1b3 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b0a87c0e-4fd0-4fb9-95a6-7f14b538ee86 req-48f39f52-aa61-4051-a590-b59f4a89b1b3 service nova] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-b0a87c0e-4fd0-4fb9-95a6-7f14b538ee86 req-48f39f52-aa61-4051-a590-b59f4a89b1b3 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] No waiting events found dispatching network-vif-plugged-718755e4-0ae2-47c0-b5c9-630c5df1e840 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:15 user nova-compute[71557]: WARNING nova.compute.manager [req-b0a87c0e-4fd0-4fb9-95a6-7f14b538ee86 req-48f39f52-aa61-4051-a590-b59f4a89b1b3 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received unexpected event network-vif-plugged-718755e4-0ae2-47c0-b5c9-630c5df1e840 for instance with vm_state active and task_state deleting.
Apr 12 10:38:16 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:38:16 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:38:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:38:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:38:16 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:38:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:38:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] <== connect_volume: return (1483ms) {'type': 'block', 'scsi_wwn': '23338373135396131', 'path': '/dev/sdb'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:38:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338373135396131', 'path': '/dev/sdb'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:38:16 user nova-compute[71557]: DEBUG nova.objects.instance [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lazy-loading 'flavor' on Instance uuid ea55f551-968e-4ece-a37a-c4128ce5e8cb {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:38:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:16 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Updating instance_info_cache with network_info: [{"id": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "address": "fa:16:3e:97:77:c8", "network": {"id": "4d3f7dc3-82bc-43ab-be83-29e8f16f99de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-970702209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce2a3bde13e464f8df0a41f30c240ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5c1f1e-a7", "ovs_interfaceid": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:38:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:38:16 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:38:16 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:38:16 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:38:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:17 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:38:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/893c42b2-83ed-4823-9698-2015a3ffd4c5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 136314880 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/893c42b2-83ed-4823-9698-2015a3ffd4c5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/893c42b2-83ed-4823-9698-2015a3ffd4c5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/893c42b2-83ed-4823-9698-2015a3ffd4c5/disk --force-share --output=json" returned: 0 in 0.323s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 287309824 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:18 user nova-compute[71557]: DEBUG nova.compute.manager [req-ff6ff546-89a0-4fb1-b93f-65aadba18a1e req-d91eda41-9f5c-48c5-94d1-7eb34f199453 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-deleted-1173b214-caa3-4d2b-9ee4-efe4ab063cac {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:18 user nova-compute[71557]: INFO nova.compute.manager [req-ff6ff546-89a0-4fb1-b93f-65aadba18a1e req-d91eda41-9f5c-48c5-94d1-7eb34f199453 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Neutron deleted interface 1173b214-caa3-4d2b-9ee4-efe4ab063cac; detaching it from the instance and deleting it from the info cache
Apr 12 10:38:18 user nova-compute[71557]: DEBUG nova.network.neutron [req-ff6ff546-89a0-4fb1-b93f-65aadba18a1e req-d91eda41-9f5c-48c5-94d1-7eb34f199453 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Updating instance_info_cache with network_info: [{"id": "fe31a29c-b57d-463d-98ba-6527848edeba", "address": "fa:16:3e:04:9a:84", "network": {"id": "487a3034-5a63-4896-a029-be581b719991", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-754944090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe31a29c-b5", "ovs_interfaceid": "fe31a29c-b57d-463d-98ba-6527848edeba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "address": "fa:16:3e:7f:41:2c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e2f100-f6", "ovs_interfaceid": "c5e2f100-f6a5-4f59-9e60-5eddd9d9d7f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "address": "fa:16:3e:b0:8e:21", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap307fee9a-af", "ovs_interfaceid": "307fee9a-af5f-45a9-b678-7cb16cfad99d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "925f7823-924b-4df5-8bec-5f065331e4fe", "address": "fa:16:3e:41:4d:9c", "network": {"id": "5c74f6a2-2fbf-4117-85df-6a7abb02577c", "bridge": "br-int", "label": "tempest-device-tagging-net1-93222513", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap925f7823-92", "ovs_interfaceid": "925f7823-924b-4df5-8bec-5f065331e4fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23c5dfaa-4003-410d-836e-4218b879cf66", "address": "fa:16:3e:49:60:f7", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c5dfaa-40", "ovs_interfaceid": "23c5dfaa-4003-410d-836e-4218b879cf66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "address": "fa:16:3e:d3:ce:bd", "network": {"id": "47aa3673-739f-40a5-90b5-9bdc59b7590c", "bridge": "br-int", "label": "tempest-device-tagging-net2-294744350", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1fcfbd94249342b2a436d2592e0dc9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap718755e4-0a", "ovs_interfaceid": "718755e4-0ae2-47c0-b5c9-630c5df1e840", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:38:18 user nova-compute[71557]: DEBUG nova.compute.manager [req-ff6ff546-89a0-4fb1-b93f-65aadba18a1e req-d91eda41-9f5c-48c5-94d1-7eb34f199453 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Detach interface failed, port_id=1173b214-caa3-4d2b-9ee4-efe4ab063cac, reason: Instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 could not be found. {{(pid=71557) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 10:38:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:18 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 471859200 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 607125504 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 768606208 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:19 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681295884.6231878, 3d261c30-0c6f-4d1b-8965-448dc019728e => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:38:19 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] VM Stopped (Lifecycle Event)
Apr 12 10:38:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:19 user nova-compute[71557]: DEBUG nova.compute.manager [None req-8e88eb4e-956b-4320-8242-55a08d763cf4 None None] [instance: 3d261c30-0c6f-4d1b-8965-448dc019728e] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:38:19 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:38:19 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Took 4.64 seconds to deallocate network for instance.
Apr 12 10:38:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 913309696 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:38:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:20 user nova-compute[71557]: DEBUG nova.compute.manager [req-9c90eacd-0d32-42e4-9f89-8d92dc85f9eb req-23183a6e-7a72-4e4a-b471-96fe0e441fc4 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-deleted-fe31a29c-b57d-463d-98ba-6527848edeba {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:20 user nova-compute[71557]: DEBUG nova.compute.manager [req-9c90eacd-0d32-42e4-9f89-8d92dc85f9eb req-23183a6e-7a72-4e4a-b471-96fe0e441fc4 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-deleted-925f7823-924b-4df5-8bec-5f065331e4fe {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:20 user nova-compute[71557]: DEBUG nova.compute.manager [req-9c90eacd-0d32-42e4-9f89-8d92dc85f9eb req-23183a6e-7a72-4e4a-b471-96fe0e441fc4 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-deleted-23c5dfaa-4003-410d-836e-4218b879cf66 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:20 user nova-compute[71557]: DEBUG nova.compute.manager [req-9c90eacd-0d32-42e4-9f89-8d92dc85f9eb req-23183a6e-7a72-4e4a-b471-96fe0e441fc4 service nova] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Received event network-vif-deleted-718755e4-0ae2-47c0-b5c9-630c5df1e840 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 1028653056 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:38:21 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:38:21 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:38:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=7855MB free_disk=26.498966217041016GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CYKBFxrG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '63298498-6bc0-47a0-b48e-815852c52771': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:38:21 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:38:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c7ec06-f3f6-48f2-83f4-2d6f37bee26f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:38:21 user nova-compute[71557]: No targets found.
Apr 12 10:38:21 user nova-compute[71557]: iSNS:
Apr 12 10:38:21 user nova-compute[71557]: No targets found.
Apr 12 10:38:21 user nova-compute[71557]: STATIC:
Apr 12 10:38:21 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771
Apr 12 10:38:21 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:21 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:21 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4
Apr 12 10:38:21 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:21 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:21 user nova-compute[71557]: FIRMWARE:
Apr 12 10:38:21 user nova-compute[71557]: No targets found.
Apr 12 10:38:21 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:38:21 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:38:21 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance f47d368e-3870-49d0-8522-a94991ec4ba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance dc6eb5d4-d415-4459-a95b-5a470ec66586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance d04cb526-f77a-457c-90b1-3e5c202c0c30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance ea55f551-968e-4ece-a37a-c4128ce5e8cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance f147b4ee-d130-41ae-a4db-bc248fb23266 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 893c42b2-83ed-4823-9698-2015a3ffd4c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[46271850-d6cb-4bca-bfcf-037c2091f6dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d01631-a49f-4bde-94b8-6cd446902889]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:38:21 user nova-compute[71557]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:38:21 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:38:21 user nova-compute[71557]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 (non-flash)
Apr 12 10:38:21 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd40c5000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771'): ({'sdf'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Removing single pathed devices sdf {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c927a3b6-4823-4168-bb44-e19aacf947d3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7851e5b8-e6d0-46ea-bf17-efffb881e074]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Flushing IO for device /dev/sdf {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7abeb6-538f-4eeb-90bc-c56c7e08d3fb]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1803e290-2334-45eb-9b3b-b7273f238ad1]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] SCSI volumes sdf have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d240e41-a4b6-48ec-904e-7f8fff84e291]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d10b447-2ec5-4271-acdd-034bc5c84749]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771, portal: 172.16.0.220,3260]
Apr 12 10:38:21 user nova-compute[71557]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771, portal: 172.16.0.220,3260] successful.
Apr 12 10:38:21 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63298498-6bc0-47a0-b48e-815852c52771 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[474883df-9e98-450e-816b-d8284effbd3b]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] <== disconnect_volume: return (306ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryHjCUZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ea55f551-968e-4ece-a37a-c4128ce5e8cb', 'attached_at': '', 'detached_at': '', 'volume_id': '2c1f53d0-46d5-4944-89d3-f0793ff3fbf4', 'serial'} {{(pid=71557) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] swap_volume: removing Cinder connection for volume 63298498-6bc0-47a0-b48e-815852c52771 {{(pid=71557) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:38:21 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:38:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] swap_volume: Updating volume 63298498-6bc0-47a0-b48e-815852c52771 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "ryHjCUZE", "auth_password": "xKaHjNRJebcFgV", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "2c1f53d0-46d5-4944-89d3-f0793ff3fbf4"}, "status": "reserved", "instance": "ea55f551-968e-4ece-a37a-c4128ce5e8cb", "attached_at": "", "detached_at": "", "volume_id": "2c1f53d0-46d5-4944-89d3-f0793ff3fbf4", "serial": "2c1f53d0-46d5-4944-89d3-f0793ff3fbf4"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '2c1f53d0-46d5-4944-89d3-f0793ff3fbf4', 'no_device': None, 'attachment_id': 'd75214cc-3380-48b9-aedc-4e66ce9905bb'} {{(pid=71557) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 12 10:38:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0fd5bf5a-fd94-4e73-bbdf-c767ba75d516 tempest-TestVolumeSwap-219534210 tempest-TestVolumeSwap-219534210-project-admin] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.979s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:23 user nova-compute[71557]: INFO nova.compute.manager [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Took 3.28 seconds to detach 3 volumes for instance.
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:23 user nova-compute[71557]: INFO nova.compute.manager [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Detaching volume 2c1f53d0-46d5-4944-89d3-f0793ff3fbf4
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:23 user nova-compute[71557]: INFO nova.virt.block_device [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Attempting to driver detach volume 2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 from mountpoint /dev/vdb
Apr 12 10:38:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Attempting to detach device vdb from instance ea55f551-968e-4ece-a37a-c4128ce5e8cb from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:38:23 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:38:23 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 10:38:23 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:38:23 user nova-compute[71557]:   <serial>2c1f53d0-46d5-4944-89d3-f0793ff3fbf4</serial>
Apr 12 10:38:23 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:38:23 user nova-compute[71557]: </disk>
Apr 12 10:38:23 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:38:23 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Successfully detached device vdb from instance ea55f551-968e-4ece-a37a-c4128ce5e8cb from the persistent domain config.
Apr 12 10:38:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ea55f551-968e-4ece-a37a-c4128ce5e8cb from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:38:23 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:38:23 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 10:38:23 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:38:23 user nova-compute[71557]:   <serial>2c1f53d0-46d5-4944-89d3-f0793ff3fbf4</serial>
Apr 12 10:38:23 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:38:23 user nova-compute[71557]: </disk>
Apr 12 10:38:23 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.167s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:38:23 user nova-compute[71557]: INFO nova.compute.claims [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Claim successful on node user
Apr 12 10:38:23 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Deleted allocations for instance b9fd76e3-c7ed-4631-b056-3bd13439f7d3
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b5592683-e1a5-43b2-b3d4-c31c157e2789 tempest-TaggedBootDevicesTest_v242-639083036 tempest-TaggedBootDevicesTest_v242-639083036-project-member] Lock "b9fd76e3-c7ed-4631-b056-3bd13439f7d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.749s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681295903.716563, ea55f551-968e-4ece-a37a-c4128ce5e8cb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ea55f551-968e-4ece-a37a-c4128ce5e8cb {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 10:38:23 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Successfully detached device vdb from instance ea55f551-968e-4ece-a37a-c4128ce5e8cb from the live domain config.
Apr 12 10:38:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryHjCUZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '2c1f53d0-46d5-4944-89d3-f0793ff3fbf4': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:38:23 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:38:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[498bf605-6f4d-4e83-b5c9-453cc71a34ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:38:23 user nova-compute[71557]: No targets found.
Apr 12 10:38:23 user nova-compute[71557]: iSNS:
Apr 12 10:38:23 user nova-compute[71557]: No targets found.
Apr 12 10:38:23 user nova-compute[71557]: STATIC:
Apr 12 10:38:23 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4
Apr 12 10:38:23 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:38:23 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:38:23 user nova-compute[71557]: FIRMWARE:
Apr 12 10:38:23 user nova-compute[71557]: No targets found.
Apr 12 10:38:23 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:38:23 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:38:23 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca666c59-9630-4a11-9262-78b692103bfd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a56ea6-bcc9-4019-98c4-d7466e537426]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:38:23 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 (non-flash)
Apr 12 10:38:23 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd40c69e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4'): ({'sdb'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Removing single pathed devices sdb {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[05888eaa-2f94-4eec-b036-67852c670c7a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae77636e-33d6-4fac-bee8-77a149dc52b2]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Flushing IO for device /dev/sdb {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ec7eb4-719c-4988-9b0a-39da6bffc29f]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6caab7b-c45a-4815-8506-92a9fa7fbbd6]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afc6668-ea20-4f81-a37f-51c66a72dd86]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:38:24 user nova-compute[71557]: DEBUG nova.network.neutron [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:38:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:24 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3088cbd6-898b-484e-9069-9d40125eac4d]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:24 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4, portal: 172.16.0.220,3260]
Apr 12 10:38:24 user nova-compute[71557]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4, portal: 172.16.0.220,3260] successful.
Apr 12 10:38:24 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1f53d0-46d5-4944-89d3-f0793ff3fbf4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:24 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9cfd1b-e592-4eda-96f5-41b9dc1e5f1e]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:24 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:24 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:38:24 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] <== disconnect_volume: return (309ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:38:24 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:38:24 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:38:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:38:24 user nova-compute[71557]: INFO nova.virt.block_device [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Booting with blank volume at /dev/vda
Apr 12 10:38:24 user nova-compute[71557]: DEBUG nova.policy [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:38:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:24 user nova-compute[71557]: DEBUG nova.network.neutron [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Successfully created port: 1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:38:24 user nova-compute[71557]: DEBUG nova.objects.instance [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lazy-loading 'flavor' on Instance uuid ea55f551-968e-4ece-a37a-c4128ce5e8cb {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:38:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-677314d9-319e-479c-8ff0-c38dd3277d99 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.782s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:26 user nova-compute[71557]: DEBUG nova.network.neutron [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Successfully updated port: 1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:38:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "refresh_cache-8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:38:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquired lock "refresh_cache-8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:38:26 user nova-compute[71557]: DEBUG nova.network.neutron [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:38:26 user nova-compute[71557]: DEBUG nova.compute.manager [req-187760c8-4421-4610-b026-b1f90f7ffbb4 req-5014965f-9ef6-4da2-a68e-7255c5adbab1 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received event network-changed-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:26 user nova-compute[71557]: DEBUG nova.compute.manager [req-187760c8-4421-4610-b026-b1f90f7ffbb4 req-5014965f-9ef6-4da2-a68e-7255c5adbab1 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Refreshing instance network info cache due to event network-changed-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:38:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-187760c8-4421-4610-b026-b1f90f7ffbb4 req-5014965f-9ef6-4da2-a68e-7255c5adbab1 service nova] Acquiring lock "refresh_cache-8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:38:26 user nova-compute[71557]: DEBUG nova.network.neutron [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:38:27 user nova-compute[71557]: DEBUG nova.network.neutron [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Updating instance_info_cache with network_info: [{"id": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "address": "fa:16:3e:e8:3f:f9", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e23fbbf-0b", "ovs_interfaceid": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:38:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Releasing lock "refresh_cache-8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:38:27 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Instance network_info: |[{"id": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "address": "fa:16:3e:e8:3f:f9", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e23fbbf-0b", "ovs_interfaceid": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:38:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-187760c8-4421-4610-b026-b1f90f7ffbb4 req-5014965f-9ef6-4da2-a68e-7255c5adbab1 service nova] Acquired lock "refresh_cache-8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:38:27 user nova-compute[71557]: DEBUG nova.network.neutron [req-187760c8-4421-4610-b026-b1f90f7ffbb4 req-5014965f-9ef6-4da2-a68e-7255c5adbab1 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Refreshing network info cache for port 1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:38:27 user nova-compute[71557]: DEBUG nova.network.neutron [req-187760c8-4421-4610-b026-b1f90f7ffbb4 req-5014965f-9ef6-4da2-a68e-7255c5adbab1 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Updated VIF entry in instance network info cache for port 1e23fbbf-0bbf-491b-b83b-b1e7067f91fb. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:38:27 user nova-compute[71557]: DEBUG nova.network.neutron [req-187760c8-4421-4610-b026-b1f90f7ffbb4 req-5014965f-9ef6-4da2-a68e-7255c5adbab1 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Updating instance_info_cache with network_info: [{"id": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "address": "fa:16:3e:e8:3f:f9", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e23fbbf-0b", "ovs_interfaceid": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:38:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-187760c8-4421-4610-b026-b1f90f7ffbb4 req-5014965f-9ef6-4da2-a68e-7255c5adbab1 service nova] Releasing lock "refresh_cache-8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:38:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:28 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681295893.787125, b9fd76e3-c7ed-4631-b056-3bd13439f7d3 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:38:28 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] VM Stopped (Lifecycle Event)
Apr 12 10:38:28 user nova-compute[71557]: DEBUG nova.compute.manager [None req-7bbf6cac-ea98-483b-9c51-29d73c8556ae None None] [instance: b9fd76e3-c7ed-4631-b056-3bd13439f7d3] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:38:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:29 user nova-compute[71557]: DEBUG os_brick.utils [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:38:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bf24b7-c106-4952-9c84-8675cfb082e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af16104-ec3b-4b9e-a648-e9fe421a86e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c89e06c-bb89-46ef-be29-1f7670093b5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd371da-8d66-423b-bb3f-daee7cb54f2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:38:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:38:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:38:29 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:38:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae8d981-f06a-4d66-9535-04bd4ec0f302]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:38:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:38:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:38:29 user nova-compute[71557]: DEBUG os_brick.utils [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:38:29 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Updating existing volume attachment record: 387b20c5-ca7c-4f0c-80ec-1d55f45c5e82 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:38:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:38:34 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Creating image(s)
Apr 12 10:38:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Did not create local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Ensure instance console log exists: /opt/stack/data/nova/instances/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Start _get_guest_xml network_info=[{"id": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "address": "fa:16:3e:e8:3f:f9", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e23fbbf-0b", "ovs_interfaceid": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': '387b20c5-ca7c-4f0c-80ec-1d55f45c5e82', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MomdaHlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212', 'attached_at': '', 'detached_at': '', 'volume_id': '8585bd8b-e5a9-4a52-84c2-194841fc5cd0', 'serial': '8585bd8b-e5a9-4a52-84c2-194841fc5cd0'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:38:34 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:38:34 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:38:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MomdaHlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:38:34 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:38:34 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:38:34 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5659ff71-f728-4000-b3ec-73776360026e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:38:34 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77aeaf6-008e-4de1-8d71-f436a789aec5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0] added
Apr 12 10:38:34 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb24f7d-5cda-44ac-9319-d2a2d79c63d7]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30bf272-8bac-405d-ae29-57d6c9158997]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MomdaHlQ {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MomdaHlQ" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfde524d-ede7-4876-9a4a-9915ecbcadf8]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MomdaHlQ'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83f2b02-acde-445f-9899-a0964d0ebdb7]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[124985a9-ab6f-42fb-9fff-cfbd1d5aca8d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 10:38:34 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 10:38:34 user nova-compute[71557]:  {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:38:34 user nova-compute[71557]: WARNING os_brick.initiator.connectors.iscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 10:38:34 user nova-compute[71557]: 
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e157ad-a977-491a-a07e-f4ecbf74d41c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0, portal: 172.16.0.220,3260]
Apr 12 10:38:34 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0, portal: 172.16.0.220,3260] successful.
Apr 12 10:38:34 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95f9db3-5f64-45b5-842a-08bf49c50e9b]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[957f719e-19fa-4266-9b17-bce5bd0928d7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:38:34 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:38:34 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.048s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af0b0e6-d408-4701-85a7-de2949dce39a]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:38:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MomdaHlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:38:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:38:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26139666438363264', 'path': '/dev/sdb'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:38:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139666438363264', 'path': '/dev/sdb'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:38:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1497116859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1497116859',id=14,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3789b59ccc704f86afac83af21fd84f9',ramdisk_id='',reservation_id='r-qmvf1fzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:38:24Z,user_data=None,user_id='ba49b947c74e48f3b161b6f9fce8b1c5',uuid=8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "address": "fa:16:3e:e8:3f:f9", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e23fbbf-0b", "ovs_interfaceid": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:38:35 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converting VIF {"id": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "address": "fa:16:3e:e8:3f:f9", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e23fbbf-0b", "ovs_interfaceid": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:38:35 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:3f:f9,bridge_name='br-int',has_traffic_filtering=True,id=1e23fbbf-0bbf-491b-b83b-b1e7067f91fb,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e23fbbf-0b') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:38:35 user nova-compute[71557]: DEBUG nova.objects.instance [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:38:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:38:35 user nova-compute[71557]:   <uuid>8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212</uuid>
Apr 12 10:38:35 user nova-compute[71557]:   <name>instance-0000000e</name>
Apr 12 10:38:35 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:38:35 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:38:35 user nova-compute[71557]:   <metadata>
Apr 12 10:38:35 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:38:35 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:38:35 user nova-compute[71557]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1497116859</nova:name>
Apr 12 10:38:35 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:38:34</nova:creationTime>
Apr 12 10:38:35 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:38:35 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:38:35 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:38:35 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:38:35 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:38:35 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:38:35 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:38:35 user nova-compute[71557]:       <nova:owner>
Apr 12 10:38:35 user nova-compute[71557]:         <nova:user uuid="ba49b947c74e48f3b161b6f9fce8b1c5">tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member</nova:user>
Apr 12 10:38:35 user nova-compute[71557]:         <nova:project uuid="3789b59ccc704f86afac83af21fd84f9">tempest-ServerBootFromVolumeStableRescueTest-1826285115</nova:project>
Apr 12 10:38:35 user nova-compute[71557]:       </nova:owner>
Apr 12 10:38:35 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:38:35 user nova-compute[71557]:       <nova:ports>
Apr 12 10:38:35 user nova-compute[71557]:         <nova:port uuid="1e23fbbf-0bbf-491b-b83b-b1e7067f91fb">
Apr 12 10:38:35 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 10:38:35 user nova-compute[71557]:         </nova:port>
Apr 12 10:38:35 user nova-compute[71557]:       </nova:ports>
Apr 12 10:38:35 user nova-compute[71557]:     </nova:instance>
Apr 12 10:38:35 user nova-compute[71557]:   </metadata>
Apr 12 10:38:35 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:38:35 user nova-compute[71557]:     <system>
Apr 12 10:38:35 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:38:35 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:38:35 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:38:35 user nova-compute[71557]:       <entry name="serial">8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212</entry>
Apr 12 10:38:35 user nova-compute[71557]:       <entry name="uuid">8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212</entry>
Apr 12 10:38:35 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:38:35 user nova-compute[71557]:     </system>
Apr 12 10:38:35 user nova-compute[71557]:   </sysinfo>
Apr 12 10:38:35 user nova-compute[71557]:   <os>
Apr 12 10:38:35 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:38:35 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:38:35 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:38:35 user nova-compute[71557]:   </os>
Apr 12 10:38:35 user nova-compute[71557]:   <features>
Apr 12 10:38:35 user nova-compute[71557]:     <acpi/>
Apr 12 10:38:35 user nova-compute[71557]:     <apic/>
Apr 12 10:38:35 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:38:35 user nova-compute[71557]:   </features>
Apr 12 10:38:35 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:38:35 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:38:35 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:38:35 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:38:35 user nova-compute[71557]:   </clock>
Apr 12 10:38:35 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:38:35 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:38:35 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:38:35 user nova-compute[71557]:   </cpu>
Apr 12 10:38:35 user nova-compute[71557]:   <devices>
Apr 12 10:38:35 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:38:35 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:38:35 user nova-compute[71557]:       <source dev="/dev/sdb"/>
Apr 12 10:38:35 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:38:35 user nova-compute[71557]:       <serial>8585bd8b-e5a9-4a52-84c2-194841fc5cd0</serial>
Apr 12 10:38:35 user nova-compute[71557]:     </disk>
Apr 12 10:38:35 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:38:35 user nova-compute[71557]:       <mac address="fa:16:3e:e8:3f:f9"/>
Apr 12 10:38:35 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:38:35 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:38:35 user nova-compute[71557]:       <target dev="tap1e23fbbf-0b"/>
Apr 12 10:38:35 user nova-compute[71557]:     </interface>
Apr 12 10:38:35 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:38:35 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212/console.log" append="off"/>
Apr 12 10:38:35 user nova-compute[71557]:     </serial>
Apr 12 10:38:35 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:38:35 user nova-compute[71557]:     <video>
Apr 12 10:38:35 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:38:35 user nova-compute[71557]:     </video>
Apr 12 10:38:35 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:38:35 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:38:35 user nova-compute[71557]:     </rng>
Apr 12 10:38:35 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:38:35 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:38:35 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:38:35 user nova-compute[71557]:     </memballoon>
Apr 12 10:38:35 user nova-compute[71557]:   </devices>
Apr 12 10:38:35 user nova-compute[71557]: </domain>
Apr 12 10:38:35 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:38:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1497116859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1497116859',id=14,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3789b59ccc704f86afac83af21fd84f9',ramdisk_id='',reservation_id='r-qmvf1fzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:38:24Z,user_data=None,user_id='ba49b947c74e48f3b161b6f9fce8b1c5',uuid=8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "address": "fa:16:3e:e8:3f:f9", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e23fbbf-0b", "ovs_interfaceid": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:38:35 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converting VIF {"id": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "address": "fa:16:3e:e8:3f:f9", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e23fbbf-0b", "ovs_interfaceid": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:38:35 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:3f:f9,bridge_name='br-int',has_traffic_filtering=True,id=1e23fbbf-0bbf-491b-b83b-b1e7067f91fb,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e23fbbf-0b') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:38:35 user nova-compute[71557]: DEBUG os_vif [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:3f:f9,bridge_name='br-int',has_traffic_filtering=True,id=1e23fbbf-0bbf-491b-b83b-b1e7067f91fb,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e23fbbf-0b') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:38:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:38:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:38:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e23fbbf-0b, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:38:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e23fbbf-0b, col_values=(('external_ids', {'iface-id': '1e23fbbf-0bbf-491b-b83b-b1e7067f91fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:3f:f9', 'vm-uuid': '8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:38:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:38:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:35 user nova-compute[71557]: INFO os_vif [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:3f:f9,bridge_name='br-int',has_traffic_filtering=True,id=1e23fbbf-0bbf-491b-b83b-b1e7067f91fb,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e23fbbf-0b')
Apr 12 10:38:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:38:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] No VIF found with MAC fa:16:3e:e8:3f:f9, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:38:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:37 user nova-compute[71557]: DEBUG nova.compute.manager [req-178fc40a-fc1a-404f-b950-cf90df0c6e99 req-b1c24c83-0cf4-4486-8a77-1a468fde6cb1 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received event network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-178fc40a-fc1a-404f-b950-cf90df0c6e99 req-b1c24c83-0cf4-4486-8a77-1a468fde6cb1 service nova] Acquiring lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-178fc40a-fc1a-404f-b950-cf90df0c6e99 req-b1c24c83-0cf4-4486-8a77-1a468fde6cb1 service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-178fc40a-fc1a-404f-b950-cf90df0c6e99 req-b1c24c83-0cf4-4486-8a77-1a468fde6cb1 service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:37 user nova-compute[71557]: DEBUG nova.compute.manager [req-178fc40a-fc1a-404f-b950-cf90df0c6e99 req-b1c24c83-0cf4-4486-8a77-1a468fde6cb1 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] No waiting events found dispatching network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:37 user nova-compute[71557]: WARNING nova.compute.manager [req-178fc40a-fc1a-404f-b950-cf90df0c6e99 req-b1c24c83-0cf4-4486-8a77-1a468fde6cb1 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received unexpected event network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance with vm_state building and task_state spawning.
Apr 12 10:38:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:39 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295919.4908085, 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:38:39 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] VM Resumed (Lifecycle Event)
Apr 12 10:38:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:38:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:38:39 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Instance spawned successfully.
Apr 12 10:38:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:38:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:38:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:38:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:39 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:38:39 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295919.4943192, 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:38:39 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] VM Started (Lifecycle Event)
Apr 12 10:38:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:38:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-bf6d224c-0170-47f2-82d8-4c39595b94bb req-6511488a-49b5-4f56-b5c3-f5a70c60d4ea service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received event network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bf6d224c-0170-47f2-82d8-4c39595b94bb req-6511488a-49b5-4f56-b5c3-f5a70c60d4ea service nova] Acquiring lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bf6d224c-0170-47f2-82d8-4c39595b94bb req-6511488a-49b5-4f56-b5c3-f5a70c60d4ea service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bf6d224c-0170-47f2-82d8-4c39595b94bb req-6511488a-49b5-4f56-b5c3-f5a70c60d4ea service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-bf6d224c-0170-47f2-82d8-4c39595b94bb req-6511488a-49b5-4f56-b5c3-f5a70c60d4ea service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] No waiting events found dispatching network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:39 user nova-compute[71557]: WARNING nova.compute.manager [req-bf6d224c-0170-47f2-82d8-4c39595b94bb req-6511488a-49b5-4f56-b5c3-f5a70c60d4ea service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received unexpected event network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance with vm_state building and task_state spawning.
Apr 12 10:38:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:38:39 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:38:39 user nova-compute[71557]: INFO nova.compute.manager [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Took 5.23 seconds to spawn the instance on the hypervisor.
Apr 12 10:38:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:38:39 user nova-compute[71557]: INFO nova.compute.manager [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Took 16.35 seconds to build instance.
Apr 12 10:38:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ad288639-6659-4da3-8b21-3a7ce65ef78b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.441s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "0bfafa79-ce40-42f1-9992-10e50734f7fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:38:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:38:41 user nova-compute[71557]: INFO nova.compute.claims [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Claim successful on node user
Apr 12 10:38:41 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:38:41 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:38:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:38:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:38:41 user nova-compute[71557]: DEBUG nova.network.neutron [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:38:41 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:38:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG nova.policy [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG nova.compute.manager [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:38:42 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Creating image(s)
Apr 12 10:38:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "/opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "/opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "/opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.140s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk 1073741824" returned: 0 in 0.049s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.143s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Cannot resize image /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG nova.objects.instance [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'migration_context' on Instance uuid 0bfafa79-ce40-42f1-9992-10e50734f7fa {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Ensure instance console log exists: /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:42 user nova-compute[71557]: DEBUG nova.network.neutron [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Successfully created port: 4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.network.neutron [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Successfully updated port: 4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "refresh_cache-0bfafa79-ce40-42f1-9992-10e50734f7fa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquired lock "refresh_cache-0bfafa79-ce40-42f1-9992-10e50734f7fa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.network.neutron [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-9532452b-a9a4-4860-a231-59af2f69e7ac req-2909a70d-3334-4c67-a07f-6232c1135d9c service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Received event network-changed-4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-9532452b-a9a4-4860-a231-59af2f69e7ac req-2909a70d-3334-4c67-a07f-6232c1135d9c service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Refreshing instance network info cache due to event network-changed-4de5a799-c343-4e41-88ef-ebaaa3adb14c. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9532452b-a9a4-4860-a231-59af2f69e7ac req-2909a70d-3334-4c67-a07f-6232c1135d9c service nova] Acquiring lock "refresh_cache-0bfafa79-ce40-42f1-9992-10e50734f7fa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.network.neutron [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.network.neutron [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Updating instance_info_cache with network_info: [{"id": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "address": "fa:16:3e:6e:34:b4", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de5a799-c3", "ovs_interfaceid": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Releasing lock "refresh_cache-0bfafa79-ce40-42f1-9992-10e50734f7fa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.compute.manager [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Instance network_info: |[{"id": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "address": "fa:16:3e:6e:34:b4", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de5a799-c3", "ovs_interfaceid": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9532452b-a9a4-4860-a231-59af2f69e7ac req-2909a70d-3334-4c67-a07f-6232c1135d9c service nova] Acquired lock "refresh_cache-0bfafa79-ce40-42f1-9992-10e50734f7fa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.network.neutron [req-9532452b-a9a4-4860-a231-59af2f69e7ac req-2909a70d-3334-4c67-a07f-6232c1135d9c service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Refreshing network info cache for port 4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Start _get_guest_xml network_info=[{"id": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "address": "fa:16:3e:6e:34:b4", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de5a799-c3", "ovs_interfaceid": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:38:43 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:38:43 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1310544900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1310544900',id=15,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2Hsku+9Gq6PQ4eKPx2NZhPKKREpcJhVPgOkrPIzB0Og0vZ9OIo/sOZ0cMVzynU//y1O/biJFt/UdsDmp+9Toxz6/qyq8KmOhnHzR0d1UhA1wltYPUXYdlGdBHjOrPUqw==',key_name='tempest-keypair-1823760254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af33ce0944194932b663c3b8aef9783d',ramdisk_id='',reservation_id='r-oeqsk990',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-603525697',owner_user_name='tempest-AttachVolumeShelveTestJSON-603525697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:38:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d6279f1ce94008a2898ade6f730b40',uuid=0bfafa79-ce40-42f1-9992-10e50734f7fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "address": "fa:16:3e:6e:34:b4", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de5a799-c3", "ovs_interfaceid": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converting VIF {"id": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "address": "fa:16:3e:6e:34:b4", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de5a799-c3", "ovs_interfaceid": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:34:b4,bridge_name='br-int',has_traffic_filtering=True,id=4de5a799-c343-4e41-88ef-ebaaa3adb14c,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4de5a799-c3') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.objects.instance [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bfafa79-ce40-42f1-9992-10e50734f7fa {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:38:43 user nova-compute[71557]:   <uuid>0bfafa79-ce40-42f1-9992-10e50734f7fa</uuid>
Apr 12 10:38:43 user nova-compute[71557]:   <name>instance-0000000f</name>
Apr 12 10:38:43 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:38:43 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:38:43 user nova-compute[71557]:   <metadata>
Apr 12 10:38:43 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:38:43 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:38:43 user nova-compute[71557]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1310544900</nova:name>
Apr 12 10:38:43 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:38:43</nova:creationTime>
Apr 12 10:38:43 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:38:43 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:38:43 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:38:43 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:38:43 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:38:43 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:38:43 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:38:43 user nova-compute[71557]:       <nova:owner>
Apr 12 10:38:43 user nova-compute[71557]:         <nova:user uuid="47d6279f1ce94008a2898ade6f730b40">tempest-AttachVolumeShelveTestJSON-603525697-project-member</nova:user>
Apr 12 10:38:43 user nova-compute[71557]:         <nova:project uuid="af33ce0944194932b663c3b8aef9783d">tempest-AttachVolumeShelveTestJSON-603525697</nova:project>
Apr 12 10:38:43 user nova-compute[71557]:       </nova:owner>
Apr 12 10:38:43 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:38:43 user nova-compute[71557]:       <nova:ports>
Apr 12 10:38:43 user nova-compute[71557]:         <nova:port uuid="4de5a799-c343-4e41-88ef-ebaaa3adb14c">
Apr 12 10:38:43 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 10:38:43 user nova-compute[71557]:         </nova:port>
Apr 12 10:38:43 user nova-compute[71557]:       </nova:ports>
Apr 12 10:38:43 user nova-compute[71557]:     </nova:instance>
Apr 12 10:38:43 user nova-compute[71557]:   </metadata>
Apr 12 10:38:43 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:38:43 user nova-compute[71557]:     <system>
Apr 12 10:38:43 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:38:43 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:38:43 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:38:43 user nova-compute[71557]:       <entry name="serial">0bfafa79-ce40-42f1-9992-10e50734f7fa</entry>
Apr 12 10:38:43 user nova-compute[71557]:       <entry name="uuid">0bfafa79-ce40-42f1-9992-10e50734f7fa</entry>
Apr 12 10:38:43 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:38:43 user nova-compute[71557]:     </system>
Apr 12 10:38:43 user nova-compute[71557]:   </sysinfo>
Apr 12 10:38:43 user nova-compute[71557]:   <os>
Apr 12 10:38:43 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:38:43 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:38:43 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:38:43 user nova-compute[71557]:   </os>
Apr 12 10:38:43 user nova-compute[71557]:   <features>
Apr 12 10:38:43 user nova-compute[71557]:     <acpi/>
Apr 12 10:38:43 user nova-compute[71557]:     <apic/>
Apr 12 10:38:43 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:38:43 user nova-compute[71557]:   </features>
Apr 12 10:38:43 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:38:43 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:38:43 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:38:43 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:38:43 user nova-compute[71557]:   </clock>
Apr 12 10:38:43 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:38:43 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:38:43 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:38:43 user nova-compute[71557]:   </cpu>
Apr 12 10:38:43 user nova-compute[71557]:   <devices>
Apr 12 10:38:43 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:38:43 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:38:43 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk"/>
Apr 12 10:38:43 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:38:43 user nova-compute[71557]:     </disk>
Apr 12 10:38:43 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:38:43 user nova-compute[71557]:       <mac address="fa:16:3e:6e:34:b4"/>
Apr 12 10:38:43 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:38:43 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:38:43 user nova-compute[71557]:       <target dev="tap4de5a799-c3"/>
Apr 12 10:38:43 user nova-compute[71557]:     </interface>
Apr 12 10:38:43 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:38:43 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/console.log" append="off"/>
Apr 12 10:38:43 user nova-compute[71557]:     </serial>
Apr 12 10:38:43 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:38:43 user nova-compute[71557]:     <video>
Apr 12 10:38:43 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:38:43 user nova-compute[71557]:     </video>
Apr 12 10:38:43 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:38:43 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:38:43 user nova-compute[71557]:     </rng>
Apr 12 10:38:43 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:38:43 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:38:43 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:38:43 user nova-compute[71557]:     </memballoon>
Apr 12 10:38:43 user nova-compute[71557]:   </devices>
Apr 12 10:38:43 user nova-compute[71557]: </domain>
Apr 12 10:38:43 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1310544900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1310544900',id=15,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2Hsku+9Gq6PQ4eKPx2NZhPKKREpcJhVPgOkrPIzB0Og0vZ9OIo/sOZ0cMVzynU//y1O/biJFt/UdsDmp+9Toxz6/qyq8KmOhnHzR0d1UhA1wltYPUXYdlGdBHjOrPUqw==',key_name='tempest-keypair-1823760254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af33ce0944194932b663c3b8aef9783d',ramdisk_id='',reservation_id='r-oeqsk990',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-603525697',owner_user_name='tempest-AttachVolumeShelveTestJSON-603525697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:38:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d6279f1ce94008a2898ade6f730b40',uuid=0bfafa79-ce40-42f1-9992-10e50734f7fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "address": "fa:16:3e:6e:34:b4", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de5a799-c3", "ovs_interfaceid": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converting VIF {"id": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "address": "fa:16:3e:6e:34:b4", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de5a799-c3", "ovs_interfaceid": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:34:b4,bridge_name='br-int',has_traffic_filtering=True,id=4de5a799-c343-4e41-88ef-ebaaa3adb14c,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4de5a799-c3') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG os_vif [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:34:b4,bridge_name='br-int',has_traffic_filtering=True,id=4de5a799-c343-4e41-88ef-ebaaa3adb14c,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4de5a799-c3') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4de5a799-c3, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4de5a799-c3, col_values=(('external_ids', {'iface-id': '4de5a799-c343-4e41-88ef-ebaaa3adb14c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:34:b4', 'vm-uuid': '0bfafa79-ce40-42f1-9992-10e50734f7fa'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:43 user nova-compute[71557]: INFO os_vif [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:34:b4,bridge_name='br-int',has_traffic_filtering=True,id=4de5a799-c343-4e41-88ef-ebaaa3adb14c,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4de5a799-c3')
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:38:43 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] No VIF found with MAC fa:16:3e:6e:34:b4, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:38:44 user nova-compute[71557]: DEBUG nova.network.neutron [req-9532452b-a9a4-4860-a231-59af2f69e7ac req-2909a70d-3334-4c67-a07f-6232c1135d9c service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Updated VIF entry in instance network info cache for port 4de5a799-c343-4e41-88ef-ebaaa3adb14c. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:38:44 user nova-compute[71557]: DEBUG nova.network.neutron [req-9532452b-a9a4-4860-a231-59af2f69e7ac req-2909a70d-3334-4c67-a07f-6232c1135d9c service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Updating instance_info_cache with network_info: [{"id": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "address": "fa:16:3e:6e:34:b4", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de5a799-c3", "ovs_interfaceid": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:38:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9532452b-a9a4-4860-a231-59af2f69e7ac req-2909a70d-3334-4c67-a07f-6232c1135d9c service nova] Releasing lock "refresh_cache-0bfafa79-ce40-42f1-9992-10e50734f7fa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:38:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "1c663163-6794-4c92-a401-5bc15d112c65" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "1c663163-6794-4c92-a401-5bc15d112c65" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:45 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:38:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:45 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:38:45 user nova-compute[71557]: INFO nova.compute.claims [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Claim successful on node user
Apr 12 10:38:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-e66e6b10-9b74-4c34-b5eb-101ac2703bbf req-0fce10c3-2ebb-4867-8e9f-a83a5cf88e25 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Received event network-vif-plugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e66e6b10-9b74-4c34-b5eb-101ac2703bbf req-0fce10c3-2ebb-4867-8e9f-a83a5cf88e25 service nova] Acquiring lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e66e6b10-9b74-4c34-b5eb-101ac2703bbf req-0fce10c3-2ebb-4867-8e9f-a83a5cf88e25 service nova] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e66e6b10-9b74-4c34-b5eb-101ac2703bbf req-0fce10c3-2ebb-4867-8e9f-a83a5cf88e25 service nova] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-e66e6b10-9b74-4c34-b5eb-101ac2703bbf req-0fce10c3-2ebb-4867-8e9f-a83a5cf88e25 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] No waiting events found dispatching network-vif-plugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:46 user nova-compute[71557]: WARNING nova.compute.manager [req-e66e6b10-9b74-4c34-b5eb-101ac2703bbf req-0fce10c3-2ebb-4867-8e9f-a83a5cf88e25 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Received unexpected event network-vif-plugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c for instance with vm_state building and task_state spawning.
Apr 12 10:38:46 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:38:46 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:38:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.609s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:38:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:38:46 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:38:46 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:38:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:38:46 user nova-compute[71557]: DEBUG nova.policy [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0a2243c6c9f431da846cc54ec181fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb8217b1544db384bebe1059848bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:38:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:38:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:38:46 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Creating image(s)
Apr 12 10:38:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c663163-6794-4c92-a401-5bc15d112c65/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "/opt/stack/data/nova/instances/1c663163-6794-4c92-a401-5bc15d112c65/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "/opt/stack/data/nova/instances/1c663163-6794-4c92-a401-5bc15d112c65/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/1c663163-6794-4c92-a401-5bc15d112c65/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/1c663163-6794-4c92-a401-5bc15d112c65/disk 1073741824" returned: 0 in 0.045s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c663163-6794-4c92-a401-5bc15d112c65/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c663163-6794-4c92-a401-5bc15d112c65/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Successfully created port: 6b5da29f-d5cb-4af2-ab48-c296b053e407 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c663163-6794-4c92-a401-5bc15d112c65/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Cannot resize image /opt/stack/data/nova/instances/1c663163-6794-4c92-a401-5bc15d112c65/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.objects.instance [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lazy-loading 'migration_context' on Instance uuid 1c663163-6794-4c92-a401-5bc15d112c65 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295927.3457139, 0bfafa79-ce40-42f1-9992-10e50734f7fa => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:38:47 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] VM Resumed (Lifecycle Event)
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.compute.manager [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Ensure instance console log exists: /opt/stack/data/nova/instances/1c663163-6794-4c92-a401-5bc15d112c65/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:47 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Instance spawned successfully.
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:47 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295927.3522584, 0bfafa79-ce40-42f1-9992-10e50734f7fa => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:38:47 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] VM Started (Lifecycle Event)
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:38:47 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:38:47 user nova-compute[71557]: INFO nova.compute.manager [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Took 5.44 seconds to spawn the instance on the hypervisor.
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.compute.manager [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:38:47 user nova-compute[71557]: INFO nova.compute.manager [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Took 6.14 seconds to build instance.
Apr 12 10:38:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-509eec14-8bce-481b-afd0-7936ca401b69 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.243s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Successfully updated port: 6b5da29f-d5cb-4af2-ab48-c296b053e407 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "refresh_cache-1c663163-6794-4c92-a401-5bc15d112c65" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquired lock "refresh_cache-1c663163-6794-4c92-a401-5bc15d112c65" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:38:47 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.compute.manager [req-e461fa58-f985-4c66-b4ef-9ec960a2331c req-d61c7662-b4c3-4dd1-882c-948da00ae53e service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Received event network-vif-plugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e461fa58-f985-4c66-b4ef-9ec960a2331c req-d61c7662-b4c3-4dd1-882c-948da00ae53e service nova] Acquiring lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e461fa58-f985-4c66-b4ef-9ec960a2331c req-d61c7662-b4c3-4dd1-882c-948da00ae53e service nova] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e461fa58-f985-4c66-b4ef-9ec960a2331c req-d61c7662-b4c3-4dd1-882c-948da00ae53e service nova] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.compute.manager [req-e461fa58-f985-4c66-b4ef-9ec960a2331c req-d61c7662-b4c3-4dd1-882c-948da00ae53e service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] No waiting events found dispatching network-vif-plugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:48 user nova-compute[71557]: WARNING nova.compute.manager [req-e461fa58-f985-4c66-b4ef-9ec960a2331c req-d61c7662-b4c3-4dd1-882c-948da00ae53e service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Received unexpected event network-vif-plugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c for instance with vm_state active and task_state None.
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.compute.manager [req-e461fa58-f985-4c66-b4ef-9ec960a2331c req-d61c7662-b4c3-4dd1-882c-948da00ae53e service nova] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Received event network-changed-6b5da29f-d5cb-4af2-ab48-c296b053e407 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.compute.manager [req-e461fa58-f985-4c66-b4ef-9ec960a2331c req-d61c7662-b4c3-4dd1-882c-948da00ae53e service nova] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Refreshing instance network info cache due to event network-changed-6b5da29f-d5cb-4af2-ab48-c296b053e407. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e461fa58-f985-4c66-b4ef-9ec960a2331c req-d61c7662-b4c3-4dd1-882c-948da00ae53e service nova] Acquiring lock "refresh_cache-1c663163-6794-4c92-a401-5bc15d112c65" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Updating instance_info_cache with network_info: [{"id": "6b5da29f-d5cb-4af2-ab48-c296b053e407", "address": "fa:16:3e:15:6b:44", "network": {"id": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-80273954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdb8217b1544db384bebe1059848bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5da29f-d5", "ovs_interfaceid": "6b5da29f-d5cb-4af2-ab48-c296b053e407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Releasing lock "refresh_cache-1c663163-6794-4c92-a401-5bc15d112c65" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Instance network_info: |[{"id": "6b5da29f-d5cb-4af2-ab48-c296b053e407", "address": "fa:16:3e:15:6b:44", "network": {"id": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-80273954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdb8217b1544db384bebe1059848bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5da29f-d5", "ovs_interfaceid": "6b5da29f-d5cb-4af2-ab48-c296b053e407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e461fa58-f985-4c66-b4ef-9ec960a2331c req-d61c7662-b4c3-4dd1-882c-948da00ae53e service nova] Acquired lock "refresh_cache-1c663163-6794-4c92-a401-5bc15d112c65" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.network.neutron [req-e461fa58-f985-4c66-b4ef-9ec960a2331c req-d61c7662-b4c3-4dd1-882c-948da00ae53e service nova] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Refreshing network info cache for port 6b5da29f-d5cb-4af2-ab48-c296b053e407 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Start _get_guest_xml network_info=[{"id": "6b5da29f-d5cb-4af2-ab48-c296b053e407", "address": "fa:16:3e:15:6b:44", "network": {"id": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-80273954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdb8217b1544db384bebe1059848bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5da29f-d5", "ovs_interfaceid": "6b5da29f-d5cb-4af2-ab48-c296b053e407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:38:48 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:38:48 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1187530573',display_name='tempest-VolumesAdminNegativeTest-server-1187530573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1187530573',id=16,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cdb8217b1544db384bebe1059848bb6',ramdisk_id='',reservation_id='r-prp4479s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-375460860',owner_user_name='tempest-VolumesAdminNegativeTest-375460860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:38:47Z,user_data=None,user_id='a0a2243c6c9f431da846cc54ec181fcc',uuid=1c663163-6794-4c92-a401-5bc15d112c65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b5da29f-d5cb-4af2-ab48-c296b053e407", "address": "fa:16:3e:15:6b:44", "network": {"id": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-80273954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdb8217b1544db384bebe1059848bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5da29f-d5", "ovs_interfaceid": "6b5da29f-d5cb-4af2-ab48-c296b053e407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Converting VIF {"id": "6b5da29f-d5cb-4af2-ab48-c296b053e407", "address": "fa:16:3e:15:6b:44", "network": {"id": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-80273954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdb8217b1544db384bebe1059848bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5da29f-d5", "ovs_interfaceid": "6b5da29f-d5cb-4af2-ab48-c296b053e407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:6b:44,bridge_name='br-int',has_traffic_filtering=True,id=6b5da29f-d5cb-4af2-ab48-c296b053e407,network=Network(66f6d7b6-8980-47a3-a7b6-f62db8264cd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5da29f-d5') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.objects.instance [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c663163-6794-4c92-a401-5bc15d112c65 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:38:48 user nova-compute[71557]:   <uuid>1c663163-6794-4c92-a401-5bc15d112c65</uuid>
Apr 12 10:38:48 user nova-compute[71557]:   <name>instance-00000010</name>
Apr 12 10:38:48 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:38:48 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:38:48 user nova-compute[71557]:   <metadata>
Apr 12 10:38:48 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:38:48 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:38:48 user nova-compute[71557]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1187530573</nova:name>
Apr 12 10:38:48 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:38:48</nova:creationTime>
Apr 12 10:38:48 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:38:48 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:38:48 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:38:48 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:38:48 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:38:48 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:38:48 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:38:48 user nova-compute[71557]:       <nova:owner>
Apr 12 10:38:48 user nova-compute[71557]:         <nova:user uuid="a0a2243c6c9f431da846cc54ec181fcc">tempest-VolumesAdminNegativeTest-375460860-project-member</nova:user>
Apr 12 10:38:48 user nova-compute[71557]:         <nova:project uuid="0cdb8217b1544db384bebe1059848bb6">tempest-VolumesAdminNegativeTest-375460860</nova:project>
Apr 12 10:38:48 user nova-compute[71557]:       </nova:owner>
Apr 12 10:38:48 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:38:48 user nova-compute[71557]:       <nova:ports>
Apr 12 10:38:48 user nova-compute[71557]:         <nova:port uuid="6b5da29f-d5cb-4af2-ab48-c296b053e407">
Apr 12 10:38:48 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 10:38:48 user nova-compute[71557]:         </nova:port>
Apr 12 10:38:48 user nova-compute[71557]:       </nova:ports>
Apr 12 10:38:48 user nova-compute[71557]:     </nova:instance>
Apr 12 10:38:48 user nova-compute[71557]:   </metadata>
Apr 12 10:38:48 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:38:48 user nova-compute[71557]:     <system>
Apr 12 10:38:48 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:38:48 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:38:48 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:38:48 user nova-compute[71557]:       <entry name="serial">1c663163-6794-4c92-a401-5bc15d112c65</entry>
Apr 12 10:38:48 user nova-compute[71557]:       <entry name="uuid">1c663163-6794-4c92-a401-5bc15d112c65</entry>
Apr 12 10:38:48 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:38:48 user nova-compute[71557]:     </system>
Apr 12 10:38:48 user nova-compute[71557]:   </sysinfo>
Apr 12 10:38:48 user nova-compute[71557]:   <os>
Apr 12 10:38:48 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:38:48 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:38:48 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:38:48 user nova-compute[71557]:   </os>
Apr 12 10:38:48 user nova-compute[71557]:   <features>
Apr 12 10:38:48 user nova-compute[71557]:     <acpi/>
Apr 12 10:38:48 user nova-compute[71557]:     <apic/>
Apr 12 10:38:48 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:38:48 user nova-compute[71557]:   </features>
Apr 12 10:38:48 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:38:48 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:38:48 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:38:48 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:38:48 user nova-compute[71557]:   </clock>
Apr 12 10:38:48 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:38:48 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:38:48 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:38:48 user nova-compute[71557]:   </cpu>
Apr 12 10:38:48 user nova-compute[71557]:   <devices>
Apr 12 10:38:48 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:38:48 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:38:48 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/1c663163-6794-4c92-a401-5bc15d112c65/disk"/>
Apr 12 10:38:48 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:38:48 user nova-compute[71557]:     </disk>
Apr 12 10:38:48 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:38:48 user nova-compute[71557]:       <mac address="fa:16:3e:15:6b:44"/>
Apr 12 10:38:48 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:38:48 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:38:48 user nova-compute[71557]:       <target dev="tap6b5da29f-d5"/>
Apr 12 10:38:48 user nova-compute[71557]:     </interface>
Apr 12 10:38:48 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:38:48 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/1c663163-6794-4c92-a401-5bc15d112c65/console.log" append="off"/>
Apr 12 10:38:48 user nova-compute[71557]:     </serial>
Apr 12 10:38:48 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:38:48 user nova-compute[71557]:     <video>
Apr 12 10:38:48 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:38:48 user nova-compute[71557]:     </video>
Apr 12 10:38:48 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:38:48 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:38:48 user nova-compute[71557]:     </rng>
Apr 12 10:38:48 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:38:48 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:38:48 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:38:48 user nova-compute[71557]:     </memballoon>
Apr 12 10:38:48 user nova-compute[71557]:   </devices>
Apr 12 10:38:48 user nova-compute[71557]: </domain>
Apr 12 10:38:48 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1187530573',display_name='tempest-VolumesAdminNegativeTest-server-1187530573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1187530573',id=16,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cdb8217b1544db384bebe1059848bb6',ramdisk_id='',reservation_id='r-prp4479s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-375460860',owner_user_name='tempest-VolumesAdminNegativeTest-375460860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:38:47Z,user_data=None,user_id='a0a2243c6c9f431da846cc54ec181fcc',uuid=1c663163-6794-4c92-a401-5bc15d112c65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b5da29f-d5cb-4af2-ab48-c296b053e407", "address": "fa:16:3e:15:6b:44", "network": {"id": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-80273954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdb8217b1544db384bebe1059848bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5da29f-d5", "ovs_interfaceid": "6b5da29f-d5cb-4af2-ab48-c296b053e407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Converting VIF {"id": "6b5da29f-d5cb-4af2-ab48-c296b053e407", "address": "fa:16:3e:15:6b:44", "network": {"id": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-80273954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdb8217b1544db384bebe1059848bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5da29f-d5", "ovs_interfaceid": "6b5da29f-d5cb-4af2-ab48-c296b053e407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:6b:44,bridge_name='br-int',has_traffic_filtering=True,id=6b5da29f-d5cb-4af2-ab48-c296b053e407,network=Network(66f6d7b6-8980-47a3-a7b6-f62db8264cd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5da29f-d5') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG os_vif [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:6b:44,bridge_name='br-int',has_traffic_filtering=True,id=6b5da29f-d5cb-4af2-ab48-c296b053e407,network=Network(66f6d7b6-8980-47a3-a7b6-f62db8264cd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5da29f-d5') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b5da29f-d5, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6b5da29f-d5, col_values=(('external_ids', {'iface-id': '6b5da29f-d5cb-4af2-ab48-c296b053e407', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:6b:44', 'vm-uuid': '1c663163-6794-4c92-a401-5bc15d112c65'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:48 user nova-compute[71557]: INFO os_vif [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:6b:44,bridge_name='br-int',has_traffic_filtering=True,id=6b5da29f-d5cb-4af2-ab48-c296b053e407,network=Network(66f6d7b6-8980-47a3-a7b6-f62db8264cd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5da29f-d5')
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] No VIF found with MAC fa:16:3e:15:6b:44, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.network.neutron [req-e461fa58-f985-4c66-b4ef-9ec960a2331c req-d61c7662-b4c3-4dd1-882c-948da00ae53e service nova] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Updated VIF entry in instance network info cache for port 6b5da29f-d5cb-4af2-ab48-c296b053e407. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG nova.network.neutron [req-e461fa58-f985-4c66-b4ef-9ec960a2331c req-d61c7662-b4c3-4dd1-882c-948da00ae53e service nova] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Updating instance_info_cache with network_info: [{"id": "6b5da29f-d5cb-4af2-ab48-c296b053e407", "address": "fa:16:3e:15:6b:44", "network": {"id": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-80273954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdb8217b1544db384bebe1059848bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5da29f-d5", "ovs_interfaceid": "6b5da29f-d5cb-4af2-ab48-c296b053e407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:38:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e461fa58-f985-4c66-b4ef-9ec960a2331c req-d61c7662-b4c3-4dd1-882c-948da00ae53e service nova] Releasing lock "refresh_cache-1c663163-6794-4c92-a401-5bc15d112c65" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:38:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:50 user nova-compute[71557]: DEBUG nova.compute.manager [req-6ac64dfd-2b30-47f9-8e4f-2cbcc7f2f8f9 req-2da8e2f7-7304-4aa1-9af8-3fdd7d414c57 service nova] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Received event network-vif-plugged-6b5da29f-d5cb-4af2-ab48-c296b053e407 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6ac64dfd-2b30-47f9-8e4f-2cbcc7f2f8f9 req-2da8e2f7-7304-4aa1-9af8-3fdd7d414c57 service nova] Acquiring lock "1c663163-6794-4c92-a401-5bc15d112c65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6ac64dfd-2b30-47f9-8e4f-2cbcc7f2f8f9 req-2da8e2f7-7304-4aa1-9af8-3fdd7d414c57 service nova] Lock "1c663163-6794-4c92-a401-5bc15d112c65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6ac64dfd-2b30-47f9-8e4f-2cbcc7f2f8f9 req-2da8e2f7-7304-4aa1-9af8-3fdd7d414c57 service nova] Lock "1c663163-6794-4c92-a401-5bc15d112c65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:50 user nova-compute[71557]: DEBUG nova.compute.manager [req-6ac64dfd-2b30-47f9-8e4f-2cbcc7f2f8f9 req-2da8e2f7-7304-4aa1-9af8-3fdd7d414c57 service nova] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] No waiting events found dispatching network-vif-plugged-6b5da29f-d5cb-4af2-ab48-c296b053e407 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:50 user nova-compute[71557]: WARNING nova.compute.manager [req-6ac64dfd-2b30-47f9-8e4f-2cbcc7f2f8f9 req-2da8e2f7-7304-4aa1-9af8-3fdd7d414c57 service nova] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Received unexpected event network-vif-plugged-6b5da29f-d5cb-4af2-ab48-c296b053e407 for instance with vm_state building and task_state spawning.
Apr 12 10:38:51 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295931.9380078, 1c663163-6794-4c92-a401-5bc15d112c65 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:38:51 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] VM Resumed (Lifecycle Event)
Apr 12 10:38:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:38:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:38:51 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Instance spawned successfully.
Apr 12 10:38:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:38:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:38:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:38:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:38:51 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:38:52 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295931.9392316, 1c663163-6794-4c92-a401-5bc15d112c65 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:38:52 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] VM Started (Lifecycle Event)
Apr 12 10:38:52 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:38:52 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:38:52 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:38:52 user nova-compute[71557]: INFO nova.compute.manager [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Took 5.35 seconds to spawn the instance on the hypervisor.
Apr 12 10:38:52 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:38:52 user nova-compute[71557]: INFO nova.compute.manager [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Took 6.26 seconds to build instance.
Apr 12 10:38:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5544efd-32eb-4e3f-83cd-872ae9d79f61 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "1c663163-6794-4c92-a401-5bc15d112c65" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.352s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:52 user nova-compute[71557]: DEBUG nova.compute.manager [req-2fb25d47-2dbe-4343-b685-143440076fe5 req-c86989e6-3302-401c-878a-d409fed2a724 service nova] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Received event network-vif-plugged-6b5da29f-d5cb-4af2-ab48-c296b053e407 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:38:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2fb25d47-2dbe-4343-b685-143440076fe5 req-c86989e6-3302-401c-878a-d409fed2a724 service nova] Acquiring lock "1c663163-6794-4c92-a401-5bc15d112c65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:38:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2fb25d47-2dbe-4343-b685-143440076fe5 req-c86989e6-3302-401c-878a-d409fed2a724 service nova] Lock "1c663163-6794-4c92-a401-5bc15d112c65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:38:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2fb25d47-2dbe-4343-b685-143440076fe5 req-c86989e6-3302-401c-878a-d409fed2a724 service nova] Lock "1c663163-6794-4c92-a401-5bc15d112c65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:38:52 user nova-compute[71557]: DEBUG nova.compute.manager [req-2fb25d47-2dbe-4343-b685-143440076fe5 req-c86989e6-3302-401c-878a-d409fed2a724 service nova] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] No waiting events found dispatching network-vif-plugged-6b5da29f-d5cb-4af2-ab48-c296b053e407 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:38:52 user nova-compute[71557]: WARNING nova.compute.manager [req-2fb25d47-2dbe-4343-b685-143440076fe5 req-c86989e6-3302-401c-878a-d409fed2a724 service nova] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Received unexpected event network-vif-plugged-6b5da29f-d5cb-4af2-ab48-c296b053e407 for instance with vm_state active and task_state None.
Apr 12 10:38:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:38:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:38:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 10:38:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:38:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:38:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "f147b4ee-d130-41ae-a4db-bc248fb23266" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:01 user nova-compute[71557]: INFO nova.compute.manager [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Terminating instance
Apr 12 10:39:01 user nova-compute[71557]: DEBUG nova.compute.manager [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:39:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:01 user nova-compute[71557]: DEBUG nova.compute.manager [req-59f812ed-922c-4a1d-9279-05653bbcedea req-cdd7a5a3-86aa-4823-9e5f-fc0c5dbc5410 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Received event network-vif-unplugged-96998164-acd9-4a18-b230-d63787eaf154 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-59f812ed-922c-4a1d-9279-05653bbcedea req-cdd7a5a3-86aa-4823-9e5f-fc0c5dbc5410 service nova] Acquiring lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-59f812ed-922c-4a1d-9279-05653bbcedea req-cdd7a5a3-86aa-4823-9e5f-fc0c5dbc5410 service nova] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-59f812ed-922c-4a1d-9279-05653bbcedea req-cdd7a5a3-86aa-4823-9e5f-fc0c5dbc5410 service nova] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:01 user nova-compute[71557]: DEBUG nova.compute.manager [req-59f812ed-922c-4a1d-9279-05653bbcedea req-cdd7a5a3-86aa-4823-9e5f-fc0c5dbc5410 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] No waiting events found dispatching network-vif-unplugged-96998164-acd9-4a18-b230-d63787eaf154 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:39:01 user nova-compute[71557]: DEBUG nova.compute.manager [req-59f812ed-922c-4a1d-9279-05653bbcedea req-cdd7a5a3-86aa-4823-9e5f-fc0c5dbc5410 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Received event network-vif-unplugged-96998164-acd9-4a18-b230-d63787eaf154 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:39:02 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Instance destroyed successfully.
Apr 12 10:39:02 user nova-compute[71557]: DEBUG nova.objects.instance [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lazy-loading 'resources' on Instance uuid f147b4ee-d130-41ae-a4db-bc248fb23266 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:39:02 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:36:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973136543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-973136543',id=10,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdimvfCdLuB4VkmLV8sKAN/mnwsyMwY8NOOti+AyTKIr7DOlGneUneWZujzSPReHJ3Bkx1IiksPqGfbsqao0C74w5qd657VSCv5dx2mJ7By8lLfjmYEB3fpEh2Gj0rqkQ==',key_name='tempest-keypair-1041772862',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:36:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6981486a29b64ee7b9ef7cbf2ca852be',ramdisk_id='',reservation_id='r-c2o3o5pa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2008645939',owner_user_name='tempest-TaggedAttachmentsTest-2008645939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='254d3560065c4d8a8aaf312870be2967',uuid=f147b4ee-d130-41ae-a4db-bc248fb23266,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96998164-acd9-4a18-b230-d63787eaf154", "address": "fa:16:3e:2e:44:60", "network": {"id": "4f4a6f13-7642-4157-ba75-be13336c456e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-673330570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96998164-ac", "ovs_interfaceid": "96998164-acd9-4a18-b230-d63787eaf154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:39:02 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Converting VIF {"id": "96998164-acd9-4a18-b230-d63787eaf154", "address": "fa:16:3e:2e:44:60", "network": {"id": "4f4a6f13-7642-4157-ba75-be13336c456e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-673330570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6981486a29b64ee7b9ef7cbf2ca852be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96998164-ac", "ovs_interfaceid": "96998164-acd9-4a18-b230-d63787eaf154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:39:02 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:44:60,bridge_name='br-int',has_traffic_filtering=True,id=96998164-acd9-4a18-b230-d63787eaf154,network=Network(4f4a6f13-7642-4157-ba75-be13336c456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96998164-ac') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:39:02 user nova-compute[71557]: DEBUG os_vif [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:44:60,bridge_name='br-int',has_traffic_filtering=True,id=96998164-acd9-4a18-b230-d63787eaf154,network=Network(4f4a6f13-7642-4157-ba75-be13336c456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96998164-ac') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:39:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96998164-ac, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:39:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:39:02 user nova-compute[71557]: INFO os_vif [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:44:60,bridge_name='br-int',has_traffic_filtering=True,id=96998164-acd9-4a18-b230-d63787eaf154,network=Network(4f4a6f13-7642-4157-ba75-be13336c456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96998164-ac')
Apr 12 10:39:02 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Deleting instance files /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266_del
Apr 12 10:39:02 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Deletion of /opt/stack/data/nova/instances/f147b4ee-d130-41ae-a4db-bc248fb23266_del complete
Apr 12 10:39:02 user nova-compute[71557]: INFO nova.compute.manager [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 10:39:02 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:39:02 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:39:02 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:39:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:03 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:39:03 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Took 0.88 seconds to deallocate network for instance.
Apr 12 10:39:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:03 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:39:03 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:39:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:03 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Deleted allocations for instance f147b4ee-d130-41ae-a4db-bc248fb23266
Apr 12 10:39:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-fe4dc5f6-e34b-477c-a90b-6102d277c0c5 tempest-TaggedAttachmentsTest-2008645939 tempest-TaggedAttachmentsTest-2008645939-project-member] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.378s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-2c026496-ed83-455f-82a8-47059884ceaf req-ae83b9e9-6659-4403-9fe4-d009fa88b5d1 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Received event network-vif-plugged-96998164-acd9-4a18-b230-d63787eaf154 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2c026496-ed83-455f-82a8-47059884ceaf req-ae83b9e9-6659-4403-9fe4-d009fa88b5d1 service nova] Acquiring lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2c026496-ed83-455f-82a8-47059884ceaf req-ae83b9e9-6659-4403-9fe4-d009fa88b5d1 service nova] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2c026496-ed83-455f-82a8-47059884ceaf req-ae83b9e9-6659-4403-9fe4-d009fa88b5d1 service nova] Lock "f147b4ee-d130-41ae-a4db-bc248fb23266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-2c026496-ed83-455f-82a8-47059884ceaf req-ae83b9e9-6659-4403-9fe4-d009fa88b5d1 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] No waiting events found dispatching network-vif-plugged-96998164-acd9-4a18-b230-d63787eaf154 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:39:04 user nova-compute[71557]: WARNING nova.compute.manager [req-2c026496-ed83-455f-82a8-47059884ceaf req-ae83b9e9-6659-4403-9fe4-d009fa88b5d1 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Received unexpected event network-vif-plugged-96998164-acd9-4a18-b230-d63787eaf154 for instance with vm_state deleted and task_state None.
Apr 12 10:39:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-2c026496-ed83-455f-82a8-47059884ceaf req-ae83b9e9-6659-4403-9fe4-d009fa88b5d1 service nova] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Received event network-vif-deleted-96998164-acd9-4a18-b230-d63787eaf154 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "f47d368e-3870-49d0-8522-a94991ec4ba5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:12 user nova-compute[71557]: DEBUG nova.objects.instance [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lazy-loading 'flavor' on Instance uuid f47d368e-3870-49d0-8522-a94991ec4ba5 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:39:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "f47d368e-3870-49d0-8522-a94991ec4ba5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:13 user nova-compute[71557]: INFO nova.compute.manager [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Attaching volume afb7485e-496d-4fb9-a5b1-613d21171666 to /dev/vdb
Apr 12 10:39:13 user nova-compute[71557]: DEBUG os_brick.utils [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0eea4b-c392-4214-b410-09fdcd79478e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95e1415-00a8-4634-8394-2b8e72551fd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[00761bf8-d396-49ab-9e79-7cc28acd2ed2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[860e741b-b64a-462f-bc2b-e5d5e4655320]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:39:13 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2571a560-bb17-4af2-b62d-722d6dd1b13f]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG os_brick.utils [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Updating existing volume attachment record: c35d98da-5046-46c2-a3a2-1191544d4506 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:13 user nova-compute[71557]: INFO nova.compute.manager [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Terminating instance
Apr 12 10:39:13 user nova-compute[71557]: DEBUG nova.compute.manager [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-898ecbc3-95a5-4417-a820-2f582ff61485 req-828bb410-dda9-457f-8563-8f3c7a52e451 service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Received event network-vif-unplugged-9d4bc0b7-4a2b-4354-a609-c673f6235cc7 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-898ecbc3-95a5-4417-a820-2f582ff61485 req-828bb410-dda9-457f-8563-8f3c7a52e451 service nova] Acquiring lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-898ecbc3-95a5-4417-a820-2f582ff61485 req-828bb410-dda9-457f-8563-8f3c7a52e451 service nova] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-898ecbc3-95a5-4417-a820-2f582ff61485 req-828bb410-dda9-457f-8563-8f3c7a52e451 service nova] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-898ecbc3-95a5-4417-a820-2f582ff61485 req-828bb410-dda9-457f-8563-8f3c7a52e451 service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] No waiting events found dispatching network-vif-unplugged-9d4bc0b7-4a2b-4354-a609-c673f6235cc7 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:39:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-898ecbc3-95a5-4417-a820-2f582ff61485 req-828bb410-dda9-457f-8563-8f3c7a52e451 service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Received event network-vif-unplugged-9d4bc0b7-4a2b-4354-a609-c673f6235cc7 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG nova.objects.instance [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'flavor' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:39:14 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Instance destroyed successfully.
Apr 12 10:39:14 user nova-compute[71557]: DEBUG nova.objects.instance [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lazy-loading 'resources' on Instance uuid ea55f551-968e-4ece-a37a-c4128ce5e8cb {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1772353252',display_name='tempest-TestVolumeSwap-server-1772353252',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1772353252',id=8,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjYthrvQaeO5iRkpOme8wd9BXslJ7+bH9c2pwqGtw4ONI6Nky7fjGEhK/7wi0cE/C4qW3/+u5Kcz2ZNhnlwfyEfLgpJZMopCh6eIMANDCmV2ciSVUgehPex6h7+lEIbHQ==',key_name='tempest-keypair-1030522827',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:36:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91b7b715cc24490ebd04d5469b6e07ce',ramdisk_id='',reservation_id='r-t4jzxex9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1349998885',owner_user_name='tempest-TestVolumeSwap-1349998885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80dbdeaccf84466286a6d85921e15a3f',uuid=ea55f551-968e-4ece-a37a-c4128ce5e8cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7", "address": "fa:16:3e:e1:68:2b", "network": {"id": "d823a4e6-ea4f-426a-8afe-49a806172180", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1926857283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91b7b715cc24490ebd04d5469b6e07ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d4bc0b7-4a", "ovs_interfaceid": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Converting VIF {"id": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7", "address": "fa:16:3e:e1:68:2b", "network": {"id": "d823a4e6-ea4f-426a-8afe-49a806172180", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1926857283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91b7b715cc24490ebd04d5469b6e07ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d4bc0b7-4a", "ovs_interfaceid": "9d4bc0b7-4a2b-4354-a609-c673f6235cc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:68:2b,bridge_name='br-int',has_traffic_filtering=True,id=9d4bc0b7-4a2b-4354-a609-c673f6235cc7,network=Network(d823a4e6-ea4f-426a-8afe-49a806172180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d4bc0b7-4a') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG os_vif [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:68:2b,bridge_name='br-int',has_traffic_filtering=True,id=9d4bc0b7-4a2b-4354-a609-c673f6235cc7,network=Network(d823a4e6-ea4f-426a-8afe-49a806172180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d4bc0b7-4a') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d4bc0b7-4a, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:39:14 user nova-compute[71557]: INFO os_vif [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:68:2b,bridge_name='br-int',has_traffic_filtering=True,id=9d4bc0b7-4a2b-4354-a609-c673f6235cc7,network=Network(d823a4e6-ea4f-426a-8afe-49a806172180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d4bc0b7-4a')
Apr 12 10:39:14 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Deleting instance files /opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb_del
Apr 12 10:39:14 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Deletion of /opt/stack/data/nova/instances/ea55f551-968e-4ece-a37a-c4128ce5e8cb_del complete
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "893c42b2-83ed-4823-9698-2015a3ffd4c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "893c42b2-83ed-4823-9698-2015a3ffd4c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "893c42b2-83ed-4823-9698-2015a3ffd4c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "893c42b2-83ed-4823-9698-2015a3ffd4c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "893c42b2-83ed-4823-9698-2015a3ffd4c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:14 user nova-compute[71557]: INFO nova.compute.manager [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Terminating instance
Apr 12 10:39:14 user nova-compute[71557]: DEBUG nova.compute.manager [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:39:14 user nova-compute[71557]: INFO nova.compute.manager [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Took 0.96 seconds to destroy the instance on the hypervisor.
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:14 user nova-compute[71557]: INFO nova.compute.manager [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Attaching volume 028bc65f-dc6d-4486-a99f-19a5ae874a93 to /dev/vdb
Apr 12 10:39:14 user nova-compute[71557]: DEBUG os_brick.utils [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[075174ef-0915-4fdd-9828-f1d4afeee55b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bad96ed-7481-4a11-8a79-3d6513d42fc4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-294c70f8-55d7-43f2-883b-92e528627e30 req-c37a8891-6368-4da4-8805-eb97439ab35a service nova] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Received event network-vif-unplugged-92cfa1bd-511c-4432-8b37-529eb34f8b21 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-294c70f8-55d7-43f2-883b-92e528627e30 req-c37a8891-6368-4da4-8805-eb97439ab35a service nova] Acquiring lock "893c42b2-83ed-4823-9698-2015a3ffd4c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-294c70f8-55d7-43f2-883b-92e528627e30 req-c37a8891-6368-4da4-8805-eb97439ab35a service nova] Lock "893c42b2-83ed-4823-9698-2015a3ffd4c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-294c70f8-55d7-43f2-883b-92e528627e30 req-c37a8891-6368-4da4-8805-eb97439ab35a service nova] Lock "893c42b2-83ed-4823-9698-2015a3ffd4c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-294c70f8-55d7-43f2-883b-92e528627e30 req-c37a8891-6368-4da4-8805-eb97439ab35a service nova] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] No waiting events found dispatching network-vif-unplugged-92cfa1bd-511c-4432-8b37-529eb34f8b21 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-294c70f8-55d7-43f2-883b-92e528627e30 req-c37a8891-6368-4da4-8805-eb97439ab35a service nova] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Received event network-vif-unplugged-92cfa1bd-511c-4432-8b37-529eb34f8b21 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cbeb95-0105-4fc5-a6a9-352c0909063e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c8f5ba-e966-4810-9724-ad0cddb3c78b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:39:14 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:39:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed596b9-6e58-43af-8710-679f0c96cbe0]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG os_brick.utils [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Updating existing volume attachment record: 6b8baac0-d2bf-4425-bfcd-dbbc93107c43 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:39:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:15 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Instance destroyed successfully.
Apr 12 10:39:15 user nova-compute[71557]: DEBUG nova.objects.instance [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lazy-loading 'resources' on Instance uuid 893c42b2-83ed-4823-9698-2015a3ffd4c5 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:39:15 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-59410143',display_name='tempest-ServersNegativeTestJSON-server-59410143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-59410143',id=12,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:37:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='024682bfda5548b8b9b404c85dd55b34',ramdisk_id='',reservation_id='r-47yjd5e4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-563292074',owner_user_name='tempest-ServersNegativeTestJSON-563292074-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:37:31Z,user_data=None,user_id='33d19bfc4894401cb664521438338b9a',uuid=893c42b2-83ed-4823-9698-2015a3ffd4c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92cfa1bd-511c-4432-8b37-529eb34f8b21", "address": "fa:16:3e:f4:27:5b", "network": {"id": "092e35b9-633d-403b-a777-df3e8c018327", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667523639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "024682bfda5548b8b9b404c85dd55b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92cfa1bd-51", "ovs_interfaceid": "92cfa1bd-511c-4432-8b37-529eb34f8b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:39:15 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Converting VIF {"id": "92cfa1bd-511c-4432-8b37-529eb34f8b21", "address": "fa:16:3e:f4:27:5b", "network": {"id": "092e35b9-633d-403b-a777-df3e8c018327", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667523639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "024682bfda5548b8b9b404c85dd55b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92cfa1bd-51", "ovs_interfaceid": "92cfa1bd-511c-4432-8b37-529eb34f8b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:39:15 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:27:5b,bridge_name='br-int',has_traffic_filtering=True,id=92cfa1bd-511c-4432-8b37-529eb34f8b21,network=Network(092e35b9-633d-403b-a777-df3e8c018327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92cfa1bd-51') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:39:15 user nova-compute[71557]: DEBUG os_vif [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:27:5b,bridge_name='br-int',has_traffic_filtering=True,id=92cfa1bd-511c-4432-8b37-529eb34f8b21,network=Network(092e35b9-633d-403b-a777-df3e8c018327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92cfa1bd-51') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:39:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92cfa1bd-51, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:39:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:15 user nova-compute[71557]: INFO os_vif [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:27:5b,bridge_name='br-int',has_traffic_filtering=True,id=92cfa1bd-511c-4432-8b37-529eb34f8b21,network=Network(092e35b9-633d-403b-a777-df3e8c018327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92cfa1bd-51')
Apr 12 10:39:15 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Deleting instance files /opt/stack/data/nova/instances/893c42b2-83ed-4823-9698-2015a3ffd4c5_del
Apr 12 10:39:15 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Deletion of /opt/stack/data/nova/instances/893c42b2-83ed-4823-9698-2015a3ffd4c5_del complete
Apr 12 10:39:15 user nova-compute[71557]: INFO nova.compute.manager [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Took 0.70 seconds to destroy the instance on the hypervisor.
Apr 12 10:39:15 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:39:15 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:39:15 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:39:15 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:39:15 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Took 0.50 seconds to deallocate network for instance.
Apr 12 10:39:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-51855656-5cbf-4dce-90ad-96283b6158f1 req-3f460c1c-1662-496a-a0f2-21f019de6695 service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Received event network-vif-plugged-9d4bc0b7-4a2b-4354-a609-c673f6235cc7 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-51855656-5cbf-4dce-90ad-96283b6158f1 req-3f460c1c-1662-496a-a0f2-21f019de6695 service nova] Acquiring lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-51855656-5cbf-4dce-90ad-96283b6158f1 req-3f460c1c-1662-496a-a0f2-21f019de6695 service nova] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-51855656-5cbf-4dce-90ad-96283b6158f1 req-3f460c1c-1662-496a-a0f2-21f019de6695 service nova] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-51855656-5cbf-4dce-90ad-96283b6158f1 req-3f460c1c-1662-496a-a0f2-21f019de6695 service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] No waiting events found dispatching network-vif-plugged-9d4bc0b7-4a2b-4354-a609-c673f6235cc7 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:39:16 user nova-compute[71557]: WARNING nova.compute.manager [req-51855656-5cbf-4dce-90ad-96283b6158f1 req-3f460c1c-1662-496a-a0f2-21f019de6695 service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Received unexpected event network-vif-plugged-9d4bc0b7-4a2b-4354-a609-c673f6235cc7 for instance with vm_state active and task_state deleting.
Apr 12 10:39:16 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:39:16 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:39:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:16 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Deleted allocations for instance 893c42b2-83ed-4823-9698-2015a3ffd4c5
Apr 12 10:39:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-767da586-dd40-4689-913f-d47f41254815 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "893c42b2-83ed-4823-9698-2015a3ffd4c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.878s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:16 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:39:16 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Took 1.91 seconds to deallocate network for instance.
Apr 12 10:39:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-3e30dd2a-9f48-488d-b8fd-9e8933f1876d req-4489cf82-3ba4-4eb6-b469-1b01774f0660 service nova] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Received event network-vif-deleted-9d4bc0b7-4a2b-4354-a609-c673f6235cc7 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:16 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:39:16 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:39:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-f7833003-8d16-450e-aea6-c8d5bafaf50e req-b862ce14-5203-4a1a-888a-31c84ec93df0 service nova] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Received event network-vif-plugged-92cfa1bd-511c-4432-8b37-529eb34f8b21 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f7833003-8d16-450e-aea6-c8d5bafaf50e req-b862ce14-5203-4a1a-888a-31c84ec93df0 service nova] Acquiring lock "893c42b2-83ed-4823-9698-2015a3ffd4c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f7833003-8d16-450e-aea6-c8d5bafaf50e req-b862ce14-5203-4a1a-888a-31c84ec93df0 service nova] Lock "893c42b2-83ed-4823-9698-2015a3ffd4c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f7833003-8d16-450e-aea6-c8d5bafaf50e req-b862ce14-5203-4a1a-888a-31c84ec93df0 service nova] Lock "893c42b2-83ed-4823-9698-2015a3ffd4c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-f7833003-8d16-450e-aea6-c8d5bafaf50e req-b862ce14-5203-4a1a-888a-31c84ec93df0 service nova] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] No waiting events found dispatching network-vif-plugged-92cfa1bd-511c-4432-8b37-529eb34f8b21 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:39:16 user nova-compute[71557]: WARNING nova.compute.manager [req-f7833003-8d16-450e-aea6-c8d5bafaf50e req-b862ce14-5203-4a1a-888a-31c84ec93df0 service nova] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Received unexpected event network-vif-plugged-92cfa1bd-511c-4432-8b37-529eb34f8b21 for instance with vm_state deleted and task_state None.
Apr 12 10:39:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-f7833003-8d16-450e-aea6-c8d5bafaf50e req-b862ce14-5203-4a1a-888a-31c84ec93df0 service nova] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Received event network-vif-deleted-92cfa1bd-511c-4432-8b37-529eb34f8b21 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:16 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Deleted allocations for instance ea55f551-968e-4ece-a37a-c4128ce5e8cb
Apr 12 10:39:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d614732d-d88b-408a-bc6a-9a4cd3486500 tempest-TestVolumeSwap-1349998885 tempest-TestVolumeSwap-1349998885-project-member] Lock "ea55f551-968e-4ece-a37a-c4128ce5e8cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.532s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:17 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:39:17 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:39:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:39:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:39:17 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:39:17 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681295942.402804, f147b4ee-d130-41ae-a4db-bc248fb23266 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:39:17 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] VM Stopped (Lifecycle Event)
Apr 12 10:39:17 user nova-compute[71557]: DEBUG nova.compute.manager [None req-469fc586-a07c-4b9d-b67c-b5683eb904b7 None None] [instance: f147b4ee-d130-41ae-a4db-bc248fb23266] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:39:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Updating instance_info_cache with network_info: [{"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IliQbaxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:39:18 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:39:18 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:39:18 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b41dd32-94e8-4ad4-a7b7-53638e2d46d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:39:18 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c663163-6794-4c92-a401-5bc15d112c65/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9653f773-e8f3-4b80-a270-bedecd65bfc5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666] added
Apr 12 10:39:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a57cfa0-87fe-46e5-b37f-336bd36e06dd]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21128e8-03a2-4d70-93d1-2cc52e21227d]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IliQbaxz {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IliQbaxz" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[510392fe-0403-4e26-bbda-61f59cc958a5]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IliQbaxz'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde0e022-ff05-4765-b3b2-6368e669dbbb]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c663163-6794-4c92-a401-5bc15d112c65/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c663163-6794-4c92-a401-5bc15d112c65/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b75d01-d4c2-428d-9779-30b2072f2020]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a125c0-5527-47c8-b138-76e15326935d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666, portal: 172.16.0.220,3260]
Apr 12 10:39:18 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666, portal: 172.16.0.220,3260] successful.
Apr 12 10:39:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbd4402-49c0-4351-9580-f0128d4f1b70]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5eee1d-bc67-46a1-96b3-03a6781965fa]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:18 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:18 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c663163-6794-4c92-a401-5bc15d112c65/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[296480b8-97bf-4c97-b4dd-f6897e20b23d]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:39:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IliQbaxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:39:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:39:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCjTdIwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:39:19 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:39:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:39:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '26263396139636332', 'path': '/dev/sdc'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263396139636332', 'path': '/dev/sdc'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.515s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:39:20 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:39:20 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG nova.objects.instance [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lazy-loading 'flavor' on Instance uuid f47d368e-3870-49d0-8522-a94991ec4ba5 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab66df04-1046-44ac-9942-7f8d85a96eb5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:39:20 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 10:39:20 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:39:20 user nova-compute[71557]:   <source dev="/dev/sdc"/>
Apr 12 10:39:20 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:39:20 user nova-compute[71557]:   <serial>afb7485e-496d-4fb9-a5b1-613d21171666</serial>
Apr 12 10:39:20 user nova-compute[71557]: </disk>
Apr 12 10:39:20 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[318dbdf8-fe80-4eb7-b7ae-ddffa8432aec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93] added
Apr 12 10:39:20 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[acae89c2-400a-45c4-8ad3-78d4292846f4]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb09953c-c3ea-428e-ba90-c59a0614feb0]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SCjTdIwL {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SCjTdIwL" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[93db7514-b3cb-47f3-9f52-7b5282bca262]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SCjTdIwL'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b851570-fde3-4064-830b-d2a6987e0ba5]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c851ce-d37c-44e5-90ba-4cabe00f1390]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:20 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:20 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:20 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:20 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8800f43-9aca-4ce2-a66e-317b12dacf27]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93, portal: 172.16.0.220,3260]
Apr 12 10:39:20 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93, portal: 172.16.0.220,3260] successful.
Apr 12 10:39:20 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a8a2db-4b99-4a93-97e9-83076c196286]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[13df5baa-b413-4c27-bbf9-80fab0ab972e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:20 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:20 user nova-compute[71557]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:39:20 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:20 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:20 user nova-compute[71557]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:39:20 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0998442a-b484-41a8-b71c-d2404996f4b6]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCjTdIwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] No VIF found with MAC fa:16:3e:97:77:c8, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c195ec3c-821f-46c6-95c1-3e02a51b5b61 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.585s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:39:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.543s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:39:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] <== connect_volume: return (2058ms) {'type': 'block', 'scsi_wwn': '26461383863613636', 'path': '/dev/sdd'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:39:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461383863613636', 'path': '/dev/sdd'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:39:21 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:39:21 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:39:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=7801MB free_disk=26.499786376953125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:39:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:21 user nova-compute[71557]: DEBUG nova.objects.instance [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'flavor' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:39:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 10:39:21 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:39:21 user nova-compute[71557]:   <source dev="/dev/sdd"/>
Apr 12 10:39:21 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:39:21 user nova-compute[71557]:   <serial>028bc65f-dc6d-4486-a99f-19a5ae874a93</serial>
Apr 12 10:39:21 user nova-compute[71557]: </disk>
Apr 12 10:39:21 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 10:39:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:39:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance f47d368e-3870-49d0-8522-a94991ec4ba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:39:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:39:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance dc6eb5d4-d415-4459-a95b-5a470ec66586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:39:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance d04cb526-f77a-457c-90b1-3e5c202c0c30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:39:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:39:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:39:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0bfafa79-ce40-42f1-9992-10e50734f7fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:39:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 1c663163-6794-4c92-a401-5bc15d112c65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:39:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:39:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:39:22 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:39:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:39:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:39:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] No VIF found with MAC fa:16:3e:fe:65:45, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:39:22 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:39:22 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:39:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.530s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ab645ab4-96dc-4484-88b7-8c2821a46902 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.548s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:22 user nova-compute[71557]: INFO nova.compute.manager [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Rescuing
Apr 12 10:39:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:39:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquired lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:39:22 user nova-compute[71557]: DEBUG nova.network.neutron [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG nova.network.neutron [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Updating instance_info_cache with network_info: [{"id": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "address": "fa:16:3e:97:77:c8", "network": {"id": "4d3f7dc3-82bc-43ab-be83-29e8f16f99de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-970702209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce2a3bde13e464f8df0a41f30c240ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5c1f1e-a7", "ovs_interfaceid": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Releasing lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:23 user nova-compute[71557]: INFO nova.compute.manager [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Rebuilding instance
Apr 12 10:39:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG nova.objects.instance [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'trusted_certs' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG nova.objects.instance [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'pci_requests' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG nova.objects.instance [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'pci_devices' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG nova.objects.instance [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'resources' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-a22f893c-c8a9-40a0-b585-ae24bbfe97ee req-6085d870-b7c6-41bc-b396-d1532e8508ce service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received event network-vif-unplugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a22f893c-c8a9-40a0-b585-ae24bbfe97ee req-6085d870-b7c6-41bc-b396-d1532e8508ce service nova] Acquiring lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a22f893c-c8a9-40a0-b585-ae24bbfe97ee req-6085d870-b7c6-41bc-b396-d1532e8508ce service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a22f893c-c8a9-40a0-b585-ae24bbfe97ee req-6085d870-b7c6-41bc-b396-d1532e8508ce service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-a22f893c-c8a9-40a0-b585-ae24bbfe97ee req-6085d870-b7c6-41bc-b396-d1532e8508ce service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] No waiting events found dispatching network-vif-unplugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:39:23 user nova-compute[71557]: WARNING nova.compute.manager [req-a22f893c-c8a9-40a0-b585-ae24bbfe97ee req-6085d870-b7c6-41bc-b396-d1532e8508ce service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received unexpected event network-vif-unplugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance with vm_state active and task_state rescuing.
Apr 12 10:39:23 user nova-compute[71557]: DEBUG nova.objects.instance [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'migration_context' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG nova.objects.instance [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71557) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:24 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Instance destroyed successfully.
Apr 12 10:39:24 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Attempting a stable device rescue
Apr 12 10:39:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:24 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Instance destroyed successfully.
Apr 12 10:39:24 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71557) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 10:39:24 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Instance directory exists: not creating {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 10:39:24 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Creating image(s)
Apr 12 10:39:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "/opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "/opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "/opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:24 user nova-compute[71557]: DEBUG nova.objects.instance [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lazy-loading 'trusted_certs' on Instance uuid f47d368e-3870-49d0-8522-a94991ec4ba5 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:39:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "384e50488245ee285329d7957751c37bf2ed8cb7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "384e50488245ee285329d7957751c37bf2ed8cb7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/384e50488245ee285329d7957751c37bf2ed8cb7.part --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:25 user nova-compute[71557]: INFO nova.compute.manager [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Detaching volume 028bc65f-dc6d-4486-a99f-19a5ae874a93
Apr 12 10:39:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received event network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Acquiring lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] No waiting events found dispatching network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:39:25 user nova-compute[71557]: WARNING nova.compute.manager [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received unexpected event network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance with vm_state active and task_state rescuing.
Apr 12 10:39:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-vif-unplugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] No waiting events found dispatching network-vif-unplugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:39:25 user nova-compute[71557]: WARNING nova.compute.manager [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received unexpected event network-vif-unplugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance with vm_state active and task_state rebuilding.
Apr 12 10:39:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] No waiting events found dispatching network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:39:25 user nova-compute[71557]: WARNING nova.compute.manager [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received unexpected event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance with vm_state active and task_state rebuilding.
Apr 12 10:39:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] No waiting events found dispatching network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:39:25 user nova-compute[71557]: WARNING nova.compute.manager [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received unexpected event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance with vm_state active and task_state rebuilding.
Apr 12 10:39:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] No waiting events found dispatching network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:39:25 user nova-compute[71557]: WARNING nova.compute.manager [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received unexpected event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance with vm_state active and task_state rebuilding.
Apr 12 10:39:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-vif-unplugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] No waiting events found dispatching network-vif-unplugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:39:25 user nova-compute[71557]: WARNING nova.compute.manager [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received unexpected event network-vif-unplugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance with vm_state active and task_state rebuilding.
Apr 12 10:39:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] No waiting events found dispatching network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:39:25 user nova-compute[71557]: WARNING nova.compute.manager [req-2a44009b-4f19-4acd-bb4e-e452719ca4ab req-19ea066e-ae24-41ea-a2d9-ea185f595161 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received unexpected event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance with vm_state active and task_state rebuilding.
Apr 12 10:39:25 user nova-compute[71557]: INFO nova.virt.block_device [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Attempting to driver detach volume 028bc65f-dc6d-4486-a99f-19a5ae874a93 from mountpoint /dev/vdb
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/384e50488245ee285329d7957751c37bf2ed8cb7.part --force-share --output=json" returned: 0 in 0.197s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG nova.virt.images [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] f4fcf2fb-8011-4377-96b3-cd19c43f5545 was qcow2, converting to raw {{(pid=71557) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG nova.privsep.utils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71557) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/384e50488245ee285329d7957751c37bf2ed8cb7.part /opt/stack/data/nova/instances/_base/384e50488245ee285329d7957751c37bf2ed8cb7.converted {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Attempting to detach device vdb from instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:39:25 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:39:25 user nova-compute[71557]:   <source dev="/dev/sdd"/>
Apr 12 10:39:25 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:39:25 user nova-compute[71557]:   <serial>028bc65f-dc6d-4486-a99f-19a5ae874a93</serial>
Apr 12 10:39:25 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:39:25 user nova-compute[71557]: </disk>
Apr 12 10:39:25 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:39:25 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Successfully detached device vdb from instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b from the persistent domain config.
Apr 12 10:39:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCjTdIwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:39:25 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 10:39:25 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.069s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4a4707-a20e-407f-a409-f823c21937c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:39:25 user nova-compute[71557]: No targets found.
Apr 12 10:39:25 user nova-compute[71557]: iSNS:
Apr 12 10:39:25 user nova-compute[71557]: No targets found.
Apr 12 10:39:25 user nova-compute[71557]: STATIC:
Apr 12 10:39:25 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:39:25 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:39:25 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:39:25 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93
Apr 12 10:39:25 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:39:25 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:39:25 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666
Apr 12 10:39:25 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:39:25 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:39:25 user nova-compute[71557]: FIRMWARE:
Apr 12 10:39:25 user nova-compute[71557]: No targets found.
Apr 12 10:39:25 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:39:25 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:39:25 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7090e5-1bdf-43d6-adaa-8e7e1cd10f8d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78fb5d5-04ab-4a5c-85e0-29546c5b1385]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:25 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:25 user nova-compute[71557]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:39:25 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:25 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:25 user nova-compute[71557]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:39:25 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fe1121e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93'): ({'sdd'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Removing single pathed devices sdd {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/384e50488245ee285329d7957751c37bf2ed8cb7.part /opt/stack/data/nova/instances/_base/384e50488245ee285329d7957751c37bf2ed8cb7.converted" returned: 0 in 0.244s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/384e50488245ee285329d7957751c37bf2ed8cb7.converted --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[21151b49-7ce2-4718-b1ac-a1f74a344cdf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e06fdcf-cb19-44ec-bfd3-feca24d15662]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flushing IO for device /dev/sdd {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0c7690-8391-4bff-89a0-195555f35020]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7637f2d1-45ba-4600-b559-fc233439ce7c]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] SCSI volumes sdd have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/384e50488245ee285329d7957751c37bf2ed8cb7.converted --force-share --output=json" returned: 0 in 0.149s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "384e50488245ee285329d7957751c37bf2ed8cb7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.705s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "384e50488245ee285329d7957751c37bf2ed8cb7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "384e50488245ee285329d7957751c37bf2ed8cb7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/384e50488245ee285329d7957751c37bf2ed8cb7 --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acdf07d-07e9-4b5c-bd04-bc5900edaf0d]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbbda38-3b94-4bb8-bc1e-bdb99c6b7226]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93, portal: 172.16.0.220,3260]
Apr 12 10:39:26 user nova-compute[71557]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93, portal: 172.16.0.220,3260] successful.
Apr 12 10:39:26 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[855fd214-e930-42d5-b87b-46a3fa7092ac]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.480s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] <== disconnect_volume: return (482ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/384e50488245ee285329d7957751c37bf2ed8cb7 --force-share --output=json" returned: 0 in 0.165s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/384e50488245ee285329d7957751c37bf2ed8cb7,backing_fmt=raw /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk.rescue {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/384e50488245ee285329d7957751c37bf2ed8cb7,backing_fmt=raw /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk.rescue" returned: 0 in 0.064s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "384e50488245ee285329d7957751c37bf2ed8cb7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.objects.instance [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lazy-loading 'migration_context' on Instance uuid f47d368e-3870-49d0-8522-a94991ec4ba5 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Start _get_guest_xml network_info=[{"id": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "address": "fa:16:3e:97:77:c8", "network": {"id": "4d3f7dc3-82bc-43ab-be83-29e8f16f99de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-970702209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-970702209-network", "vif_mac": "fa:16:3e:97:77:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce2a3bde13e464f8df0a41f30c240ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5c1f1e-a7", "ovs_interfaceid": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f4fcf2fb-8011-4377-96b3-cd19c43f5545', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'attachment_id': 'c35d98da-5046-46c2-a3a2-1191544d4506', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IliQbaxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'f47d368e-3870-49d0-8522-a94991ec4ba5', 'attached_at': '', 'detached_at': '', 'volume_id': 'afb7485e-496d-4fb9-a5b1-613d21171666', 'serial': 'afb7485e-496d-4fb9-a5b1-613d21171666'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.objects.instance [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lazy-loading 'resources' on Instance uuid f47d368e-3870-49d0-8522-a94991ec4ba5 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.objects.instance [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lazy-loading 'numa_topology' on Instance uuid f47d368e-3870-49d0-8522-a94991ec4ba5 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:39:26 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:39:26 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.objects.instance [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lazy-loading 'vcpu_model' on Instance uuid f47d368e-3870-49d0-8522-a94991ec4ba5 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IliQbaxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:39:26 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:39:26 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:39:26 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f1c9b8-3639-4734-84bf-81707869d17f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = IliQbaxz\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 10:39:26 user nova-compute[71557]: node.name = iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666
Apr 12 10:39:26 user nova-compute[71557]: node.tpgt = -1
Apr 12 10:39:26 user nova-compute[71557]: node.startup = automatic
Apr 12 10:39:26 user nova-compute[71557]: node.leading_login = No
Apr 12 10:39:26 user nova-compute[71557]: iface.iscsi_ifacename = default
Apr 12 10:39:26 user nova-compute[71557]: iface.net_ifacename = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.ipaddress = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.prefix_len = 0
Apr 12 10:39:26 user nova-compute[71557]: iface.hwaddress = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.transport_name = tcp
Apr 12 10:39:26 user nova-compute[71557]: iface.initiatorname = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.state = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.vlan_id = 0
Apr 12 10:39:26 user nova-compute[71557]: iface.vlan_priority = 0
Apr 12 10:39:26 user nova-compute[71557]: iface.vlan_state = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.iface_num = 0
Apr 12 10:39:26 user nova-compute[71557]: iface.mtu = 0
Apr 12 10:39:26 user nova-compute[71557]: iface.port = 0
Apr 12 10:39:26 user nova-compute[71557]: iface.bootproto = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.subnet_mask = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.gateway = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.dhcp_alt_client_id = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.dhcp_dns = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.dhcp_learn_iqn = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.dhcp_vendor_id_state = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.dhcp_vendor_id = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.dhcp_slp_da = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.fragmentation = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.gratuitous_arp = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.incoming_forwarding = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.tos_state = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.tos = 0
Apr 12 10:39:26 user nova-compute[71557]: iface.ttl = 0
Apr 12 10:39:26 user nova-compute[71557]: iface.delayed_ack = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.tcp_nagle = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.tcp_wsf_state = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.tcp_wsf = 0
Apr 12 10:39:26 user nova-compute[71557]: iface.tcp_timer_scale = 0
Apr 12 10:39:26 user nova-compute[71557]: iface.tcp_timestamp = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.redirect = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.def_task_mgmt_timeout = 0
Apr 12 10:39:26 user nova-compute[71557]: iface.header_digest = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.data_digest = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.immediate_data = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.initial_r2t = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.data_seq_inorder = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.data_pdu_inorder = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.erl = 0
Apr 12 10:39:26 user nova-compute[71557]: iface.max_receive_data_len = 0
Apr 12 10:39:26 user nova-compute[71557]: iface.first_burst_len = 0
Apr 12 10:39:26 user nova-compute[71557]: iface.max_outstanding_r2t = 0
Apr 12 10:39:26 user nova-compute[71557]: iface.max_burst_len = 0
Apr 12 10:39:26 user nova-compute[71557]: iface.chap_auth = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.bidi_chap = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.strict_login_compliance = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.discovery_auth = <empty>
Apr 12 10:39:26 user nova-compute[71557]: iface.discovery_logout = <empty>
Apr 12 10:39:26 user nova-compute[71557]: node.discovery_address = <empty>
Apr 12 10:39:26 user nova-compute[71557]: node.discovery_port = 0
Apr 12 10:39:26 user nova-compute[71557]: node.discovery_type = static
Apr 12 10:39:26 user nova-compute[71557]: node.session.initial_cmdsn = 0
Apr 12 10:39:26 user nova-compute[71557]: node.session.initial_login_retry_max = 8
Apr 12 10:39:26 user nova-compute[71557]: node.session.xmit_thread_priority = -20
Apr 12 10:39:26 user nova-compute[71557]: node.session.cmds_max = 128
Apr 12 10:39:26 user nova-compute[71557]: node.session.queue_depth = 32
Apr 12 10:39:26 user nova-compute[71557]: node.session.nr_sessions = 1
Apr 12 10:39:26 user nova-compute[71557]: node.session.auth.authmethod = CHAP
Apr 12 10:39:26 user nova-compute[71557]: node.session.auth.username = IliQbaxz
Apr 12 10:39:26 user nova-compute[71557]: node.session.auth.password = ***
Apr 12 10:39:26 user nova-compute[71557]: node.session.auth.username_in = <empty>
Apr 12 10:39:26 user nova-compute[71557]: node.session.auth.password_in = <empty>
Apr 12 10:39:26 user nova-compute[71557]: node.session.auth.chap_algs = MD5
Apr 12 10:39:26 user nova-compute[71557]: node.session.timeo.replacement_timeout = 120
Apr 12 10:39:26 user nova-compute[71557]: node.session.err_timeo.abort_timeout = 15
Apr 12 10:39:26 user nova-compute[71557]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 10:39:26 user nova-compute[71557]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 10:39:26 user nova-compute[71557]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 10:39:26 user nova-compute[71557]: node.session.iscsi.FastAbort = Yes
Apr 12 10:39:26 user nova-compute[71557]: node.session.iscsi.InitialR2T = No
Apr 12 10:39:26 user nova-compute[71557]: node.session.iscsi.ImmediateData = Yes
Apr 12 10:39:26 user nova-compute[71557]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 10:39:26 user nova-compute[71557]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 10:39:26 user nova-compute[71557]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 10:39:26 user nova-compute[71557]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 10:39:26 user nova-compute[71557]: node.session.iscsi.MaxConnections = 1
Apr 12 10:39:26 user nova-compute[71557]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 10:39:26 user nova-compute[71557]: node.session.iscsi.ERL = 0
Apr 12 10:39:26 user nova-compute[71557]: node.session.scan = manual
Apr 12 10:39:26 user nova-compute[71557]: node.session.reopen_max = 0
Apr 12 10:39:26 user nova-compute[71557]: node.conn[0].address = 172.16.0.220
Apr 12 10:39:26 user nova-compute[71557]: node.conn[0].port = 3260
Apr 12 10:39:26 user nova-compute[71557]: node.conn[0].startup = manual
Apr 12 10:39:26 user nova-compute[71557]: node.conn[0].tcp.window_size = 524288
Apr 12 10:39:26 user nova-compute[71557]: node.conn[0].tcp.type_of_service = 0
Apr 12 10:39:26 user nova-compute[71557]: node.conn[0].timeo.logout_timeout = 15
Apr 12 10:39:26 user nova-compute[71557]: node.conn[0].timeo.login_timeout = 15
Apr 12 10:39:26 user nova-compute[71557]: node.conn[0].timeo.auth_timeout = 45
Apr 12 10:39:26 user nova-compute[71557]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 10:39:26 user nova-compute[71557]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 10:39:26 user nova-compute[71557]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 10:39:26 user nova-compute[71557]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 10:39:26 user nova-compute[71557]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 10:39:26 user nova-compute[71557]: node.conn[0].iscsi.DataDigest = None
Apr 12 10:39:26 user nova-compute[71557]: node.conn[0].iscsi.IFMarker = No
Apr 12 10:39:26 user nova-compute[71557]: node.conn[0].iscsi.OFMarker = No
Apr 12 10:39:26 user nova-compute[71557]: # END RECORD
Apr 12 10:39:26 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7480528-a47c-40d9-9214-a0873f29fcb7]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d156148f-e894-434e-9a35-864f7c7f2d86]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IliQbaxz {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IliQbaxz" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d44f041-f34a-4706-8982-2955d4ebe7f1]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IliQbaxz'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d37801a-062d-432c-aa0f-83a7d8c986bf]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d33e0d-3ab8-4d10-b999-d7fb9dc8b0d8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:26 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:26 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:26 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:26 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.161s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] HCTL ('34', '0', '0', 0) found on session 13 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7cb49e-30ce-427c-9440-dcb2cb1b01fe]: (4, ('0 0 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Searching for a device in session 13 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IliQbaxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.186s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] <== connect_volume: return (188ms) {'type': 'block', 'scsi_wwn': '26263396139636332', 'path': '/dev/sdc'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263396139636332', 'path': '/dev/sdc'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1850921758',display_name='tempest-ServerStableDeviceRescueTest-server-1850921758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1850921758',id=3,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6J/cK5G69Rc1hFnFymuRzf/sxnh8tJeZCIsgDUrpU33tRNE8M9FW28e93IetT70vO+0CYZlhg4APAc6iRcEFv6hlCiC5vyIOseX+/85okbnJjZIoECICRAjLKoMj3fbA==',key_name='tempest-keypair-1741756118',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ce2a3bde13e464f8df0a41f30c240ab',ramdisk_id='',reservation_id='r-fqkamg1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1030861486',owner_user_name='tempest-ServerStableDeviceRescueTest-1030861486-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:37:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c757f04065b9488ba75739e59d7be377',uuid=f47d368e-3870-49d0-8522-a94991ec4ba5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "address": "fa:16:3e:97:77:c8", "network": {"id": "4d3f7dc3-82bc-43ab-be83-29e8f16f99de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-970702209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-970702209-network", "vif_mac": "fa:16:3e:97:77:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce2a3bde13e464f8df0a41f30c240ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5c1f1e-a7", "ovs_interfaceid": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Converting VIF {"id": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "address": "fa:16:3e:97:77:c8", "network": {"id": "4d3f7dc3-82bc-43ab-be83-29e8f16f99de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-970702209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-970702209-network", "vif_mac": "fa:16:3e:97:77:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce2a3bde13e464f8df0a41f30c240ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5c1f1e-a7", "ovs_interfaceid": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:77:c8,bridge_name='br-int',has_traffic_filtering=True,id=7b5c1f1e-a739-4317-a7b5-d6d884d32f7c,network=Network(4d3f7dc3-82bc-43ab-be83-29e8f16f99de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b5c1f1e-a7') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.objects.instance [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lazy-loading 'pci_devices' on Instance uuid f47d368e-3870-49d0-8522-a94991ec4ba5 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:39:26 user nova-compute[71557]:   <uuid>f47d368e-3870-49d0-8522-a94991ec4ba5</uuid>
Apr 12 10:39:26 user nova-compute[71557]:   <name>instance-00000003</name>
Apr 12 10:39:26 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:39:26 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:39:26 user nova-compute[71557]:   <metadata>
Apr 12 10:39:26 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:39:26 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:39:26 user nova-compute[71557]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1850921758</nova:name>
Apr 12 10:39:26 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:39:26</nova:creationTime>
Apr 12 10:39:26 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:39:26 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:39:26 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:39:26 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:39:26 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:39:26 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:39:26 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:39:26 user nova-compute[71557]:       <nova:owner>
Apr 12 10:39:26 user nova-compute[71557]:         <nova:user uuid="c757f04065b9488ba75739e59d7be377">tempest-ServerStableDeviceRescueTest-1030861486-project-member</nova:user>
Apr 12 10:39:26 user nova-compute[71557]:         <nova:project uuid="8ce2a3bde13e464f8df0a41f30c240ab">tempest-ServerStableDeviceRescueTest-1030861486</nova:project>
Apr 12 10:39:26 user nova-compute[71557]:       </nova:owner>
Apr 12 10:39:26 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:39:26 user nova-compute[71557]:       <nova:ports>
Apr 12 10:39:26 user nova-compute[71557]:         <nova:port uuid="7b5c1f1e-a739-4317-a7b5-d6d884d32f7c">
Apr 12 10:39:26 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 10:39:26 user nova-compute[71557]:         </nova:port>
Apr 12 10:39:26 user nova-compute[71557]:       </nova:ports>
Apr 12 10:39:26 user nova-compute[71557]:     </nova:instance>
Apr 12 10:39:26 user nova-compute[71557]:   </metadata>
Apr 12 10:39:26 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:39:26 user nova-compute[71557]:     <system>
Apr 12 10:39:26 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:39:26 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:39:26 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:39:26 user nova-compute[71557]:       <entry name="serial">f47d368e-3870-49d0-8522-a94991ec4ba5</entry>
Apr 12 10:39:26 user nova-compute[71557]:       <entry name="uuid">f47d368e-3870-49d0-8522-a94991ec4ba5</entry>
Apr 12 10:39:26 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:39:26 user nova-compute[71557]:     </system>
Apr 12 10:39:26 user nova-compute[71557]:   </sysinfo>
Apr 12 10:39:26 user nova-compute[71557]:   <os>
Apr 12 10:39:26 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:39:26 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:39:26 user nova-compute[71557]:   </os>
Apr 12 10:39:26 user nova-compute[71557]:   <features>
Apr 12 10:39:26 user nova-compute[71557]:     <acpi/>
Apr 12 10:39:26 user nova-compute[71557]:     <apic/>
Apr 12 10:39:26 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:39:26 user nova-compute[71557]:   </features>
Apr 12 10:39:26 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:39:26 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:39:26 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:39:26 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:39:26 user nova-compute[71557]:   </clock>
Apr 12 10:39:26 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:39:26 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:39:26 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:39:26 user nova-compute[71557]:   </cpu>
Apr 12 10:39:26 user nova-compute[71557]:   <devices>
Apr 12 10:39:26 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:39:26 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:39:26 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk"/>
Apr 12 10:39:26 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:39:26 user nova-compute[71557]:     </disk>
Apr 12 10:39:26 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:39:26 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:39:26 user nova-compute[71557]:       <source dev="/dev/sdc"/>
Apr 12 10:39:26 user nova-compute[71557]:       <target dev="vdb" bus="virtio"/>
Apr 12 10:39:26 user nova-compute[71557]:       <serial>afb7485e-496d-4fb9-a5b1-613d21171666</serial>
Apr 12 10:39:26 user nova-compute[71557]:     </disk>
Apr 12 10:39:26 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:39:26 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:39:26 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk.rescue"/>
Apr 12 10:39:26 user nova-compute[71557]:       <target dev="vdc" bus="virtio"/>
Apr 12 10:39:26 user nova-compute[71557]:       <boot order="1"/>
Apr 12 10:39:26 user nova-compute[71557]:     </disk>
Apr 12 10:39:26 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:39:26 user nova-compute[71557]:       <mac address="fa:16:3e:97:77:c8"/>
Apr 12 10:39:26 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:39:26 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:39:26 user nova-compute[71557]:       <target dev="tap7b5c1f1e-a7"/>
Apr 12 10:39:26 user nova-compute[71557]:     </interface>
Apr 12 10:39:26 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:39:26 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/console.log" append="off"/>
Apr 12 10:39:26 user nova-compute[71557]:     </serial>
Apr 12 10:39:26 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:39:26 user nova-compute[71557]:     <video>
Apr 12 10:39:26 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:39:26 user nova-compute[71557]:     </video>
Apr 12 10:39:26 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:39:26 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:39:26 user nova-compute[71557]:     </rng>
Apr 12 10:39:26 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:39:26 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:39:26 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:39:26 user nova-compute[71557]:     </memballoon>
Apr 12 10:39:26 user nova-compute[71557]:   </devices>
Apr 12 10:39:26 user nova-compute[71557]: </domain>
Apr 12 10:39:26 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:39:26 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Instance destroyed successfully.
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:39:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] No VIF found with MAC fa:16:3e:97:77:c8, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:39:27 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Instance destroyed successfully.
Apr 12 10:39:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1895953867',display_name='tempest-ServerActionsTestJSON-server-1970085629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1895953867',id=4,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSPzZAK4K6WfKgZv6ul+nJ2Lzppw5IMfK0+f9KuGByC6XjA59WQJmgMTCh01/yWlwW8qMjnx6gjYen9tQKzYmdVo3Z1KGqS/wGYHKKDRVeNNONzm9HfPYp2EDH6xyugDA==',key_name='tempest-keypair-1241183546',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:35:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32235c67d269474b879a58269c1bfb28',ramdisk_id='',reservation_id='r-m0f2y2eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2042231427',owner_user_name='tempest-ServerActionsTestJSON-2042231427-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0059d31539304ffcb5214b408751cd4f',uuid=bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converting VIF {"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG os_vif [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa1878d2-9c, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:27 user nova-compute[71557]: INFO os_vif [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c')
Apr 12 10:39:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCjTdIwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:39:27 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 10:39:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[095ce992-55f7-4ed7-ab66-c4e908e4ca2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:39:27 user nova-compute[71557]: No targets found.
Apr 12 10:39:27 user nova-compute[71557]: iSNS:
Apr 12 10:39:27 user nova-compute[71557]: No targets found.
Apr 12 10:39:27 user nova-compute[71557]: STATIC:
Apr 12 10:39:27 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:39:27 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:39:27 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:39:27 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666
Apr 12 10:39:27 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:39:27 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:39:27 user nova-compute[71557]: FIRMWARE:
Apr 12 10:39:27 user nova-compute[71557]: No targets found.
Apr 12 10:39:27 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:39:27 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:39:27 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbf9264-3a2d-4e98-ba3e-9af0d155d3d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d950a1c8-0cde-4a2d-b7f8-d056cb943edf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:27 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:27 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:27 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:27 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd42969e0>, {}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Disconnecting from: [] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] <== disconnect_volume: return (77ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:39:27 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Deleting instance files /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b_del
Apr 12 10:39:27 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Deletion of /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b_del complete
Apr 12 10:39:27 user nova-compute[71557]: INFO nova.virt.block_device [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Booting with volume 028bc65f-dc6d-4486-a99f-19a5ae874a93 at /dev/vdb
Apr 12 10:39:27 user nova-compute[71557]: DEBUG os_brick.utils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c9d0b9-3a9d-4daf-9904-99abd7d0bc79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[22297fb3-bd46-437a-8069-8e86081b2217]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f58842e-051a-4033-b042-c6380c845910]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9567d275-b7db-4b6a-80ad-b741da450ed7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:39:27 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:39:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e7ab82-5934-431f-a7f4-0cdc8ed7d29b]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG os_brick.utils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Updating existing volume attachment record: ffabfd94-cb99-49e6-bb03-0c1d7b9b317c {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:39:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:28 user nova-compute[71557]: DEBUG nova.compute.manager [req-e9f33cdb-75f7-4862-ab22-492123f56dff req-c69101e1-4996-42c7-ab39-405ff653512a service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received event network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e9f33cdb-75f7-4862-ab22-492123f56dff req-c69101e1-4996-42c7-ab39-405ff653512a service nova] Acquiring lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e9f33cdb-75f7-4862-ab22-492123f56dff req-c69101e1-4996-42c7-ab39-405ff653512a service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e9f33cdb-75f7-4862-ab22-492123f56dff req-c69101e1-4996-42c7-ab39-405ff653512a service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:28 user nova-compute[71557]: DEBUG nova.compute.manager [req-e9f33cdb-75f7-4862-ab22-492123f56dff req-c69101e1-4996-42c7-ab39-405ff653512a service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] No waiting events found dispatching network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:39:28 user nova-compute[71557]: WARNING nova.compute.manager [req-e9f33cdb-75f7-4862-ab22-492123f56dff req-c69101e1-4996-42c7-ab39-405ff653512a service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received unexpected event network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance with vm_state active and task_state rescuing.
Apr 12 10:39:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:29 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681295954.3843286, ea55f551-968e-4ece-a37a-c4128ce5e8cb => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:39:29 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] VM Stopped (Lifecycle Event)
Apr 12 10:39:29 user nova-compute[71557]: DEBUG nova.compute.manager [None req-fd906a52-360b-4cab-9fa6-e46a0f0f045c None None] [instance: ea55f551-968e-4ece-a37a-c4128ce5e8cb] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:39:30 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681295955.1040685, 893c42b2-83ed-4823-9698-2015a3ffd4c5 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:39:30 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] VM Stopped (Lifecycle Event)
Apr 12 10:39:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c4a1acd5-9422-4dff-a698-663edb53d86e None None] [instance: 893c42b2-83ed-4823-9698-2015a3ffd4c5] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:39:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Removed pending event for f47d368e-3870-49d0-8522-a94991ec4ba5 due to event {{(pid=71557) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 10:39:30 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295970.4872286, f47d368e-3870-49d0-8522-a94991ec4ba5 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:39:30 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] VM Resumed (Lifecycle Event)
Apr 12 10:39:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-7a8a9c31-0a74-43f5-b03a-121f8eac866a tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:39:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:39:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:39:30 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 10:39:30 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295970.4918542, f47d368e-3870-49d0-8522-a94991ec4ba5 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:39:30 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] VM Started (Lifecycle Event)
Apr 12 10:39:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:39:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:39:30 user nova-compute[71557]: DEBUG nova.compute.manager [req-cdffacea-4597-4ca9-a053-e962531be73e req-41695e35-6648-4f70-b654-b09e364131f4 service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received event network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cdffacea-4597-4ca9-a053-e962531be73e req-41695e35-6648-4f70-b654-b09e364131f4 service nova] Acquiring lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cdffacea-4597-4ca9-a053-e962531be73e req-41695e35-6648-4f70-b654-b09e364131f4 service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cdffacea-4597-4ca9-a053-e962531be73e req-41695e35-6648-4f70-b654-b09e364131f4 service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:30 user nova-compute[71557]: DEBUG nova.compute.manager [req-cdffacea-4597-4ca9-a053-e962531be73e req-41695e35-6648-4f70-b654-b09e364131f4 service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] No waiting events found dispatching network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:39:30 user nova-compute[71557]: WARNING nova.compute.manager [req-cdffacea-4597-4ca9-a053-e962531be73e req-41695e35-6648-4f70-b654-b09e364131f4 service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received unexpected event network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance with vm_state active and task_state rescuing.
Apr 12 10:39:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:39:32 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Creating image(s)
Apr 12 10:39:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "/opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "/opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.145s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.150s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk 1073741824" returned: 0 in 0.057s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.151s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:32 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:39:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Cannot resize image /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Ensure instance console log exists: /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Start _get_guest_xml network_info=[{"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'attachment_id': 'ffabfd94-cb99-49e6-bb03-0c1d7b9b317c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCjTdIwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b', 'attached_at': '', 'detached_at': '', 'volume_id': '028bc65f-dc6d-4486-a99f-19a5ae874a93', 'serial': '028bc65f-dc6d-4486-a99f-19a5ae874a93'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:39:33 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 12 10:39:33 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 12 10:39:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG nova.objects.instance [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'vcpu_model' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCjTdIwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:39:33 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:39:33 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:39:33 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a0d6de-cde2-4eaa-a8d8-4dc062c10029]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:39:33 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce39a64c-9a1e-4fa6-b0e7-eadc5d598ebd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93] added
Apr 12 10:39:33 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e4a771-da9f-4a50-86be-494ce1fe1607]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9859ed3-e5e4-42af-b1ae-f31ce7b74e97]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SCjTdIwL {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SCjTdIwL" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b168674-47e0-48db-b968-807fa5fe2e4d]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SCjTdIwL'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7407c49-862c-4418-9561-e9c32d48518e]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[722681af-96a9-48a7-8b14-fe8052bd6156]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:33 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:33 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:33 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:33 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd6e33d-8dad-49f6-b546-1f8b93256964]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93, portal: 172.16.0.220,3260]
Apr 12 10:39:33 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93, portal: 172.16.0.220,3260] successful.
Apr 12 10:39:33 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f43edd-d23c-496b-a040-3f8e19727928]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a3e2a6-4a3e-454e-8a11-09e732e537a8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:33 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:33 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:39:33 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:33 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:33 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:39:33 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d32f79b-e925-4654-80dc-6484e391ac53]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:39:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCjTdIwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:39:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:39:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26461383863613636', 'path': '/dev/sdd'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:39:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461383863613636', 'path': '/dev/sdd'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:39:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T10:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1895953867',display_name='tempest-ServerActionsTestJSON-server-1970085629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1895953867',id=4,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSPzZAK4K6WfKgZv6ul+nJ2Lzppw5IMfK0+f9KuGByC6XjA59WQJmgMTCh01/yWlwW8qMjnx6gjYen9tQKzYmdVo3Z1KGqS/wGYHKKDRVeNNONzm9HfPYp2EDH6xyugDA==',key_name='tempest-keypair-1241183546',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:35:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32235c67d269474b879a58269c1bfb28',ramdisk_id='',reservation_id='r-m0f2y2eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2042231427',owner_user_name='tempest-ServerActionsTestJSON-2042231427-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:39:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0059d31539304ffcb5214b408751cd4f',uuid=bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:39:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converting VIF {"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:39:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:39:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:39:34 user nova-compute[71557]:   <uuid>bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b</uuid>
Apr 12 10:39:34 user nova-compute[71557]:   <name>instance-00000004</name>
Apr 12 10:39:34 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:39:34 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:39:34 user nova-compute[71557]:   <metadata>
Apr 12 10:39:34 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:39:34 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:39:34 user nova-compute[71557]:       <nova:name>tempest-ServerActionsTestJSON-server-1970085629</nova:name>
Apr 12 10:39:34 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:39:33</nova:creationTime>
Apr 12 10:39:34 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:39:34 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:39:34 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:39:34 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:39:34 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:39:34 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:39:34 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:39:34 user nova-compute[71557]:       <nova:owner>
Apr 12 10:39:34 user nova-compute[71557]:         <nova:user uuid="0059d31539304ffcb5214b408751cd4f">tempest-ServerActionsTestJSON-2042231427-project-member</nova:user>
Apr 12 10:39:34 user nova-compute[71557]:         <nova:project uuid="32235c67d269474b879a58269c1bfb28">tempest-ServerActionsTestJSON-2042231427</nova:project>
Apr 12 10:39:34 user nova-compute[71557]:       </nova:owner>
Apr 12 10:39:34 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:39:34 user nova-compute[71557]:       <nova:ports>
Apr 12 10:39:34 user nova-compute[71557]:         <nova:port uuid="fa1878d2-9c1a-4fda-bdbf-b226839d56c4">
Apr 12 10:39:34 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 10:39:34 user nova-compute[71557]:         </nova:port>
Apr 12 10:39:34 user nova-compute[71557]:       </nova:ports>
Apr 12 10:39:34 user nova-compute[71557]:     </nova:instance>
Apr 12 10:39:34 user nova-compute[71557]:   </metadata>
Apr 12 10:39:34 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:39:34 user nova-compute[71557]:     <system>
Apr 12 10:39:34 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:39:34 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:39:34 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:39:34 user nova-compute[71557]:       <entry name="serial">bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b</entry>
Apr 12 10:39:34 user nova-compute[71557]:       <entry name="uuid">bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b</entry>
Apr 12 10:39:34 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:39:34 user nova-compute[71557]:     </system>
Apr 12 10:39:34 user nova-compute[71557]:   </sysinfo>
Apr 12 10:39:34 user nova-compute[71557]:   <os>
Apr 12 10:39:34 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:39:34 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:39:34 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:39:34 user nova-compute[71557]:   </os>
Apr 12 10:39:34 user nova-compute[71557]:   <features>
Apr 12 10:39:34 user nova-compute[71557]:     <acpi/>
Apr 12 10:39:34 user nova-compute[71557]:     <apic/>
Apr 12 10:39:34 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:39:34 user nova-compute[71557]:   </features>
Apr 12 10:39:34 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:39:34 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:39:34 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:39:34 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:39:34 user nova-compute[71557]:   </clock>
Apr 12 10:39:34 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:39:34 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:39:34 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:39:34 user nova-compute[71557]:   </cpu>
Apr 12 10:39:34 user nova-compute[71557]:   <devices>
Apr 12 10:39:34 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:39:34 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:39:34 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk"/>
Apr 12 10:39:34 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:39:34 user nova-compute[71557]:     </disk>
Apr 12 10:39:34 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:39:34 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:39:34 user nova-compute[71557]:       <source dev="/dev/sdd"/>
Apr 12 10:39:34 user nova-compute[71557]:       <target dev="vdb" bus="virtio"/>
Apr 12 10:39:34 user nova-compute[71557]:       <serial>028bc65f-dc6d-4486-a99f-19a5ae874a93</serial>
Apr 12 10:39:34 user nova-compute[71557]:     </disk>
Apr 12 10:39:34 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:39:34 user nova-compute[71557]:       <mac address="fa:16:3e:fe:65:45"/>
Apr 12 10:39:34 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:39:34 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:39:34 user nova-compute[71557]:       <target dev="tapfa1878d2-9c"/>
Apr 12 10:39:34 user nova-compute[71557]:     </interface>
Apr 12 10:39:34 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:39:34 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/console.log" append="off"/>
Apr 12 10:39:34 user nova-compute[71557]:     </serial>
Apr 12 10:39:34 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:39:34 user nova-compute[71557]:     <video>
Apr 12 10:39:34 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:39:34 user nova-compute[71557]:     </video>
Apr 12 10:39:34 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:39:34 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:39:34 user nova-compute[71557]:     </rng>
Apr 12 10:39:34 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:39:34 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:39:34 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:39:34 user nova-compute[71557]:     </memballoon>
Apr 12 10:39:34 user nova-compute[71557]:   </devices>
Apr 12 10:39:34 user nova-compute[71557]: </domain>
Apr 12 10:39:34 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:39:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T10:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1895953867',display_name='tempest-ServerActionsTestJSON-server-1970085629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1895953867',id=4,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSPzZAK4K6WfKgZv6ul+nJ2Lzppw5IMfK0+f9KuGByC6XjA59WQJmgMTCh01/yWlwW8qMjnx6gjYen9tQKzYmdVo3Z1KGqS/wGYHKKDRVeNNONzm9HfPYp2EDH6xyugDA==',key_name='tempest-keypair-1241183546',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:35:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32235c67d269474b879a58269c1bfb28',ramdisk_id='',reservation_id='r-m0f2y2eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2042231427',owner_user_name='tempest-ServerActionsTestJSON-2042231427-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:39:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0059d31539304ffcb5214b408751cd4f',uuid=bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:39:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converting VIF {"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:39:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:39:34 user nova-compute[71557]: DEBUG os_vif [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:39:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:39:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:39:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa1878d2-9c, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:39:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfa1878d2-9c, col_values=(('external_ids', {'iface-id': 'fa1878d2-9c1a-4fda-bdbf-b226839d56c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:65:45', 'vm-uuid': 'bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:39:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:39:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:34 user nova-compute[71557]: INFO os_vif [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c')
Apr 12 10:39:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:39:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:39:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] No VIF found with MAC fa:16:3e:fe:65:45, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:39:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-655ae0fc-1478-4091-9a0a-44b2d38b2de9 req-33660855-5199-486a-ac42-de6e88ec6315 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-655ae0fc-1478-4091-9a0a-44b2d38b2de9 req-33660855-5199-486a-ac42-de6e88ec6315 service nova] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-655ae0fc-1478-4091-9a0a-44b2d38b2de9 req-33660855-5199-486a-ac42-de6e88ec6315 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-655ae0fc-1478-4091-9a0a-44b2d38b2de9 req-33660855-5199-486a-ac42-de6e88ec6315 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-655ae0fc-1478-4091-9a0a-44b2d38b2de9 req-33660855-5199-486a-ac42-de6e88ec6315 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] No waiting events found dispatching network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:39:36 user nova-compute[71557]: WARNING nova.compute.manager [req-655ae0fc-1478-4091-9a0a-44b2d38b2de9 req-33660855-5199-486a-ac42-de6e88ec6315 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received unexpected event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance with vm_state active and task_state rebuild_spawning.
Apr 12 10:39:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Removed pending event for bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b due to event {{(pid=71557) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295978.1461194, bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:39:38 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] VM Resumed (Lifecycle Event)
Apr 12 10:39:38 user nova-compute[71557]: DEBUG nova.compute.manager [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:39:38 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Instance spawned successfully.
Apr 12 10:39:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:39:38 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 12 10:39:38 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681295978.1507657, bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:39:38 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] VM Started (Lifecycle Event)
Apr 12 10:39:38 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG nova.compute.manager [req-c35721e2-a1ba-4625-bd4b-df740862a551 req-114977db-a4ca-4cce-a999-4e599fa01444 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c35721e2-a1ba-4625-bd4b-df740862a551 req-114977db-a4ca-4cce-a999-4e599fa01444 service nova] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c35721e2-a1ba-4625-bd4b-df740862a551 req-114977db-a4ca-4cce-a999-4e599fa01444 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c35721e2-a1ba-4625-bd4b-df740862a551 req-114977db-a4ca-4cce-a999-4e599fa01444 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG nova.compute.manager [req-c35721e2-a1ba-4625-bd4b-df740862a551 req-114977db-a4ca-4cce-a999-4e599fa01444 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] No waiting events found dispatching network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:39:38 user nova-compute[71557]: WARNING nova.compute.manager [req-c35721e2-a1ba-4625-bd4b-df740862a551 req-114977db-a4ca-4cce-a999-4e599fa01444 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received unexpected event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance with vm_state active and task_state rebuild_spawning.
Apr 12 10:39:38 user nova-compute[71557]: DEBUG nova.compute.manager [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:39:38 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 12 10:39:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG nova.objects.instance [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71557) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-29a8c218-cd2d-4cd5-b428-ffb1f91f9ecf tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.071s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:38 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:39:38 user nova-compute[71557]: INFO nova.compute.claims [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Claim successful on node user
Apr 12 10:39:39 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:39:39 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:39:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:39:39 user nova-compute[71557]: INFO nova.virt.block_device [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Booting with volume b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 at /dev/vda
Apr 12 10:39:39 user nova-compute[71557]: DEBUG nova.policy [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21034326c41f487181d19f60e0ccf219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ec9852adb94a5086dc3ef48871d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG os_brick.utils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f40e1c0-9e38-43b4-9098-802e99632fe6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df06d9b-fd3c-495a-b871-3723310266b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2942e20c-405e-43a2-a235-91c24a31d999]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e60e29c-ce11-4f73-b899-7f993315bdab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:39:39 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:39:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb47fe7-b1e5-4b56-a0e0-6df728e4f08c]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG os_brick.utils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:39:39 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Updating existing volume attachment record: 0940b37a-1e2d-4136-832e-c8673dc22012 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:39:40 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Successfully created port: daf1aa56-7b24-4f41-93fd-a54cdf96428f {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:39:40 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Successfully created port: fb79e431-1d99-40eb-94a0-20032fa213fb {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:39:41 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Successfully created port: 825c6036-d16c-43ab-9f6a-2bb133bf51b8 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:39:42 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Successfully created port: 13923b13-db35-4b98-b2b0-e2e18fd8441e {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:39:43 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Successfully created port: 3c8cf480-05d6-463a-a97e-a9d869ac3860 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:39:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Successfully updated port: daf1aa56-7b24-4f41-93fd-a54cdf96428f {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-3ce963ef-c045-4727-afb4-58031e8911e9 req-8d837a34-2905-4c1a-82b9-c1cd7a453ce3 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-changed-daf1aa56-7b24-4f41-93fd-a54cdf96428f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-3ce963ef-c045-4727-afb4-58031e8911e9 req-8d837a34-2905-4c1a-82b9-c1cd7a453ce3 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Refreshing instance network info cache due to event network-changed-daf1aa56-7b24-4f41-93fd-a54cdf96428f. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3ce963ef-c045-4727-afb4-58031e8911e9 req-8d837a34-2905-4c1a-82b9-c1cd7a453ce3 service nova] Acquiring lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3ce963ef-c045-4727-afb4-58031e8911e9 req-8d837a34-2905-4c1a-82b9-c1cd7a453ce3 service nova] Acquired lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG nova.network.neutron [req-3ce963ef-c045-4727-afb4-58031e8911e9 req-8d837a34-2905-4c1a-82b9-c1cd7a453ce3 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Refreshing network info cache for port daf1aa56-7b24-4f41-93fd-a54cdf96428f {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG nova.network.neutron [req-3ce963ef-c045-4727-afb4-58031e8911e9 req-8d837a34-2905-4c1a-82b9-c1cd7a453ce3 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG nova.network.neutron [req-3ce963ef-c045-4727-afb4-58031e8911e9 req-8d837a34-2905-4c1a-82b9-c1cd7a453ce3 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3ce963ef-c045-4727-afb4-58031e8911e9 req-8d837a34-2905-4c1a-82b9-c1cd7a453ce3 service nova] Releasing lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:39:44 user nova-compute[71557]: INFO nova.virt.block_device [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Booting with volume df938975-a760-4947-97c7-9d557f068c75 at /dev/vdb
Apr 12 10:39:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG os_brick.utils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e848e36c-89b3-4912-8dd8-65b9fd4c44ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d98478-f486-4b4a-aefe-3ed9955af1f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2da9ecb-45f2-4bb1-800a-60666b08e581]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be02281-930e-4349-b7ed-24485316450f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:39:44 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:39:44 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ddca1e-f9f6-425f-a1c7-4b03b8557cf0]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG os_brick.utils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:39:44 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Updating existing volume attachment record: 65f0f661-4710-4e29-919f-639f26269529 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:39:45 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Successfully updated port: bbbdccd3-ba1c-46e2-90b5-10d6036f72c7 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:39:45 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Successfully updated port: e16e56f7-00ab-422d-95b3-d1b204f693a3 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:39:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-changed-bbbdccd3-ba1c-46e2-90b5-10d6036f72c7 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Refreshing instance network info cache due to event network-changed-bbbdccd3-ba1c-46e2-90b5-10d6036f72c7. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:39:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] Acquiring lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:39:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] Acquired lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:39:46 user nova-compute[71557]: DEBUG nova.network.neutron [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Refreshing network info cache for port bbbdccd3-ba1c-46e2-90b5-10d6036f72c7 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:39:46 user nova-compute[71557]: DEBUG nova.network.neutron [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:39:46 user nova-compute[71557]: DEBUG nova.network.neutron [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:39:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] Releasing lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:39:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-changed-e16e56f7-00ab-422d-95b3-d1b204f693a3 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Refreshing instance network info cache due to event network-changed-e16e56f7-00ab-422d-95b3-d1b204f693a3. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:39:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] Acquiring lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:39:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] Acquired lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:39:46 user nova-compute[71557]: DEBUG nova.network.neutron [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Refreshing network info cache for port e16e56f7-00ab-422d-95b3-d1b204f693a3 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:39:46 user nova-compute[71557]: DEBUG nova.network.neutron [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:39:46 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Successfully updated port: fb79e431-1d99-40eb-94a0-20032fa213fb {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:39:46 user nova-compute[71557]: DEBUG nova.network.neutron [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:39:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f3026d73-5058-4a44-8495-93117dbf0df0 req-83547b6d-43a1-4057-9b85-d9218803efad service nova] Releasing lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:39:47 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Successfully updated port: 825c6036-d16c-43ab-9f6a-2bb133bf51b8 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:39:48 user nova-compute[71557]: DEBUG nova.compute.manager [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-changed-fb79e431-1d99-40eb-94a0-20032fa213fb {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:48 user nova-compute[71557]: DEBUG nova.compute.manager [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Refreshing instance network info cache due to event network-changed-fb79e431-1d99-40eb-94a0-20032fa213fb. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:39:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] Acquiring lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:39:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] Acquired lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:39:48 user nova-compute[71557]: DEBUG nova.network.neutron [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Refreshing network info cache for port fb79e431-1d99-40eb-94a0-20032fa213fb {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:39:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:48 user nova-compute[71557]: DEBUG nova.network.neutron [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:39:48 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Successfully updated port: 13923b13-db35-4b98-b2b0-e2e18fd8441e {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:39:48 user nova-compute[71557]: DEBUG nova.network.neutron [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:39:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] Releasing lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:39:48 user nova-compute[71557]: DEBUG nova.compute.manager [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-changed-825c6036-d16c-43ab-9f6a-2bb133bf51b8 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:48 user nova-compute[71557]: DEBUG nova.compute.manager [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Refreshing instance network info cache due to event network-changed-825c6036-d16c-43ab-9f6a-2bb133bf51b8. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:39:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] Acquiring lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:39:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] Acquired lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:39:48 user nova-compute[71557]: DEBUG nova.network.neutron [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Refreshing network info cache for port 825c6036-d16c-43ab-9f6a-2bb133bf51b8 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:39:48 user nova-compute[71557]: DEBUG nova.network.neutron [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:39:48 user nova-compute[71557]: DEBUG nova.network.neutron [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:39:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ceb42037-bf74-4b17-a088-eb4ccdeb7d36 req-fbe59db8-1c4a-40e1-96d6-b52f14b60236 service nova] Releasing lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:39:49 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Successfully updated port: 3c8cf480-05d6-463a-a97e-a9d869ac3860 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:39:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:39:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquired lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:39:49 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:39:49 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:39:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:50 user nova-compute[71557]: DEBUG nova.compute.manager [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-changed-13923b13-db35-4b98-b2b0-e2e18fd8441e {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:50 user nova-compute[71557]: DEBUG nova.compute.manager [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Refreshing instance network info cache due to event network-changed-13923b13-db35-4b98-b2b0-e2e18fd8441e. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:39:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] Acquiring lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:39:51 user nova-compute[71557]: INFO nova.virt.block_device [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Booting with volume a5d2f824-dd5b-4306-a67e-2a7aeda984a2 at /dev/vdc
Apr 12 10:39:51 user nova-compute[71557]: DEBUG os_brick.utils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0e469c-5fcd-488f-8fd2-7724de276b32]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6751479-c9da-4deb-805e-75d4177788ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0c5470-e49a-4dbc-80ab-9da9a8fe96ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64e2aba-752e-4252-9da8-2beb34d96a8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:39:51 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:39:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5aa4c27-a48a-4b08-a314-3add025b4f59]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG os_brick.utils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Updating existing volume attachment record: ffb2a003-1737-4097-b2d9-e3bb5d3c7223 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Updating instance_info_cache with network_info: [{"id": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "address": "fa:16:3e:cf:11:4a", "network": {"id": "698d4aee-44be-48ca-ab9b-0d58aed34d96", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1402217495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf1aa56-7b", "ovs_interfaceid": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "address": "fa:16:3e:15:59:c8", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbdccd3-ba", "ovs_interfaceid": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "address": "fa:16:3e:20:f6:ea", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e56f7-00", "ovs_interfaceid": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb79e431-1d99-40eb-94a0-20032fa213fb", "address": "fa:16:3e:fe:d3:c6", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb79e431-1d", "ovs_interfaceid": "fb79e431-1d99-40eb-94a0-20032fa213fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "address": "fa:16:3e:fe:8f:eb", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825c6036-d1", "ovs_interfaceid": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "address": "fa:16:3e:59:ab:3b", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13923b13-db", "ovs_interfaceid": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "address": "fa:16:3e:9d:7d:33", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8cf480-05", "ovs_interfaceid": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Releasing lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Instance network_info: |[{"id": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "address": "fa:16:3e:cf:11:4a", "network": {"id": "698d4aee-44be-48ca-ab9b-0d58aed34d96", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1402217495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf1aa56-7b", "ovs_interfaceid": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "address": "fa:16:3e:15:59:c8", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbdccd3-ba", "ovs_interfaceid": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "address": "fa:16:3e:20:f6:ea", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e56f7-00", "ovs_interfaceid": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb79e431-1d99-40eb-94a0-20032fa213fb", "address": "fa:16:3e:fe:d3:c6", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb79e431-1d", "ovs_interfaceid": "fb79e431-1d99-40eb-94a0-20032fa213fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "address": "fa:16:3e:fe:8f:eb", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825c6036-d1", "ovs_interfaceid": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "address": "fa:16:3e:59:ab:3b", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13923b13-db", "ovs_interfaceid": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "address": "fa:16:3e:9d:7d:33", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8cf480-05", "ovs_interfaceid": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] Acquired lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:39:51 user nova-compute[71557]: DEBUG nova.network.neutron [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Refreshing network info cache for port 13923b13-db35-4b98-b2b0-e2e18fd8441e {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:39:52 user nova-compute[71557]: DEBUG nova.network.neutron [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Updated VIF entry in instance network info cache for port 13923b13-db35-4b98-b2b0-e2e18fd8441e. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:39:52 user nova-compute[71557]: DEBUG nova.network.neutron [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Updating instance_info_cache with network_info: [{"id": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "address": "fa:16:3e:cf:11:4a", "network": {"id": "698d4aee-44be-48ca-ab9b-0d58aed34d96", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1402217495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf1aa56-7b", "ovs_interfaceid": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "address": "fa:16:3e:15:59:c8", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbdccd3-ba", "ovs_interfaceid": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "address": "fa:16:3e:20:f6:ea", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e56f7-00", "ovs_interfaceid": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb79e431-1d99-40eb-94a0-20032fa213fb", "address": "fa:16:3e:fe:d3:c6", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb79e431-1d", "ovs_interfaceid": "fb79e431-1d99-40eb-94a0-20032fa213fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "address": "fa:16:3e:fe:8f:eb", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825c6036-d1", "ovs_interfaceid": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "address": "fa:16:3e:59:ab:3b", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13923b13-db", "ovs_interfaceid": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "address": "fa:16:3e:9d:7d:33", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8cf480-05", "ovs_interfaceid": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:39:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] Releasing lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:39:52 user nova-compute[71557]: DEBUG nova.compute.manager [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-changed-3c8cf480-05d6-463a-a97e-a9d869ac3860 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:39:52 user nova-compute[71557]: DEBUG nova.compute.manager [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Refreshing instance network info cache due to event network-changed-3c8cf480-05d6-463a-a97e-a9d869ac3860. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:39:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] Acquiring lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:39:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] Acquired lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:39:52 user nova-compute[71557]: DEBUG nova.network.neutron [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Refreshing network info cache for port 3c8cf480-05d6-463a-a97e-a9d869ac3860 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:39:52 user nova-compute[71557]: DEBUG nova.network.neutron [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Updated VIF entry in instance network info cache for port 3c8cf480-05d6-463a-a97e-a9d869ac3860. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:39:52 user nova-compute[71557]: DEBUG nova.network.neutron [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Updating instance_info_cache with network_info: [{"id": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "address": "fa:16:3e:cf:11:4a", "network": {"id": "698d4aee-44be-48ca-ab9b-0d58aed34d96", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1402217495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf1aa56-7b", "ovs_interfaceid": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "address": "fa:16:3e:15:59:c8", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbdccd3-ba", "ovs_interfaceid": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "address": "fa:16:3e:20:f6:ea", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e56f7-00", "ovs_interfaceid": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb79e431-1d99-40eb-94a0-20032fa213fb", "address": "fa:16:3e:fe:d3:c6", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb79e431-1d", "ovs_interfaceid": "fb79e431-1d99-40eb-94a0-20032fa213fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "address": "fa:16:3e:fe:8f:eb", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825c6036-d1", "ovs_interfaceid": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "address": "fa:16:3e:59:ab:3b", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13923b13-db", "ovs_interfaceid": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "address": "fa:16:3e:9d:7d:33", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8cf480-05", "ovs_interfaceid": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:39:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f28ba4df-991b-4e69-abf8-50c5e2b14bdb req-7a462f8e-ab1a-4462-b0a1-f62305f2c929 service nova] Releasing lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:39:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:39:56 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Creating image(s)
Apr 12 10:39:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Did not create local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Ensure instance console log exists: /opt/stack/data/nova/instances/6b152adb-ca3d-45cf-a394-5ba5b36180a8/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Start _get_guest_xml network_info=[{"id": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "address": "fa:16:3e:cf:11:4a", "network": {"id": "698d4aee-44be-48ca-ab9b-0d58aed34d96", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1402217495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf1aa56-7b", "ovs_interfaceid": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "address": "fa:16:3e:15:59:c8", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbdccd3-ba", "ovs_interfaceid": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "address": "fa:16:3e:20:f6:ea", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e56f7-00", "ovs_interfaceid": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb79e431-1d99-40eb-94a0-20032fa213fb", "address": "fa:16:3e:fe:d3:c6", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb79e431-1d", "ovs_interfaceid": "fb79e431-1d99-40eb-94a0-20032fa213fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "address": "fa:16:3e:fe:8f:eb", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825c6036-d1", "ovs_interfaceid": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "address": "fa:16:3e:59:ab:3b", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13923b13-db", "ovs_interfaceid": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "address": "fa:16:3e:9d:7d:33", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8cf480-05", "ovs_interfaceid": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': '0940b37a-1e2d-4136-832e-c8673dc22012', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvTGZRVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b152adb-ca3d-45cf-a394-5ba5b36180a8', 'attached_at': '', 'detached_at': '', 'volume_id': 'b76b2ba5-6ae0-4392-9b42-e06b4a967ac7', 'serial': 'b76b2ba5-6ae0-4392-9b42-e06b4a967ac7'}, 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': 1, 'guest_format': None, 'attachment_id': '65f0f661-4710-4e29-919f-639f26269529', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OHLDsUfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b152adb-ca3d-45cf-a394-5ba5b36180a8', 'attached_at': '', 'detached_at': '', 'volume_id': 'df938975-a760-4947-97c7-9d557f068c75', 'serial': 'df938975-a760-4947-97c7-9d557f068c75'}, 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'boot_index': 2, 'guest_format': None, 'attachment_id': 'ffb2a003-1737-4097-b2d9-e3bb5d3c7223', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztxUfEvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b152adb-ca3d-45cf-a394-5ba5b36180a8', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5d2f824-dd5b-4306-a67e-2a7aeda984a2', 'serial': 'a5d2f824-dd5b-4306-a67e-2a7aeda984a2'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:39:56 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:39:56 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:39:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvTGZRVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:39:56 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:39:56 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:39:56 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[040d8772-3b49-4c14-9ae3-0240ad42a514]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:39:56 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[71228b74-e5cc-4b94-a8c9-3c63709770cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7] added
Apr 12 10:39:56 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[440a224f-f99f-4e7c-8fb0-65c9ea5c42c8]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4958a7d0-ae7d-44fa-82eb-81f076387367]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EvTGZRVr {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EvTGZRVr" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d136af8-7c48-4c36-be3b-64052dd377b8]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EvTGZRVr'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[afabec87-c2ed-4289-a23e-c3ad09b23c9e]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f1a470-85c2-4a0d-ae3d-30e4023440a2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:56 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:56 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:39:56 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:56 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:56 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:39:56 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2cefda-fb4c-4c07-8838-d7130fc507d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7, portal: 172.16.0.220,3260]
Apr 12 10:39:56 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7, portal: 172.16.0.220,3260] successful.
Apr 12 10:39:56 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[68667333-0d97-4463-876c-065f06de465e]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e871d84e-af3f-4181-ba5f-43548f66cfcf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:56 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:56 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:39:56 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:39:56 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:56 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:56 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:39:56 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:39:56 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc75877-416b-4195-b399-833c9cd6842b]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:39:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvTGZRVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23466646433383963', 'path': '/dev/sde'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466646433383963', 'path': '/dev/sde'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OHLDsUfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:39:57 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:39:57 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:39:57 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16e3922-233d-4fd7-a3e5-16001b05e8c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:39:57 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0e381d-9eea-42e3-ae7d-4b4c964f08f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75] added
Apr 12 10:39:57 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f434812-7834-4f23-9144-c0a47fbdddc3]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c556e07-0e36-45ab-a5ff-1e9b83d765dc]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OHLDsUfi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OHLDsUfi" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddbd5bc-c582-4cf5-a646-1a00434743e3]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OHLDsUfi'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[51937701-60a0-43c5-bd33-f36fe4ab56d0]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c88d242-e1c5-4e3a-9dbe-a5f4de9a14ee]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:57 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:57 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:39:57 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:39:57 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:57 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:57 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:39:57 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:39:57 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1307986a-b074-43d2-bcf9-8a9987b72f60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75, portal: 172.16.0.220,3260]
Apr 12 10:39:57 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75, portal: 172.16.0.220,3260] successful.
Apr 12 10:39:57 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfe25e4-d680-4392-8173-a83f545b281f]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2005194-136c-479d-855c-7dc0879d4cb5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:57 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:57 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:39:57 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:39:57 user nova-compute[71557]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)
Apr 12 10:39:57 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:57 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:57 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:39:57 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:39:57 user nova-compute[71557]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)
Apr 12 10:39:57 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:39:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4c1609-6ba9-4069-a31b-2bd613b9fdc0]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: None {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG nova.objects.instance [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lazy-loading 'flavor' on Instance uuid a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:39:58 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Ignoring supplied device name: /dev/vdb
Apr 12 10:39:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:39:58 user nova-compute[71557]: INFO nova.compute.manager [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Attaching volume dea9ff7f-5072-4321-a399-4f61bb957b28 to /dev/vdb
Apr 12 10:39:58 user nova-compute[71557]: DEBUG os_brick.utils [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[58454038-68bb-4758-9c91-2b59004dda8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4ba5cf-b6a9-4772-a9c0-ac1718d0dd95]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aed9fac-63dd-4097-9d43-101267d8ad26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d430e5f5-f57d-449d-a423-8848e450da07]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:39:58 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:39:58 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a889c3dd-57b9-4fcf-9fcd-2cae9054a203]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG os_brick.utils [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:39:58 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Updating existing volume attachment record: 23deb7a9-7397-4729-a558-8f1a2dfee654 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OHLDsUfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23335303939383435', 'path': '/dev/sdf'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335303939383435', 'path': '/dev/sdf'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztxUfEvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:39:59 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:39:59 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:39:59 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ce3c11-0ef9-4135-9251-40386d7b4549]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:39:59 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[07feedd3-1576-4192-9db5-692475d3591b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2] added
Apr 12 10:39:59 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8534561f-4a4c-438b-8ef8-7c8d21edac09]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56d1402-7b66-4617-8d44-014d6e32f2e4]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztxUfEvm {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztxUfEvm" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[301e9131-3da6-4cf7-8557-84489c3c6da1]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ztxUfEvm'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e68d2e5-b65b-4003-9b0f-3b0a4ae433ea]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc50eee-cbf1-4193-b384-0e04c19f3579]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:59 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:59 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:39:59 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:39:59 user nova-compute[71557]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)
Apr 12 10:39:59 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:59 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:59 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:39:59 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:39:59 user nova-compute[71557]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)
Apr 12 10:39:59 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9d2787-490d-4ac9-965b-5ba1e0289d09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2, portal: 172.16.0.220,3260]
Apr 12 10:39:59 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2, portal: 172.16.0.220,3260] successful.
Apr 12 10:39:59 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[488f8a4b-b1e9-4532-ab03-660cc1859951]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e448ba-851c-4271-bb07-2b66983860a8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:59 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:59 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:39:59 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:39:59 user nova-compute[71557]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)
Apr 12 10:39:59 user nova-compute[71557]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 (non-flash)
Apr 12 10:39:59 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:39:59 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:39:59 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:39:59 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:39:59 user nova-compute[71557]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)
Apr 12 10:39:59 user nova-compute[71557]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 (non-flash)
Apr 12 10:39:59 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] HCTL ('38', '-', '-', 0) found on session 18 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6011ad-e55d-45ae-bb40-86337f78818f]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Searching for a device in session 18 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztxUfEvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:39:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23934663339333635', 'path': '/dev/sdg'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934663339333635', 'path': '/dev/sdg'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-231402709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-231402709',id=17,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgrnV5i22OFRG0E5speJrbQ5C2cFr366R1ofK1KHnfKlkXjouVmIG6gTeCAblaA6aHPA7V/zt8E89wRDDgsgcclBN9hLWspmMoLKSmejTbAwlxWQgzo516k6V5HD6mhxg==',key_name='tempest-keypair-1587791170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1ec9852adb94a5086dc3ef48871d5bc',ramdisk_id='',reservation_id='r-ajljxdx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1574485217',owner_user_name='tempest-TaggedBootDevicesTest-1574485217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21034326c41f487181d19f60e0ccf219',uuid=6b152adb-ca3d-45cf-a394-5ba5b36180a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "address": "fa:16:3e:cf:11:4a", "network": {"id": "698d4aee-44be-48ca-ab9b-0d58aed34d96", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1402217495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf1aa56-7b", "ovs_interfaceid": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converting VIF {"id": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "address": "fa:16:3e:cf:11:4a", "network": {"id": "698d4aee-44be-48ca-ab9b-0d58aed34d96", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1402217495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf1aa56-7b", "ovs_interfaceid": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=daf1aa56-7b24-4f41-93fd-a54cdf96428f,network=Network(698d4aee-44be-48ca-ab9b-0d58aed34d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf1aa56-7b') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-231402709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-231402709',id=17,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgrnV5i22OFRG0E5speJrbQ5C2cFr366R1ofK1KHnfKlkXjouVmIG6gTeCAblaA6aHPA7V/zt8E89wRDDgsgcclBN9hLWspmMoLKSmejTbAwlxWQgzo516k6V5HD6mhxg==',key_name='tempest-keypair-1587791170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1ec9852adb94a5086dc3ef48871d5bc',ramdisk_id='',reservation_id='r-ajljxdx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1574485217',owner_user_name='tempest-TaggedBootDevicesTest-1574485217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21034326c41f487181d19f60e0ccf219',uuid=6b152adb-ca3d-45cf-a394-5ba5b36180a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "address": "fa:16:3e:15:59:c8", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbdccd3-ba", "ovs_interfaceid": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converting VIF {"id": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "address": "fa:16:3e:15:59:c8", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbdccd3-ba", "ovs_interfaceid": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:59:c8,bridge_name='br-int',has_traffic_filtering=True,id=bbbdccd3-ba1c-46e2-90b5-10d6036f72c7,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbbbdccd3-ba') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-231402709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-231402709',id=17,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgrnV5i22OFRG0E5speJrbQ5C2cFr366R1ofK1KHnfKlkXjouVmIG6gTeCAblaA6aHPA7V/zt8E89wRDDgsgcclBN9hLWspmMoLKSmejTbAwlxWQgzo516k6V5HD6mhxg==',key_name='tempest-keypair-1587791170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1ec9852adb94a5086dc3ef48871d5bc',ramdisk_id='',reservation_id='r-ajljxdx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1574485217',owner_user_name='tempest-TaggedBootDevicesTest-1574485217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21034326c41f487181d19f60e0ccf219',uuid=6b152adb-ca3d-45cf-a394-5ba5b36180a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "address": "fa:16:3e:20:f6:ea", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e56f7-00", "ovs_interfaceid": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converting VIF {"id": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "address": "fa:16:3e:20:f6:ea", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e56f7-00", "ovs_interfaceid": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:f6:ea,bridge_name='br-int',has_traffic_filtering=True,id=e16e56f7-00ab-422d-95b3-d1b204f693a3,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape16e56f7-00') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-231402709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-231402709',id=17,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgrnV5i22OFRG0E5speJrbQ5C2cFr366R1ofK1KHnfKlkXjouVmIG6gTeCAblaA6aHPA7V/zt8E89wRDDgsgcclBN9hLWspmMoLKSmejTbAwlxWQgzo516k6V5HD6mhxg==',key_name='tempest-keypair-1587791170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1ec9852adb94a5086dc3ef48871d5bc',ramdisk_id='',reservation_id='r-ajljxdx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1574485217',owner_user_name='tempest-TaggedBootDevicesTest-1574485217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21034326c41f487181d19f60e0ccf219',uuid=6b152adb-ca3d-45cf-a394-5ba5b36180a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb79e431-1d99-40eb-94a0-20032fa213fb", "address": "fa:16:3e:fe:d3:c6", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb79e431-1d", "ovs_interfaceid": "fb79e431-1d99-40eb-94a0-20032fa213fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converting VIF {"id": "fb79e431-1d99-40eb-94a0-20032fa213fb", "address": "fa:16:3e:fe:d3:c6", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb79e431-1d", "ovs_interfaceid": "fb79e431-1d99-40eb-94a0-20032fa213fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d3:c6,bridge_name='br-int',has_traffic_filtering=True,id=fb79e431-1d99-40eb-94a0-20032fa213fb,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb79e431-1d') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-231402709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-231402709',id=17,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgrnV5i22OFRG0E5speJrbQ5C2cFr366R1ofK1KHnfKlkXjouVmIG6gTeCAblaA6aHPA7V/zt8E89wRDDgsgcclBN9hLWspmMoLKSmejTbAwlxWQgzo516k6V5HD6mhxg==',key_name='tempest-keypair-1587791170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1ec9852adb94a5086dc3ef48871d5bc',ramdisk_id='',reservation_id='r-ajljxdx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1574485217',owner_user_name='tempest-TaggedBootDevicesTest-1574485217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21034326c41f487181d19f60e0ccf219',uuid=6b152adb-ca3d-45cf-a394-5ba5b36180a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "address": "fa:16:3e:fe:8f:eb", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825c6036-d1", "ovs_interfaceid": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converting VIF {"id": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "address": "fa:16:3e:fe:8f:eb", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825c6036-d1", "ovs_interfaceid": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:8f:eb,bridge_name='br-int',has_traffic_filtering=True,id=825c6036-d16c-43ab-9f6a-2bb133bf51b8,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825c6036-d1') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-231402709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-231402709',id=17,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgrnV5i22OFRG0E5speJrbQ5C2cFr366R1ofK1KHnfKlkXjouVmIG6gTeCAblaA6aHPA7V/zt8E89wRDDgsgcclBN9hLWspmMoLKSmejTbAwlxWQgzo516k6V5HD6mhxg==',key_name='tempest-keypair-1587791170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1ec9852adb94a5086dc3ef48871d5bc',ramdisk_id='',reservation_id='r-ajljxdx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1574485217',owner_user_name='tempest-TaggedBootDevicesTest-1574485217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21034326c41f487181d19f60e0ccf219',uuid=6b152adb-ca3d-45cf-a394-5ba5b36180a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "address": "fa:16:3e:59:ab:3b", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13923b13-db", "ovs_interfaceid": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converting VIF {"id": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "address": "fa:16:3e:59:ab:3b", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13923b13-db", "ovs_interfaceid": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:ab:3b,bridge_name='br-int',has_traffic_filtering=True,id=13923b13-db35-4b98-b2b0-e2e18fd8441e,network=Network(91288215-145e-4cd6-953e-edb9f28d5c84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13923b13-db') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-231402709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-231402709',id=17,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgrnV5i22OFRG0E5speJrbQ5C2cFr366R1ofK1KHnfKlkXjouVmIG6gTeCAblaA6aHPA7V/zt8E89wRDDgsgcclBN9hLWspmMoLKSmejTbAwlxWQgzo516k6V5HD6mhxg==',key_name='tempest-keypair-1587791170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1ec9852adb94a5086dc3ef48871d5bc',ramdisk_id='',reservation_id='r-ajljxdx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1574485217',owner_user_name='tempest-TaggedBootDevicesTest-1574485217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21034326c41f487181d19f60e0ccf219',uuid=6b152adb-ca3d-45cf-a394-5ba5b36180a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "address": "fa:16:3e:9d:7d:33", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8cf480-05", "ovs_interfaceid": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converting VIF {"id": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "address": "fa:16:3e:9d:7d:33", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8cf480-05", "ovs_interfaceid": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:7d:33,bridge_name='br-int',has_traffic_filtering=True,id=3c8cf480-05d6-463a-a97e-a9d869ac3860,network=Network(91288215-145e-4cd6-953e-edb9f28d5c84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8cf480-05') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.objects.instance [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b152adb-ca3d-45cf-a394-5ba5b36180a8 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:40:00 user nova-compute[71557]:   <uuid>6b152adb-ca3d-45cf-a394-5ba5b36180a8</uuid>
Apr 12 10:40:00 user nova-compute[71557]:   <name>instance-00000011</name>
Apr 12 10:40:00 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:40:00 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:40:00 user nova-compute[71557]:   <metadata>
Apr 12 10:40:00 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:40:00 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:40:00 user nova-compute[71557]:       <nova:name>tempest-device-tagging-server-231402709</nova:name>
Apr 12 10:40:00 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:39:56</nova:creationTime>
Apr 12 10:40:00 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:40:00 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:40:00 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:40:00 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:40:00 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:40:00 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:40:00 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:40:00 user nova-compute[71557]:       <nova:owner>
Apr 12 10:40:00 user nova-compute[71557]:         <nova:user uuid="21034326c41f487181d19f60e0ccf219">tempest-TaggedBootDevicesTest-1574485217-project-member</nova:user>
Apr 12 10:40:00 user nova-compute[71557]:         <nova:project uuid="f1ec9852adb94a5086dc3ef48871d5bc">tempest-TaggedBootDevicesTest-1574485217</nova:project>
Apr 12 10:40:00 user nova-compute[71557]:       </nova:owner>
Apr 12 10:40:00 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:40:00 user nova-compute[71557]:       <nova:ports>
Apr 12 10:40:00 user nova-compute[71557]:         <nova:port uuid="daf1aa56-7b24-4f41-93fd-a54cdf96428f">
Apr 12 10:40:00 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 10:40:00 user nova-compute[71557]:         </nova:port>
Apr 12 10:40:00 user nova-compute[71557]:         <nova:port uuid="bbbdccd3-ba1c-46e2-90b5-10d6036f72c7">
Apr 12 10:40:00 user nova-compute[71557]:           <nova:ip type="fixed" address="10.1.1.101" ipVersion="4"/>
Apr 12 10:40:00 user nova-compute[71557]:         </nova:port>
Apr 12 10:40:00 user nova-compute[71557]:         <nova:port uuid="e16e56f7-00ab-422d-95b3-d1b204f693a3">
Apr 12 10:40:00 user nova-compute[71557]:           <nova:ip type="fixed" address="10.1.1.177" ipVersion="4"/>
Apr 12 10:40:00 user nova-compute[71557]:         </nova:port>
Apr 12 10:40:00 user nova-compute[71557]:         <nova:port uuid="fb79e431-1d99-40eb-94a0-20032fa213fb">
Apr 12 10:40:00 user nova-compute[71557]:           <nova:ip type="fixed" address="10.1.1.154" ipVersion="4"/>
Apr 12 10:40:00 user nova-compute[71557]:         </nova:port>
Apr 12 10:40:00 user nova-compute[71557]:         <nova:port uuid="825c6036-d16c-43ab-9f6a-2bb133bf51b8">
Apr 12 10:40:00 user nova-compute[71557]:           <nova:ip type="fixed" address="10.1.1.11" ipVersion="4"/>
Apr 12 10:40:00 user nova-compute[71557]:         </nova:port>
Apr 12 10:40:00 user nova-compute[71557]:         <nova:port uuid="13923b13-db35-4b98-b2b0-e2e18fd8441e">
Apr 12 10:40:00 user nova-compute[71557]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 12 10:40:00 user nova-compute[71557]:         </nova:port>
Apr 12 10:40:00 user nova-compute[71557]:         <nova:port uuid="3c8cf480-05d6-463a-a97e-a9d869ac3860">
Apr 12 10:40:00 user nova-compute[71557]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 12 10:40:00 user nova-compute[71557]:         </nova:port>
Apr 12 10:40:00 user nova-compute[71557]:       </nova:ports>
Apr 12 10:40:00 user nova-compute[71557]:     </nova:instance>
Apr 12 10:40:00 user nova-compute[71557]:   </metadata>
Apr 12 10:40:00 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:40:00 user nova-compute[71557]:     <system>
Apr 12 10:40:00 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:40:00 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:40:00 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:40:00 user nova-compute[71557]:       <entry name="serial">6b152adb-ca3d-45cf-a394-5ba5b36180a8</entry>
Apr 12 10:40:00 user nova-compute[71557]:       <entry name="uuid">6b152adb-ca3d-45cf-a394-5ba5b36180a8</entry>
Apr 12 10:40:00 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:40:00 user nova-compute[71557]:     </system>
Apr 12 10:40:00 user nova-compute[71557]:   </sysinfo>
Apr 12 10:40:00 user nova-compute[71557]:   <os>
Apr 12 10:40:00 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:40:00 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:40:00 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:40:00 user nova-compute[71557]:   </os>
Apr 12 10:40:00 user nova-compute[71557]:   <features>
Apr 12 10:40:00 user nova-compute[71557]:     <acpi/>
Apr 12 10:40:00 user nova-compute[71557]:     <apic/>
Apr 12 10:40:00 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:40:00 user nova-compute[71557]:   </features>
Apr 12 10:40:00 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:40:00 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:40:00 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:40:00 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:40:00 user nova-compute[71557]:   </clock>
Apr 12 10:40:00 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:40:00 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:40:00 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:40:00 user nova-compute[71557]:   </cpu>
Apr 12 10:40:00 user nova-compute[71557]:   <devices>
Apr 12 10:40:00 user nova-compute[71557]:     <disk type="file" device="cdrom">
Apr 12 10:40:00 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 10:40:00 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/6b152adb-ca3d-45cf-a394-5ba5b36180a8/disk.config"/>
Apr 12 10:40:00 user nova-compute[71557]:       <target dev="hda" bus="ide"/>
Apr 12 10:40:00 user nova-compute[71557]:     </disk>
Apr 12 10:40:00 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:40:00 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:40:00 user nova-compute[71557]:       <source dev="/dev/sde"/>
Apr 12 10:40:00 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:40:00 user nova-compute[71557]:       <serial>b76b2ba5-6ae0-4392-9b42-e06b4a967ac7</serial>
Apr 12 10:40:00 user nova-compute[71557]:     </disk>
Apr 12 10:40:00 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:40:00 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:40:00 user nova-compute[71557]:       <source dev="/dev/sdf"/>
Apr 12 10:40:00 user nova-compute[71557]:       <target dev="vdb" bus="virtio"/>
Apr 12 10:40:00 user nova-compute[71557]:       <serial>df938975-a760-4947-97c7-9d557f068c75</serial>
Apr 12 10:40:00 user nova-compute[71557]:     </disk>
Apr 12 10:40:00 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:40:00 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:40:00 user nova-compute[71557]:       <source dev="/dev/sdg"/>
Apr 12 10:40:00 user nova-compute[71557]:       <target dev="vdc" bus="virtio"/>
Apr 12 10:40:00 user nova-compute[71557]:       <serial>a5d2f824-dd5b-4306-a67e-2a7aeda984a2</serial>
Apr 12 10:40:00 user nova-compute[71557]:     </disk>
Apr 12 10:40:00 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:40:00 user nova-compute[71557]:       <mac address="fa:16:3e:cf:11:4a"/>
Apr 12 10:40:00 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:40:00 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:40:00 user nova-compute[71557]:       <target dev="tapdaf1aa56-7b"/>
Apr 12 10:40:00 user nova-compute[71557]:     </interface>
Apr 12 10:40:00 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:40:00 user nova-compute[71557]:       <mac address="fa:16:3e:15:59:c8"/>
Apr 12 10:40:00 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:40:00 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:40:00 user nova-compute[71557]:       <target dev="tapbbbdccd3-ba"/>
Apr 12 10:40:00 user nova-compute[71557]:     </interface>
Apr 12 10:40:00 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:40:00 user nova-compute[71557]:       <mac address="fa:16:3e:20:f6:ea"/>
Apr 12 10:40:00 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:40:00 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:40:00 user nova-compute[71557]:       <target dev="tape16e56f7-00"/>
Apr 12 10:40:00 user nova-compute[71557]:     </interface>
Apr 12 10:40:00 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:40:00 user nova-compute[71557]:       <mac address="fa:16:3e:fe:d3:c6"/>
Apr 12 10:40:00 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:40:00 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:40:00 user nova-compute[71557]:       <target dev="tapfb79e431-1d"/>
Apr 12 10:40:00 user nova-compute[71557]:     </interface>
Apr 12 10:40:00 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:40:00 user nova-compute[71557]:       <mac address="fa:16:3e:fe:8f:eb"/>
Apr 12 10:40:00 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:40:00 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:40:00 user nova-compute[71557]:       <target dev="tap825c6036-d1"/>
Apr 12 10:40:00 user nova-compute[71557]:     </interface>
Apr 12 10:40:00 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:40:00 user nova-compute[71557]:       <mac address="fa:16:3e:59:ab:3b"/>
Apr 12 10:40:00 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:40:00 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:40:00 user nova-compute[71557]:       <target dev="tap13923b13-db"/>
Apr 12 10:40:00 user nova-compute[71557]:     </interface>
Apr 12 10:40:00 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:40:00 user nova-compute[71557]:       <mac address="fa:16:3e:9d:7d:33"/>
Apr 12 10:40:00 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:40:00 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:40:00 user nova-compute[71557]:       <target dev="tap3c8cf480-05"/>
Apr 12 10:40:00 user nova-compute[71557]:     </interface>
Apr 12 10:40:00 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:40:00 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/6b152adb-ca3d-45cf-a394-5ba5b36180a8/console.log" append="off"/>
Apr 12 10:40:00 user nova-compute[71557]:     </serial>
Apr 12 10:40:00 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:40:00 user nova-compute[71557]:     <video>
Apr 12 10:40:00 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:40:00 user nova-compute[71557]:     </video>
Apr 12 10:40:00 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:40:00 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:40:00 user nova-compute[71557]:     </rng>
Apr 12 10:40:00 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:40:00 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:40:00 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:40:00 user nova-compute[71557]:     </memballoon>
Apr 12 10:40:00 user nova-compute[71557]:   </devices>
Apr 12 10:40:00 user nova-compute[71557]: </domain>
Apr 12 10:40:00 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-231402709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-231402709',id=17,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgrnV5i22OFRG0E5speJrbQ5C2cFr366R1ofK1KHnfKlkXjouVmIG6gTeCAblaA6aHPA7V/zt8E89wRDDgsgcclBN9hLWspmMoLKSmejTbAwlxWQgzo516k6V5HD6mhxg==',key_name='tempest-keypair-1587791170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1ec9852adb94a5086dc3ef48871d5bc',ramdisk_id='',reservation_id='r-ajljxdx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1574485217',owner_user_name='tempest-TaggedBootDevicesTest-1574485217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21034326c41f487181d19f60e0ccf219',uuid=6b152adb-ca3d-45cf-a394-5ba5b36180a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "address": "fa:16:3e:cf:11:4a", "network": {"id": "698d4aee-44be-48ca-ab9b-0d58aed34d96", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1402217495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf1aa56-7b", "ovs_interfaceid": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converting VIF {"id": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "address": "fa:16:3e:cf:11:4a", "network": {"id": "698d4aee-44be-48ca-ab9b-0d58aed34d96", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1402217495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf1aa56-7b", "ovs_interfaceid": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=daf1aa56-7b24-4f41-93fd-a54cdf96428f,network=Network(698d4aee-44be-48ca-ab9b-0d58aed34d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf1aa56-7b') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG os_vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=daf1aa56-7b24-4f41-93fd-a54cdf96428f,network=Network(698d4aee-44be-48ca-ab9b-0d58aed34d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf1aa56-7b') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdaf1aa56-7b, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdaf1aa56-7b, col_values=(('external_ids', {'iface-id': 'daf1aa56-7b24-4f41-93fd-a54cdf96428f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:11:4a', 'vm-uuid': '6b152adb-ca3d-45cf-a394-5ba5b36180a8'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: INFO os_vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=daf1aa56-7b24-4f41-93fd-a54cdf96428f,network=Network(698d4aee-44be-48ca-ab9b-0d58aed34d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf1aa56-7b')
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-231402709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-231402709',id=17,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgrnV5i22OFRG0E5speJrbQ5C2cFr366R1ofK1KHnfKlkXjouVmIG6gTeCAblaA6aHPA7V/zt8E89wRDDgsgcclBN9hLWspmMoLKSmejTbAwlxWQgzo516k6V5HD6mhxg==',key_name='tempest-keypair-1587791170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1ec9852adb94a5086dc3ef48871d5bc',ramdisk_id='',reservation_id='r-ajljxdx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1574485217',owner_user_name='tempest-TaggedBootDevicesTest-1574485217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21034326c41f487181d19f60e0ccf219',uuid=6b152adb-ca3d-45cf-a394-5ba5b36180a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "address": "fa:16:3e:15:59:c8", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbdccd3-ba", "ovs_interfaceid": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converting VIF {"id": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "address": "fa:16:3e:15:59:c8", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbdccd3-ba", "ovs_interfaceid": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:59:c8,bridge_name='br-int',has_traffic_filtering=True,id=bbbdccd3-ba1c-46e2-90b5-10d6036f72c7,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbbbdccd3-ba') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG os_vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:59:c8,bridge_name='br-int',has_traffic_filtering=True,id=bbbdccd3-ba1c-46e2-90b5-10d6036f72c7,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbbbdccd3-ba') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbbdccd3-ba, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbbbdccd3-ba, col_values=(('external_ids', {'iface-id': 'bbbdccd3-ba1c-46e2-90b5-10d6036f72c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:59:c8', 'vm-uuid': '6b152adb-ca3d-45cf-a394-5ba5b36180a8'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: INFO os_vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:59:c8,bridge_name='br-int',has_traffic_filtering=True,id=bbbdccd3-ba1c-46e2-90b5-10d6036f72c7,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbbbdccd3-ba')
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-231402709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-231402709',id=17,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgrnV5i22OFRG0E5speJrbQ5C2cFr366R1ofK1KHnfKlkXjouVmIG6gTeCAblaA6aHPA7V/zt8E89wRDDgsgcclBN9hLWspmMoLKSmejTbAwlxWQgzo516k6V5HD6mhxg==',key_name='tempest-keypair-1587791170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1ec9852adb94a5086dc3ef48871d5bc',ramdisk_id='',reservation_id='r-ajljxdx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1574485217',owner_user_name='tempest-TaggedBootDevicesTest-1574485217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21034326c41f487181d19f60e0ccf219',uuid=6b152adb-ca3d-45cf-a394-5ba5b36180a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "address": "fa:16:3e:20:f6:ea", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e56f7-00", "ovs_interfaceid": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converting VIF {"id": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "address": "fa:16:3e:20:f6:ea", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e56f7-00", "ovs_interfaceid": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:f6:ea,bridge_name='br-int',has_traffic_filtering=True,id=e16e56f7-00ab-422d-95b3-d1b204f693a3,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape16e56f7-00') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG os_vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:f6:ea,bridge_name='br-int',has_traffic_filtering=True,id=e16e56f7-00ab-422d-95b3-d1b204f693a3,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape16e56f7-00') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape16e56f7-00, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape16e56f7-00, col_values=(('external_ids', {'iface-id': 'e16e56f7-00ab-422d-95b3-d1b204f693a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:f6:ea', 'vm-uuid': '6b152adb-ca3d-45cf-a394-5ba5b36180a8'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: INFO os_vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:f6:ea,bridge_name='br-int',has_traffic_filtering=True,id=e16e56f7-00ab-422d-95b3-d1b204f693a3,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape16e56f7-00')
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-231402709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-231402709',id=17,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgrnV5i22OFRG0E5speJrbQ5C2cFr366R1ofK1KHnfKlkXjouVmIG6gTeCAblaA6aHPA7V/zt8E89wRDDgsgcclBN9hLWspmMoLKSmejTbAwlxWQgzo516k6V5HD6mhxg==',key_name='tempest-keypair-1587791170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1ec9852adb94a5086dc3ef48871d5bc',ramdisk_id='',reservation_id='r-ajljxdx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1574485217',owner_user_name='tempest-TaggedBootDevicesTest-1574485217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21034326c41f487181d19f60e0ccf219',uuid=6b152adb-ca3d-45cf-a394-5ba5b36180a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb79e431-1d99-40eb-94a0-20032fa213fb", "address": "fa:16:3e:fe:d3:c6", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb79e431-1d", "ovs_interfaceid": "fb79e431-1d99-40eb-94a0-20032fa213fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converting VIF {"id": "fb79e431-1d99-40eb-94a0-20032fa213fb", "address": "fa:16:3e:fe:d3:c6", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb79e431-1d", "ovs_interfaceid": "fb79e431-1d99-40eb-94a0-20032fa213fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d3:c6,bridge_name='br-int',has_traffic_filtering=True,id=fb79e431-1d99-40eb-94a0-20032fa213fb,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb79e431-1d') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG os_vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d3:c6,bridge_name='br-int',has_traffic_filtering=True,id=fb79e431-1d99-40eb-94a0-20032fa213fb,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb79e431-1d') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb79e431-1d, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfb79e431-1d, col_values=(('external_ids', {'iface-id': 'fb79e431-1d99-40eb-94a0-20032fa213fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:d3:c6', 'vm-uuid': '6b152adb-ca3d-45cf-a394-5ba5b36180a8'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: INFO os_vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d3:c6,bridge_name='br-int',has_traffic_filtering=True,id=fb79e431-1d99-40eb-94a0-20032fa213fb,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb79e431-1d')
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-231402709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-231402709',id=17,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgrnV5i22OFRG0E5speJrbQ5C2cFr366R1ofK1KHnfKlkXjouVmIG6gTeCAblaA6aHPA7V/zt8E89wRDDgsgcclBN9hLWspmMoLKSmejTbAwlxWQgzo516k6V5HD6mhxg==',key_name='tempest-keypair-1587791170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1ec9852adb94a5086dc3ef48871d5bc',ramdisk_id='',reservation_id='r-ajljxdx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1574485217',owner_user_name='tempest-TaggedBootDevicesTest-1574485217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21034326c41f487181d19f60e0ccf219',uuid=6b152adb-ca3d-45cf-a394-5ba5b36180a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "address": "fa:16:3e:fe:8f:eb", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825c6036-d1", "ovs_interfaceid": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converting VIF {"id": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "address": "fa:16:3e:fe:8f:eb", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825c6036-d1", "ovs_interfaceid": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:8f:eb,bridge_name='br-int',has_traffic_filtering=True,id=825c6036-d16c-43ab-9f6a-2bb133bf51b8,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825c6036-d1') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG os_vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:8f:eb,bridge_name='br-int',has_traffic_filtering=True,id=825c6036-d16c-43ab-9f6a-2bb133bf51b8,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825c6036-d1') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap825c6036-d1, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap825c6036-d1, col_values=(('external_ids', {'iface-id': '825c6036-d16c-43ab-9f6a-2bb133bf51b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:8f:eb', 'vm-uuid': '6b152adb-ca3d-45cf-a394-5ba5b36180a8'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: INFO os_vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:8f:eb,bridge_name='br-int',has_traffic_filtering=True,id=825c6036-d16c-43ab-9f6a-2bb133bf51b8,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825c6036-d1')
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-231402709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-231402709',id=17,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgrnV5i22OFRG0E5speJrbQ5C2cFr366R1ofK1KHnfKlkXjouVmIG6gTeCAblaA6aHPA7V/zt8E89wRDDgsgcclBN9hLWspmMoLKSmejTbAwlxWQgzo516k6V5HD6mhxg==',key_name='tempest-keypair-1587791170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1ec9852adb94a5086dc3ef48871d5bc',ramdisk_id='',reservation_id='r-ajljxdx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1574485217',owner_user_name='tempest-TaggedBootDevicesTest-1574485217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21034326c41f487181d19f60e0ccf219',uuid=6b152adb-ca3d-45cf-a394-5ba5b36180a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "address": "fa:16:3e:59:ab:3b", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13923b13-db", "ovs_interfaceid": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converting VIF {"id": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "address": "fa:16:3e:59:ab:3b", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13923b13-db", "ovs_interfaceid": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:ab:3b,bridge_name='br-int',has_traffic_filtering=True,id=13923b13-db35-4b98-b2b0-e2e18fd8441e,network=Network(91288215-145e-4cd6-953e-edb9f28d5c84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13923b13-db') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG os_vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:ab:3b,bridge_name='br-int',has_traffic_filtering=True,id=13923b13-db35-4b98-b2b0-e2e18fd8441e,network=Network(91288215-145e-4cd6-953e-edb9f28d5c84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13923b13-db') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13923b13-db, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13923b13-db, col_values=(('external_ids', {'iface-id': '13923b13-db35-4b98-b2b0-e2e18fd8441e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:ab:3b', 'vm-uuid': '6b152adb-ca3d-45cf-a394-5ba5b36180a8'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: INFO os_vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:ab:3b,bridge_name='br-int',has_traffic_filtering=True,id=13923b13-db35-4b98-b2b0-e2e18fd8441e,network=Network(91288215-145e-4cd6-953e-edb9f28d5c84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13923b13-db')
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-231402709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-231402709',id=17,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgrnV5i22OFRG0E5speJrbQ5C2cFr366R1ofK1KHnfKlkXjouVmIG6gTeCAblaA6aHPA7V/zt8E89wRDDgsgcclBN9hLWspmMoLKSmejTbAwlxWQgzo516k6V5HD6mhxg==',key_name='tempest-keypair-1587791170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1ec9852adb94a5086dc3ef48871d5bc',ramdisk_id='',reservation_id='r-ajljxdx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1574485217',owner_user_name='tempest-TaggedBootDevicesTest-1574485217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21034326c41f487181d19f60e0ccf219',uuid=6b152adb-ca3d-45cf-a394-5ba5b36180a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "address": "fa:16:3e:9d:7d:33", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8cf480-05", "ovs_interfaceid": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converting VIF {"id": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "address": "fa:16:3e:9d:7d:33", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8cf480-05", "ovs_interfaceid": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:7d:33,bridge_name='br-int',has_traffic_filtering=True,id=3c8cf480-05d6-463a-a97e-a9d869ac3860,network=Network(91288215-145e-4cd6-953e-edb9f28d5c84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8cf480-05') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG os_vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:7d:33,bridge_name='br-int',has_traffic_filtering=True,id=3c8cf480-05d6-463a-a97e-a9d869ac3860,network=Network(91288215-145e-4cd6-953e-edb9f28d5c84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8cf480-05') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c8cf480-05, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c8cf480-05, col_values=(('external_ids', {'iface-id': '3c8cf480-05d6-463a-a97e-a9d869ac3860', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:7d:33', 'vm-uuid': '6b152adb-ca3d-45cf-a394-5ba5b36180a8'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:00 user nova-compute[71557]: INFO os_vif [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:7d:33,bridge_name='br-int',has_traffic_filtering=True,id=3c8cf480-05d6-463a-a97e-a9d869ac3860,network=Network(91288215-145e-4cd6-953e-edb9f28d5c84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8cf480-05')
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] No BDM found with device name hda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] No VIF found with MAC fa:16:3e:cf:11:4a, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:40:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] No VIF found with MAC fa:16:3e:fe:8f:eb, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:40:00 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Using config drive
Apr 12 10:40:01 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Creating config drive at /opt/stack/data/nova/instances/6b152adb-ca3d-45cf-a394-5ba5b36180a8/disk.config
Apr 12 10:40:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6b152adb-ca3d-45cf-a394-5ba5b36180a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuagl0aus {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6b152adb-ca3d-45cf-a394-5ba5b36180a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuagl0aus" returned: 0 in 0.071s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:02 user nova-compute[71557]: DEBUG nova.compute.manager [req-aac428ea-c910-411b-8e21-8b7623c9974b req-094117de-5147-4853-a577-164ebeca7152 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-plugged-daf1aa56-7b24-4f41-93fd-a54cdf96428f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-aac428ea-c910-411b-8e21-8b7623c9974b req-094117de-5147-4853-a577-164ebeca7152 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-aac428ea-c910-411b-8e21-8b7623c9974b req-094117de-5147-4853-a577-164ebeca7152 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-aac428ea-c910-411b-8e21-8b7623c9974b req-094117de-5147-4853-a577-164ebeca7152 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:02 user nova-compute[71557]: DEBUG nova.compute.manager [req-aac428ea-c910-411b-8e21-8b7623c9974b req-094117de-5147-4853-a577-164ebeca7152 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-plugged-daf1aa56-7b24-4f41-93fd-a54cdf96428f {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:02 user nova-compute[71557]: WARNING nova.compute.manager [req-aac428ea-c910-411b-8e21-8b7623c9974b req-094117de-5147-4853-a577-164ebeca7152 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received unexpected event network-vif-plugged-daf1aa56-7b24-4f41-93fd-a54cdf96428f for instance with vm_state building and task_state spawning.
Apr 12 10:40:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:03 user nova-compute[71557]: DEBUG nova.compute.manager [req-38f21379-f732-431f-844e-6d0532371590 req-b0f60ec6-dc18-4116-b9ee-9d12af44f5cf service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-plugged-fb79e431-1d99-40eb-94a0-20032fa213fb {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-38f21379-f732-431f-844e-6d0532371590 req-b0f60ec6-dc18-4116-b9ee-9d12af44f5cf service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-38f21379-f732-431f-844e-6d0532371590 req-b0f60ec6-dc18-4116-b9ee-9d12af44f5cf service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-38f21379-f732-431f-844e-6d0532371590 req-b0f60ec6-dc18-4116-b9ee-9d12af44f5cf service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:03 user nova-compute[71557]: DEBUG nova.compute.manager [req-38f21379-f732-431f-844e-6d0532371590 req-b0f60ec6-dc18-4116-b9ee-9d12af44f5cf service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-plugged-fb79e431-1d99-40eb-94a0-20032fa213fb {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:03 user nova-compute[71557]: WARNING nova.compute.manager [req-38f21379-f732-431f-844e-6d0532371590 req-b0f60ec6-dc18-4116-b9ee-9d12af44f5cf service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received unexpected event network-vif-plugged-fb79e431-1d99-40eb-94a0-20032fa213fb for instance with vm_state building and task_state spawning.
Apr 12 10:40:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-816b5efd-7696-40c8-95ca-d013f2b28749 req-70f520d3-5b74-4c92-8551-537ad867ced0 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-plugged-825c6036-d16c-43ab-9f6a-2bb133bf51b8 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-816b5efd-7696-40c8-95ca-d013f2b28749 req-70f520d3-5b74-4c92-8551-537ad867ced0 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-816b5efd-7696-40c8-95ca-d013f2b28749 req-70f520d3-5b74-4c92-8551-537ad867ced0 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-816b5efd-7696-40c8-95ca-d013f2b28749 req-70f520d3-5b74-4c92-8551-537ad867ced0 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-816b5efd-7696-40c8-95ca-d013f2b28749 req-70f520d3-5b74-4c92-8551-537ad867ced0 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-plugged-825c6036-d16c-43ab-9f6a-2bb133bf51b8 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:04 user nova-compute[71557]: WARNING nova.compute.manager [req-816b5efd-7696-40c8-95ca-d013f2b28749 req-70f520d3-5b74-4c92-8551-537ad867ced0 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received unexpected event network-vif-plugged-825c6036-d16c-43ab-9f6a-2bb133bf51b8 for instance with vm_state building and task_state spawning.
Apr 12 10:40:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZDFoPnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:40:04 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:40:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:40:04 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:40:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:40:04 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-plugged-daf1aa56-7b24-4f41-93fd-a54cdf96428f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-plugged-daf1aa56-7b24-4f41-93fd-a54cdf96428f {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:04 user nova-compute[71557]: WARNING nova.compute.manager [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received unexpected event network-vif-plugged-daf1aa56-7b24-4f41-93fd-a54cdf96428f for instance with vm_state building and task_state spawning.
Apr 12 10:40:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-plugged-bbbdccd3-ba1c-46e2-90b5-10d6036f72c7 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-plugged-bbbdccd3-ba1c-46e2-90b5-10d6036f72c7 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:04 user nova-compute[71557]: WARNING nova.compute.manager [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received unexpected event network-vif-plugged-bbbdccd3-ba1c-46e2-90b5-10d6036f72c7 for instance with vm_state building and task_state spawning.
Apr 12 10:40:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-plugged-bbbdccd3-ba1c-46e2-90b5-10d6036f72c7 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-plugged-bbbdccd3-ba1c-46e2-90b5-10d6036f72c7 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:04 user nova-compute[71557]: WARNING nova.compute.manager [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received unexpected event network-vif-plugged-bbbdccd3-ba1c-46e2-90b5-10d6036f72c7 for instance with vm_state building and task_state spawning.
Apr 12 10:40:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-plugged-e16e56f7-00ab-422d-95b3-d1b204f693a3 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-plugged-e16e56f7-00ab-422d-95b3-d1b204f693a3 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:04 user nova-compute[71557]: WARNING nova.compute.manager [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received unexpected event network-vif-plugged-e16e56f7-00ab-422d-95b3-d1b204f693a3 for instance with vm_state building and task_state spawning.
Apr 12 10:40:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-plugged-e16e56f7-00ab-422d-95b3-d1b204f693a3 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-plugged-e16e56f7-00ab-422d-95b3-d1b204f693a3 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:04 user nova-compute[71557]: WARNING nova.compute.manager [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received unexpected event network-vif-plugged-e16e56f7-00ab-422d-95b3-d1b204f693a3 for instance with vm_state building and task_state spawning.
Apr 12 10:40:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-plugged-3c8cf480-05d6-463a-a97e-a9d869ac3860 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG nova.compute.manager [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-plugged-3c8cf480-05d6-463a-a97e-a9d869ac3860 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:04 user nova-compute[71557]: WARNING nova.compute.manager [req-cda689f7-a063-4121-9527-548182fb7f03 req-ff3375de-ba6b-4319-bd32-ed570653c113 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received unexpected event network-vif-plugged-3c8cf480-05d6-463a-a97e-a9d869ac3860 for instance with vm_state building and task_state spawning.
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8fea7e-a43d-49eb-8b8c-f64af42badb6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:40:04 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[556e673d-8f76-4b6b-b6e2-61ba8e426505]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28] added
Apr 12 10:40:04 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b223e2a-161b-4170-a67e-38b90450c0bb]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1b4f16-0492-4d6d-9db5-aff751343257]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:40:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZDFoPnU {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZDFoPnU" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1754822f-0888-4794-a7c8-bd0a599eda42]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wZDFoPnU'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca0e872-5c57-450d-818e-5ff51f155fe5]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[034be807-8e40-4de0-a85d-14fd6583919e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 -p 172.16.0.220:3260 --login" returned: 0 in 0.194s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0000e7c3-8431-4ac7-a5fa-9a1058157e85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28, portal: 172.16.0.220,3260]
Apr 12 10:40:05 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28, portal: 172.16.0.220,3260] successful.
Apr 12 10:40:05 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9139c6b-4b12-4a35-b074-1d0b26b258ac]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c589a8c2-1ee8-4241-b08c-4744124bc880]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 (non-flash)
Apr 12 10:40:05 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.487s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] HCTL ('39', '-', '-', 0) found on session 19 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3a9c6e-9311-42d6-aafc-152542fd62d2]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Searching for a device in session 19 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZDFoPnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG nova.compute.manager [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-plugged-fb79e431-1d99-40eb-94a0-20032fa213fb {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG nova.compute.manager [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-plugged-fb79e431-1d99-40eb-94a0-20032fa213fb {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:05 user nova-compute[71557]: WARNING nova.compute.manager [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received unexpected event network-vif-plugged-fb79e431-1d99-40eb-94a0-20032fa213fb for instance with vm_state building and task_state spawning.
Apr 12 10:40:05 user nova-compute[71557]: DEBUG nova.compute.manager [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-plugged-13923b13-db35-4b98-b2b0-e2e18fd8441e {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG nova.compute.manager [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-plugged-13923b13-db35-4b98-b2b0-e2e18fd8441e {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:05 user nova-compute[71557]: WARNING nova.compute.manager [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received unexpected event network-vif-plugged-13923b13-db35-4b98-b2b0-e2e18fd8441e for instance with vm_state building and task_state spawning.
Apr 12 10:40:05 user nova-compute[71557]: DEBUG nova.compute.manager [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-plugged-13923b13-db35-4b98-b2b0-e2e18fd8441e {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:05 user nova-compute[71557]: DEBUG nova.compute.manager [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-plugged-13923b13-db35-4b98-b2b0-e2e18fd8441e {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:05 user nova-compute[71557]: WARNING nova.compute.manager [req-f53d0213-bfdd-45e9-af68-38f24f387b38 req-e2599490-1c9a-4d3b-a3ee-d6bb82931115 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received unexpected event network-vif-plugged-13923b13-db35-4b98-b2b0-e2e18fd8441e for instance with vm_state building and task_state spawning.
Apr 12 10:40:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.523s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] <== connect_volume: return (1524ms) {'type': 'block', 'scsi_wwn': '26531656437373463', 'path': '/dev/sdh'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531656437373463', 'path': '/dev/sdh'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.objects.instance [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lazy-loading 'flavor' on Instance uuid a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 10:40:06 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:40:06 user nova-compute[71557]:   <source dev="/dev/sdh"/>
Apr 12 10:40:06 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:40:06 user nova-compute[71557]:   <serial>dea9ff7f-5072-4321-a399-4f61bb957b28</serial>
Apr 12 10:40:06 user nova-compute[71557]: </disk>
Apr 12 10:40:06 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.compute.manager [req-8bb27d9d-1767-4f1a-92d7-e6eecc0a4d49 req-a50a8fa5-93b6-4a97-a662-fa8151764b99 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-plugged-825c6036-d16c-43ab-9f6a-2bb133bf51b8 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8bb27d9d-1767-4f1a-92d7-e6eecc0a4d49 req-a50a8fa5-93b6-4a97-a662-fa8151764b99 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8bb27d9d-1767-4f1a-92d7-e6eecc0a4d49 req-a50a8fa5-93b6-4a97-a662-fa8151764b99 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8bb27d9d-1767-4f1a-92d7-e6eecc0a4d49 req-a50a8fa5-93b6-4a97-a662-fa8151764b99 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.compute.manager [req-8bb27d9d-1767-4f1a-92d7-e6eecc0a4d49 req-a50a8fa5-93b6-4a97-a662-fa8151764b99 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-plugged-825c6036-d16c-43ab-9f6a-2bb133bf51b8 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:06 user nova-compute[71557]: WARNING nova.compute.manager [req-8bb27d9d-1767-4f1a-92d7-e6eecc0a4d49 req-a50a8fa5-93b6-4a97-a662-fa8151764b99 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received unexpected event network-vif-plugged-825c6036-d16c-43ab-9f6a-2bb133bf51b8 for instance with vm_state building and task_state spawning.
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296006.7843473, 6b152adb-ca3d-45cf-a394-5ba5b36180a8 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:40:06 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] VM Resumed (Lifecycle Event)
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:40:06 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Instance spawned successfully.
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:40:06 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296006.7860053, 6b152adb-ca3d-45cf-a394-5ba5b36180a8 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:40:06 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] VM Started (Lifecycle Event)
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] No VIF found with MAC fa:16:3e:39:2a:b8, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:40:06 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:40:06 user nova-compute[71557]: INFO nova.compute.manager [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Took 10.67 seconds to spawn the instance on the hypervisor.
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.compute.manager [req-856051e5-7183-408c-9690-d15d9ce9f47c req-20afb5e5-c955-4634-bc0c-d1ab36cc07e1 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-plugged-3c8cf480-05d6-463a-a97e-a9d869ac3860 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-856051e5-7183-408c-9690-d15d9ce9f47c req-20afb5e5-c955-4634-bc0c-d1ab36cc07e1 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-856051e5-7183-408c-9690-d15d9ce9f47c req-20afb5e5-c955-4634-bc0c-d1ab36cc07e1 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-856051e5-7183-408c-9690-d15d9ce9f47c req-20afb5e5-c955-4634-bc0c-d1ab36cc07e1 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:06 user nova-compute[71557]: DEBUG nova.compute.manager [req-856051e5-7183-408c-9690-d15d9ce9f47c req-20afb5e5-c955-4634-bc0c-d1ab36cc07e1 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-plugged-3c8cf480-05d6-463a-a97e-a9d869ac3860 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:06 user nova-compute[71557]: WARNING nova.compute.manager [req-856051e5-7183-408c-9690-d15d9ce9f47c req-20afb5e5-c955-4634-bc0c-d1ab36cc07e1 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received unexpected event network-vif-plugged-3c8cf480-05d6-463a-a97e-a9d869ac3860 for instance with vm_state building and task_state spawning.
Apr 12 10:40:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d7ff06a0-f2d1-4bde-8949-3e1f4955268f tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.389s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:07 user nova-compute[71557]: INFO nova.compute.manager [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Took 28.34 seconds to build instance.
Apr 12 10:40:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4c86de6b-3221-4c85-a4b9-0b0b0607fb81 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.436s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:14 user nova-compute[71557]: INFO nova.compute.manager [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Rescuing
Apr 12 10:40:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "refresh_cache-8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:40:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquired lock "refresh_cache-8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:40:14 user nova-compute[71557]: DEBUG nova.network.neutron [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:40:15 user nova-compute[71557]: DEBUG nova.network.neutron [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Updating instance_info_cache with network_info: [{"id": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "address": "fa:16:3e:e8:3f:f9", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e23fbbf-0b", "ovs_interfaceid": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:40:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Releasing lock "refresh_cache-8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:40:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-3559aa70-07b0-4229-9f44-26ae18432f7f req-38108234-a8cf-42d4-ada5-a1bb64d83cb6 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received event network-vif-unplugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3559aa70-07b0-4229-9f44-26ae18432f7f req-38108234-a8cf-42d4-ada5-a1bb64d83cb6 service nova] Acquiring lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3559aa70-07b0-4229-9f44-26ae18432f7f req-38108234-a8cf-42d4-ada5-a1bb64d83cb6 service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3559aa70-07b0-4229-9f44-26ae18432f7f req-38108234-a8cf-42d4-ada5-a1bb64d83cb6 service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-3559aa70-07b0-4229-9f44-26ae18432f7f req-38108234-a8cf-42d4-ada5-a1bb64d83cb6 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] No waiting events found dispatching network-vif-unplugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:15 user nova-compute[71557]: WARNING nova.compute.manager [req-3559aa70-07b0-4229-9f44-26ae18432f7f req-38108234-a8cf-42d4-ada5-a1bb64d83cb6 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received unexpected event network-vif-unplugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance with vm_state active and task_state rescuing.
Apr 12 10:40:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:16 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Instance destroyed successfully.
Apr 12 10:40:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:16 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Attempting a stable device rescue
Apr 12 10:40:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71557) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 10:40:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Instance directory exists: not creating {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 10:40:16 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Creating image(s)
Apr 12 10:40:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "/opt/stack/data/nova/instances/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "/opt/stack/data/nova/instances/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:16 user nova-compute[71557]: DEBUG nova.objects.instance [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:40:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9bccf74536036ea6c7f938c58b5777029837f83d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9bccf74536036ea6c7f938c58b5777029837f83d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bccf74536036ea6c7f938c58b5777029837f83d.part --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bccf74536036ea6c7f938c58b5777029837f83d.part --force-share --output=json" returned: 0 in 0.138s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.virt.images [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] dcd8eb9e-0a55-4444-a6e3-07f042d287a4 was qcow2, converting to raw {{(pid=71557) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.privsep.utils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71557) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9bccf74536036ea6c7f938c58b5777029837f83d.part /opt/stack/data/nova/instances/_base/9bccf74536036ea6c7f938c58b5777029837f83d.converted {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9bccf74536036ea6c7f938c58b5777029837f83d.part /opt/stack/data/nova/instances/_base/9bccf74536036ea6c7f938c58b5777029837f83d.converted" returned: 0 in 0.145s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bccf74536036ea6c7f938c58b5777029837f83d.converted --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-dc6eb5d4-d415-4459-a95b-5a470ec66586" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-dc6eb5d4-d415-4459-a95b-5a470ec66586" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bccf74536036ea6c7f938c58b5777029837f83d.converted --force-share --output=json" returned: 0 in 0.159s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9bccf74536036ea6c7f938c58b5777029837f83d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.180s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "9bccf74536036ea6c7f938c58b5777029837f83d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9bccf74536036ea6c7f938c58b5777029837f83d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bccf74536036ea6c7f938c58b5777029837f83d --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bccf74536036ea6c7f938c58b5777029837f83d --force-share --output=json" returned: 0 in 0.151s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bccf74536036ea6c7f938c58b5777029837f83d,backing_fmt=raw /opt/stack/data/nova/instances/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212/disk.rescue {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bccf74536036ea6c7f938c58b5777029837f83d,backing_fmt=raw /opt/stack/data/nova/instances/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212/disk.rescue" returned: 0 in 0.054s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "9bccf74536036ea6c7f938c58b5777029837f83d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.objects.instance [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'migration_context' on Instance uuid 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Start _get_guest_xml network_info=[{"id": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "address": "fa:16:3e:e8:3f:f9", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "vif_mac": "fa:16:3e:e8:3f:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e23fbbf-0b", "ovs_interfaceid": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dcd8eb9e-0a55-4444-a6e3-07f042d287a4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': '387b20c5-ca7c-4f0c-80ec-1d55f45c5e82', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MomdaHlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212', 'attached_at': '', 'detached_at': '', 'volume_id': '8585bd8b-e5a9-4a52-84c2-194841fc5cd0', 'serial': '8585bd8b-e5a9-4a52-84c2-194841fc5cd0'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.objects.instance [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'resources' on Instance uuid 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.objects.instance [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'numa_topology' on Instance uuid 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:40:17 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:40:17 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.objects.instance [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MomdaHlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:40:17 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:40:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:40:17 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:40:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:40:17 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.compute.manager [req-20c61e9e-064a-4844-b508-e4103a57ca55 req-c408727b-6396-4026-bca1-ef5dd40c480d service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received event network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-20c61e9e-064a-4844-b508-e4103a57ca55 req-c408727b-6396-4026-bca1-ef5dd40c480d service nova] Acquiring lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-20c61e9e-064a-4844-b508-e4103a57ca55 req-c408727b-6396-4026-bca1-ef5dd40c480d service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-20c61e9e-064a-4844-b508-e4103a57ca55 req-c408727b-6396-4026-bca1-ef5dd40c480d service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG nova.compute.manager [req-20c61e9e-064a-4844-b508-e4103a57ca55 req-c408727b-6396-4026-bca1-ef5dd40c480d service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] No waiting events found dispatching network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:17 user nova-compute[71557]: WARNING nova.compute.manager [req-20c61e9e-064a-4844-b508-e4103a57ca55 req-c408727b-6396-4026-bca1-ef5dd40c480d service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received unexpected event network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance with vm_state active and task_state rescuing.
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ae1b2b-8135-436a-a8be-badb363bc317]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = MomdaHlQ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 10:40:17 user nova-compute[71557]: node.name = iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:40:17 user nova-compute[71557]: node.tpgt = -1
Apr 12 10:40:17 user nova-compute[71557]: node.startup = automatic
Apr 12 10:40:17 user nova-compute[71557]: node.leading_login = No
Apr 12 10:40:17 user nova-compute[71557]: iface.iscsi_ifacename = default
Apr 12 10:40:17 user nova-compute[71557]: iface.net_ifacename = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.ipaddress = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.prefix_len = 0
Apr 12 10:40:17 user nova-compute[71557]: iface.hwaddress = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.transport_name = tcp
Apr 12 10:40:17 user nova-compute[71557]: iface.initiatorname = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.state = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.vlan_id = 0
Apr 12 10:40:17 user nova-compute[71557]: iface.vlan_priority = 0
Apr 12 10:40:17 user nova-compute[71557]: iface.vlan_state = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.iface_num = 0
Apr 12 10:40:17 user nova-compute[71557]: iface.mtu = 0
Apr 12 10:40:17 user nova-compute[71557]: iface.port = 0
Apr 12 10:40:17 user nova-compute[71557]: iface.bootproto = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.subnet_mask = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.gateway = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.dhcp_alt_client_id = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.dhcp_dns = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.dhcp_learn_iqn = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.dhcp_vendor_id_state = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.dhcp_vendor_id = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.dhcp_slp_da = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.fragmentation = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.gratuitous_arp = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.incoming_forwarding = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.tos_state = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.tos = 0
Apr 12 10:40:17 user nova-compute[71557]: iface.ttl = 0
Apr 12 10:40:17 user nova-compute[71557]: iface.delayed_ack = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.tcp_nagle = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.tcp_wsf_state = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.tcp_wsf = 0
Apr 12 10:40:17 user nova-compute[71557]: iface.tcp_timer_scale = 0
Apr 12 10:40:17 user nova-compute[71557]: iface.tcp_timestamp = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.redirect = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.def_task_mgmt_timeout = 0
Apr 12 10:40:17 user nova-compute[71557]: iface.header_digest = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.data_digest = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.immediate_data = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.initial_r2t = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.data_seq_inorder = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.data_pdu_inorder = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.erl = 0
Apr 12 10:40:17 user nova-compute[71557]: iface.max_receive_data_len = 0
Apr 12 10:40:17 user nova-compute[71557]: iface.first_burst_len = 0
Apr 12 10:40:17 user nova-compute[71557]: iface.max_outstanding_r2t = 0
Apr 12 10:40:17 user nova-compute[71557]: iface.max_burst_len = 0
Apr 12 10:40:17 user nova-compute[71557]: iface.chap_auth = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.bidi_chap = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.strict_login_compliance = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.discovery_auth = <empty>
Apr 12 10:40:17 user nova-compute[71557]: iface.discovery_logout = <empty>
Apr 12 10:40:17 user nova-compute[71557]: node.discovery_address = <empty>
Apr 12 10:40:17 user nova-compute[71557]: node.discovery_port = 0
Apr 12 10:40:17 user nova-compute[71557]: node.discovery_type = static
Apr 12 10:40:17 user nova-compute[71557]: node.session.initial_cmdsn = 0
Apr 12 10:40:17 user nova-compute[71557]: node.session.initial_login_retry_max = 8
Apr 12 10:40:17 user nova-compute[71557]: node.session.xmit_thread_priority = -20
Apr 12 10:40:17 user nova-compute[71557]: node.session.cmds_max = 128
Apr 12 10:40:17 user nova-compute[71557]: node.session.queue_depth = 32
Apr 12 10:40:17 user nova-compute[71557]: node.session.nr_sessions = 1
Apr 12 10:40:17 user nova-compute[71557]: node.session.auth.authmethod = CHAP
Apr 12 10:40:17 user nova-compute[71557]: node.session.auth.username = MomdaHlQ
Apr 12 10:40:17 user nova-compute[71557]: node.session.auth.password = ***
Apr 12 10:40:17 user nova-compute[71557]: node.session.auth.username_in = <empty>
Apr 12 10:40:17 user nova-compute[71557]: node.session.auth.password_in = <empty>
Apr 12 10:40:17 user nova-compute[71557]: node.session.auth.chap_algs = MD5
Apr 12 10:40:17 user nova-compute[71557]: node.session.timeo.replacement_timeout = 120
Apr 12 10:40:17 user nova-compute[71557]: node.session.err_timeo.abort_timeout = 15
Apr 12 10:40:17 user nova-compute[71557]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 10:40:17 user nova-compute[71557]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 10:40:17 user nova-compute[71557]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 10:40:17 user nova-compute[71557]: node.session.iscsi.FastAbort = Yes
Apr 12 10:40:17 user nova-compute[71557]: node.session.iscsi.InitialR2T = No
Apr 12 10:40:17 user nova-compute[71557]: node.session.iscsi.ImmediateData = Yes
Apr 12 10:40:17 user nova-compute[71557]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 10:40:17 user nova-compute[71557]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 10:40:17 user nova-compute[71557]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 10:40:17 user nova-compute[71557]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 10:40:17 user nova-compute[71557]: node.session.iscsi.MaxConnections = 1
Apr 12 10:40:17 user nova-compute[71557]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 10:40:17 user nova-compute[71557]: node.session.iscsi.ERL = 0
Apr 12 10:40:17 user nova-compute[71557]: node.session.scan = manual
Apr 12 10:40:17 user nova-compute[71557]: node.session.reopen_max = 0
Apr 12 10:40:17 user nova-compute[71557]: node.conn[0].address = 172.16.0.220
Apr 12 10:40:17 user nova-compute[71557]: node.conn[0].port = 3260
Apr 12 10:40:17 user nova-compute[71557]: node.conn[0].startup = manual
Apr 12 10:40:17 user nova-compute[71557]: node.conn[0].tcp.window_size = 524288
Apr 12 10:40:17 user nova-compute[71557]: node.conn[0].tcp.type_of_service = 0
Apr 12 10:40:17 user nova-compute[71557]: node.conn[0].timeo.logout_timeout = 15
Apr 12 10:40:17 user nova-compute[71557]: node.conn[0].timeo.login_timeout = 15
Apr 12 10:40:17 user nova-compute[71557]: node.conn[0].timeo.auth_timeout = 45
Apr 12 10:40:17 user nova-compute[71557]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 10:40:17 user nova-compute[71557]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 10:40:17 user nova-compute[71557]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 10:40:17 user nova-compute[71557]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 10:40:17 user nova-compute[71557]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 10:40:17 user nova-compute[71557]: node.conn[0].iscsi.DataDigest = None
Apr 12 10:40:17 user nova-compute[71557]: node.conn[0].iscsi.IFMarker = No
Apr 12 10:40:17 user nova-compute[71557]: node.conn[0].iscsi.OFMarker = No
Apr 12 10:40:17 user nova-compute[71557]: # END RECORD
Apr 12 10:40:17 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbe67c7-f996-40bd-ac8e-55c9317d1fef]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bddf95-92e7-4342-bd0e-f038d0639766]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:40:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MomdaHlQ {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MomdaHlQ" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0121793f-f988-4145-9da7-89291fec6fcf]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MomdaHlQ'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d61704-a499-44ae-a0fe-3079b37841af]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc0ec23-6f52-451b-ac29-f66b5d8cc64c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:40:18 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:40:18 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:40:18 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:40:18 user nova-compute[71557]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)
Apr 12 10:40:18 user nova-compute[71557]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 (non-flash)
Apr 12 10:40:18 user nova-compute[71557]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 (non-flash)
Apr 12 10:40:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:40:18 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:40:18 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:40:18 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:40:18 user nova-compute[71557]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)
Apr 12 10:40:18 user nova-compute[71557]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 (non-flash)
Apr 12 10:40:18 user nova-compute[71557]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 (non-flash)
Apr 12 10:40:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.176s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] HCTL ('33', '0', '0', 0) found on session 12 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e17f8ba-50d2-4e6f-8876-52ef41cdacf7]: (4, ('0 0 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Searching for a device in session 12 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MomdaHlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.211s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] <== connect_volume: return (213ms) {'type': 'block', 'scsi_wwn': '26139666438363264', 'path': '/dev/sdb'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139666438363264', 'path': '/dev/sdb'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1497116859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1497116859',id=14,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:38:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3789b59ccc704f86afac83af21fd84f9',ramdisk_id='',reservation_id='r-qmvf1fzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:38:40Z,user_data=None,user_id='ba49b947c74e48f3b161b6f9fce8b1c5',uuid=8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "address": "fa:16:3e:e8:3f:f9", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "vif_mac": "fa:16:3e:e8:3f:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e23fbbf-0b", "ovs_interfaceid": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converting VIF {"id": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "address": "fa:16:3e:e8:3f:f9", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "vif_mac": "fa:16:3e:e8:3f:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e23fbbf-0b", "ovs_interfaceid": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:3f:f9,bridge_name='br-int',has_traffic_filtering=True,id=1e23fbbf-0bbf-491b-b83b-b1e7067f91fb,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e23fbbf-0b') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG nova.objects.instance [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:40:18 user nova-compute[71557]:   <uuid>8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212</uuid>
Apr 12 10:40:18 user nova-compute[71557]:   <name>instance-0000000e</name>
Apr 12 10:40:18 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:40:18 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:40:18 user nova-compute[71557]:   <metadata>
Apr 12 10:40:18 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:40:18 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:40:18 user nova-compute[71557]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1497116859</nova:name>
Apr 12 10:40:18 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:40:17</nova:creationTime>
Apr 12 10:40:18 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:40:18 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:40:18 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:40:18 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:40:18 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:40:18 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:40:18 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:40:18 user nova-compute[71557]:       <nova:owner>
Apr 12 10:40:18 user nova-compute[71557]:         <nova:user uuid="ba49b947c74e48f3b161b6f9fce8b1c5">tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member</nova:user>
Apr 12 10:40:18 user nova-compute[71557]:         <nova:project uuid="3789b59ccc704f86afac83af21fd84f9">tempest-ServerBootFromVolumeStableRescueTest-1826285115</nova:project>
Apr 12 10:40:18 user nova-compute[71557]:       </nova:owner>
Apr 12 10:40:18 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:40:18 user nova-compute[71557]:       <nova:ports>
Apr 12 10:40:18 user nova-compute[71557]:         <nova:port uuid="1e23fbbf-0bbf-491b-b83b-b1e7067f91fb">
Apr 12 10:40:18 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 10:40:18 user nova-compute[71557]:         </nova:port>
Apr 12 10:40:18 user nova-compute[71557]:       </nova:ports>
Apr 12 10:40:18 user nova-compute[71557]:     </nova:instance>
Apr 12 10:40:18 user nova-compute[71557]:   </metadata>
Apr 12 10:40:18 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:40:18 user nova-compute[71557]:     <system>
Apr 12 10:40:18 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:40:18 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:40:18 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:40:18 user nova-compute[71557]:       <entry name="serial">8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212</entry>
Apr 12 10:40:18 user nova-compute[71557]:       <entry name="uuid">8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212</entry>
Apr 12 10:40:18 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:40:18 user nova-compute[71557]:     </system>
Apr 12 10:40:18 user nova-compute[71557]:   </sysinfo>
Apr 12 10:40:18 user nova-compute[71557]:   <os>
Apr 12 10:40:18 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:40:18 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:40:18 user nova-compute[71557]:   </os>
Apr 12 10:40:18 user nova-compute[71557]:   <features>
Apr 12 10:40:18 user nova-compute[71557]:     <acpi/>
Apr 12 10:40:18 user nova-compute[71557]:     <apic/>
Apr 12 10:40:18 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:40:18 user nova-compute[71557]:   </features>
Apr 12 10:40:18 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:40:18 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:40:18 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:40:18 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:40:18 user nova-compute[71557]:   </clock>
Apr 12 10:40:18 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:40:18 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:40:18 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:40:18 user nova-compute[71557]:   </cpu>
Apr 12 10:40:18 user nova-compute[71557]:   <devices>
Apr 12 10:40:18 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:40:18 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:40:18 user nova-compute[71557]:       <source dev="/dev/sdb"/>
Apr 12 10:40:18 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:40:18 user nova-compute[71557]:       <serial>8585bd8b-e5a9-4a52-84c2-194841fc5cd0</serial>
Apr 12 10:40:18 user nova-compute[71557]:     </disk>
Apr 12 10:40:18 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:40:18 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:40:18 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212/disk.rescue"/>
Apr 12 10:40:18 user nova-compute[71557]:       <target dev="vdb" bus="virtio"/>
Apr 12 10:40:18 user nova-compute[71557]:       <boot order="1"/>
Apr 12 10:40:18 user nova-compute[71557]:     </disk>
Apr 12 10:40:18 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:40:18 user nova-compute[71557]:       <mac address="fa:16:3e:e8:3f:f9"/>
Apr 12 10:40:18 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:40:18 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:40:18 user nova-compute[71557]:       <target dev="tap1e23fbbf-0b"/>
Apr 12 10:40:18 user nova-compute[71557]:     </interface>
Apr 12 10:40:18 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:40:18 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212/console.log" append="off"/>
Apr 12 10:40:18 user nova-compute[71557]:     </serial>
Apr 12 10:40:18 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:40:18 user nova-compute[71557]:     <video>
Apr 12 10:40:18 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:40:18 user nova-compute[71557]:     </video>
Apr 12 10:40:18 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:40:18 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:40:18 user nova-compute[71557]:     </rng>
Apr 12 10:40:18 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:40:18 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:40:18 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:40:18 user nova-compute[71557]:     </memballoon>
Apr 12 10:40:18 user nova-compute[71557]:   </devices>
Apr 12 10:40:18 user nova-compute[71557]: </domain>
Apr 12 10:40:18 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:40:18 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Instance destroyed successfully.
Apr 12 10:40:18 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Updating instance_info_cache with network_info: [{"id": "54a35da3-7130-4116-a695-1d7da8f0afc8", "address": "fa:16:3e:0a:f4:49", "network": {"id": "092e35b9-633d-403b-a777-df3e8c018327", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667523639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "024682bfda5548b8b9b404c85dd55b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a35da3-71", "ovs_interfaceid": "54a35da3-7130-4116-a695-1d7da8f0afc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-dc6eb5d4-d415-4459-a95b-5a470ec66586" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] No VIF found with MAC fa:16:3e:e8:3f:f9, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:40:18 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:20 user nova-compute[71557]: DEBUG nova.compute.manager [req-4b89d6a3-2690-4ca9-80f0-2f18e0156eef req-a43cbc7c-3800-4770-87f0-7b592cd55966 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received event network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4b89d6a3-2690-4ca9-80f0-2f18e0156eef req-a43cbc7c-3800-4770-87f0-7b592cd55966 service nova] Acquiring lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4b89d6a3-2690-4ca9-80f0-2f18e0156eef req-a43cbc7c-3800-4770-87f0-7b592cd55966 service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4b89d6a3-2690-4ca9-80f0-2f18e0156eef req-a43cbc7c-3800-4770-87f0-7b592cd55966 service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:20 user nova-compute[71557]: DEBUG nova.compute.manager [req-4b89d6a3-2690-4ca9-80f0-2f18e0156eef req-a43cbc7c-3800-4770-87f0-7b592cd55966 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] No waiting events found dispatching network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:20 user nova-compute[71557]: WARNING nova.compute.manager [req-4b89d6a3-2690-4ca9-80f0-2f18e0156eef req-a43cbc7c-3800-4770-87f0-7b592cd55966 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received unexpected event network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance with vm_state active and task_state rescuing.
Apr 12 10:40:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:40:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:40:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:40:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c663163-6794-4c92-a401-5bc15d112c65/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c663163-6794-4c92-a401-5bc15d112c65/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c663163-6794-4c92-a401-5bc15d112c65/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c663163-6794-4c92-a401-5bc15d112c65/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:40:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Removed pending event for 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 due to event {{(pid=71557) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 10:40:22 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296022.123686, 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:40:22 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] VM Resumed (Lifecycle Event)
Apr 12 10:40:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-6de1bc67-ae49-4a35-8fad-cff366ed2491 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:40:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:40:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:40:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:22 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 10:40:22 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296022.1290834, 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:40:22 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] VM Started (Lifecycle Event)
Apr 12 10:40:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:40:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:40:22 user nova-compute[71557]: DEBUG nova.compute.manager [req-e9c3f3b3-3e4b-4355-af4c-3c104246c256 req-9bcca6e8-d779-46f2-94d2-4f0fe1d085b0 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received event network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e9c3f3b3-3e4b-4355-af4c-3c104246c256 req-9bcca6e8-d779-46f2-94d2-4f0fe1d085b0 service nova] Acquiring lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e9c3f3b3-3e4b-4355-af4c-3c104246c256 req-9bcca6e8-d779-46f2-94d2-4f0fe1d085b0 service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e9c3f3b3-3e4b-4355-af4c-3c104246c256 req-9bcca6e8-d779-46f2-94d2-4f0fe1d085b0 service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:22 user nova-compute[71557]: DEBUG nova.compute.manager [req-e9c3f3b3-3e4b-4355-af4c-3c104246c256 req-9bcca6e8-d779-46f2-94d2-4f0fe1d085b0 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] No waiting events found dispatching network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:22 user nova-compute[71557]: WARNING nova.compute.manager [req-e9c3f3b3-3e4b-4355-af4c-3c104246c256 req-9bcca6e8-d779-46f2-94d2-4f0fe1d085b0 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received unexpected event network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance with vm_state rescued and task_state None.
Apr 12 10:40:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:40:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:40:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:40:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:24 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:40:24 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:40:24 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=7642MB free_disk=26.335430145263672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:40:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:25 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:40:25 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance f47d368e-3870-49d0-8522-a94991ec4ba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:40:25 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:40:25 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance dc6eb5d4-d415-4459-a95b-5a470ec66586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:40:25 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance d04cb526-f77a-457c-90b1-3e5c202c0c30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:40:25 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:40:25 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:40:25 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0bfafa79-ce40-42f1-9992-10e50734f7fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:40:25 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 1c663163-6794-4c92-a401-5bc15d112c65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:40:25 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:40:25 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:40:25 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:40:25 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:40:25 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:40:25 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:40:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.856s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:26 user nova-compute[71557]: INFO nova.compute.manager [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Detaching volume dea9ff7f-5072-4321-a399-4f61bb957b28
Apr 12 10:40:26 user nova-compute[71557]: INFO nova.virt.block_device [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Attempting to driver detach volume dea9ff7f-5072-4321-a399-4f61bb957b28 from mountpoint /dev/vdb
Apr 12 10:40:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Attempting to detach device vdb from instance a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 10:40:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:40:26 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:40:26 user nova-compute[71557]:   <source dev="/dev/sdh"/>
Apr 12 10:40:26 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:40:26 user nova-compute[71557]:   <serial>dea9ff7f-5072-4321-a399-4f61bb957b28</serial>
Apr 12 10:40:26 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:40:26 user nova-compute[71557]: </disk>
Apr 12 10:40:26 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:40:26 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Successfully detached device vdb from instance a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 from the persistent domain config.
Apr 12 10:40:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 10:40:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:40:26 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:40:26 user nova-compute[71557]:   <source dev="/dev/sdh"/>
Apr 12 10:40:26 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:40:26 user nova-compute[71557]:   <serial>dea9ff7f-5072-4321-a399-4f61bb957b28</serial>
Apr 12 10:40:26 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:40:26 user nova-compute[71557]: </disk>
Apr 12 10:40:26 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:40:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:26 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:40:26 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:40:26 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:40:26 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:40:26 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:40:26 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:40:26 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:40:26 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681296027.0995855, a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 10:40:27 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Successfully detached device vdb from instance a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 from the live domain config.
Apr 12 10:40:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZDFoPnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:40:27 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:40:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fc7d2b-07ae-447b-81de-764df1b37b56]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:40:27 user nova-compute[71557]: No targets found.
Apr 12 10:40:27 user nova-compute[71557]: iSNS:
Apr 12 10:40:27 user nova-compute[71557]: No targets found.
Apr 12 10:40:27 user nova-compute[71557]: STATIC:
Apr 12 10:40:27 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:40:27 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:40:27 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:40:27 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93
Apr 12 10:40:27 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:40:27 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:40:27 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7
Apr 12 10:40:27 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:40:27 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:40:27 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75
Apr 12 10:40:27 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:40:27 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:40:27 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28
Apr 12 10:40:27 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:40:27 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:40:27 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666
Apr 12 10:40:27 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:40:27 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:40:27 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2
Apr 12 10:40:27 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:40:27 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:40:27 user nova-compute[71557]: FIRMWARE:
Apr 12 10:40:27 user nova-compute[71557]: No targets found.
Apr 12 10:40:27 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:40:27 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:40:27 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[436a8329-1350-4c37-b120-bb9bd081bc87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f7b5b6-bf01-47ba-bd78-e1204fe2d20e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:40:27 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:40:27 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:40:27 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:40:27 user nova-compute[71557]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)
Apr 12 10:40:27 user nova-compute[71557]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 (non-flash)
Apr 12 10:40:27 user nova-compute[71557]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 (non-flash)
Apr 12 10:40:27 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:40:27 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:40:27 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:40:27 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:40:27 user nova-compute[71557]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)
Apr 12 10:40:27 user nova-compute[71557]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 (non-flash)
Apr 12 10:40:27 user nova-compute[71557]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 (non-flash)
Apr 12 10:40:27 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fc42a48b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28'): ({'sdh'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Removing single pathed devices sdh {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c65052-d829-48b0-9fce-7f5c31206aa8]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[918a98ea-2b2a-4c44-a3a6-660675a8647e]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Flushing IO for device /dev/sdh {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3d6363-5478-4ec8-982c-6e25fe209563]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e372b4-bd87-4edc-b429-fb31c15200fd]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] SCSI volumes sdh have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b04cab9-26c2-4549-9e6e-7fe193bd3502]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[721937de-f8e8-4942-8a5a-5275da8d4b39]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28, portal: 172.16.0.220,3260]
Apr 12 10:40:27 user nova-compute[71557]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28, portal: 172.16.0.220,3260] successful.
Apr 12 10:40:27 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3f6143-609b-4c4f-b6d0-3beac0c08814]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] <== disconnect_volume: return (385ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:40:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:40:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:28 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lazy-loading 'flavor' on Instance uuid a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:40:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a165cd21-8a98-4204-b7a2-8e5ed9288bb2 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.115s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.955s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:28 user nova-compute[71557]: INFO nova.compute.manager [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Terminating instance
Apr 12 10:40:28 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:40:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG nova.compute.manager [req-a8ecaab9-95ed-47cc-87c1-c1910553d997 req-57afdec0-1694-46ed-8048-af0b4c95c2b6 service nova] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Received event network-vif-unplugged-5eed0079-0c02-43b0-8124-4ef257a7eb1f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a8ecaab9-95ed-47cc-87c1-c1910553d997 req-57afdec0-1694-46ed-8048-af0b4c95c2b6 service nova] Acquiring lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a8ecaab9-95ed-47cc-87c1-c1910553d997 req-57afdec0-1694-46ed-8048-af0b4c95c2b6 service nova] Lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a8ecaab9-95ed-47cc-87c1-c1910553d997 req-57afdec0-1694-46ed-8048-af0b4c95c2b6 service nova] Lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG nova.compute.manager [req-a8ecaab9-95ed-47cc-87c1-c1910553d997 req-57afdec0-1694-46ed-8048-af0b4c95c2b6 service nova] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] No waiting events found dispatching network-vif-unplugged-5eed0079-0c02-43b0-8124-4ef257a7eb1f {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG nova.compute.manager [req-a8ecaab9-95ed-47cc-87c1-c1910553d997 req-57afdec0-1694-46ed-8048-af0b4c95c2b6 service nova] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Received event network-vif-unplugged-5eed0079-0c02-43b0-8124-4ef257a7eb1f for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:40:29 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Instance destroyed successfully.
Apr 12 10:40:29 user nova-compute[71557]: DEBUG nova.objects.instance [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lazy-loading 'resources' on Instance uuid a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:38:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1220560850',display_name='tempest-VolumesSnapshotTestJSON-instance-1220560850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1220560850',id=13,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:38:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16de154a6d344b18a939c6a1b1a679f5',ramdisk_id='',reservation_id='r-600v1esk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-858479648',owner_user_name='tempest-VolumesSnapshotTestJSON-858479648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:38:15Z,user_data=None,user_id='2c97c57a3e7142d088e1cf315f5d8d72',uuid=a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5eed0079-0c02-43b0-8124-4ef257a7eb1f", "address": "fa:16:3e:39:2a:b8", "network": {"id": "a5611852-639c-4e1f-8dbc-cc88bc5651d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1575956045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "16de154a6d344b18a939c6a1b1a679f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eed0079-0c", "ovs_interfaceid": "5eed0079-0c02-43b0-8124-4ef257a7eb1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Converting VIF {"id": "5eed0079-0c02-43b0-8124-4ef257a7eb1f", "address": "fa:16:3e:39:2a:b8", "network": {"id": "a5611852-639c-4e1f-8dbc-cc88bc5651d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1575956045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "16de154a6d344b18a939c6a1b1a679f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5eed0079-0c", "ovs_interfaceid": "5eed0079-0c02-43b0-8124-4ef257a7eb1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:2a:b8,bridge_name='br-int',has_traffic_filtering=True,id=5eed0079-0c02-43b0-8124-4ef257a7eb1f,network=Network(a5611852-639c-4e1f-8dbc-cc88bc5651d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eed0079-0c') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG os_vif [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:2a:b8,bridge_name='br-int',has_traffic_filtering=True,id=5eed0079-0c02-43b0-8124-4ef257a7eb1f,network=Network(a5611852-639c-4e1f-8dbc-cc88bc5651d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eed0079-0c') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5eed0079-0c, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:29 user nova-compute[71557]: INFO os_vif [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:2a:b8,bridge_name='br-int',has_traffic_filtering=True,id=5eed0079-0c02-43b0-8124-4ef257a7eb1f,network=Network(a5611852-639c-4e1f-8dbc-cc88bc5651d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5eed0079-0c')
Apr 12 10:40:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZDFoPnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:40:29 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:40:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0c2ece-2c2e-44b7-92ea-3c497041dfcc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:40:29 user nova-compute[71557]: No targets found.
Apr 12 10:40:29 user nova-compute[71557]: iSNS:
Apr 12 10:40:29 user nova-compute[71557]: No targets found.
Apr 12 10:40:29 user nova-compute[71557]: STATIC:
Apr 12 10:40:29 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:40:29 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:40:29 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:40:29 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93
Apr 12 10:40:29 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:40:29 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:40:29 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7
Apr 12 10:40:29 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:40:29 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:40:29 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75
Apr 12 10:40:29 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:40:29 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:40:29 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666
Apr 12 10:40:29 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:40:29 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:40:29 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2
Apr 12 10:40:29 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:40:29 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:40:29 user nova-compute[71557]: FIRMWARE:
Apr 12 10:40:29 user nova-compute[71557]: No targets found.
Apr 12 10:40:29 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:40:29 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:40:29 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dea9ff7f-5072-4321-a399-4f61bb957b28', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[44443e68-e516-4d2a-a533-e4619fe00271]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc3f709-9760-4487-acd6-604494090fc1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:40:29 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:40:29 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:40:29 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:40:29 user nova-compute[71557]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)
Apr 12 10:40:29 user nova-compute[71557]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 (non-flash)
Apr 12 10:40:29 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:40:29 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:40:29 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:40:29 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:40:29 user nova-compute[71557]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)
Apr 12 10:40:29 user nova-compute[71557]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 (non-flash)
Apr 12 10:40:29 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fe1122830>, {}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Disconnecting from: [] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.113s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] <== disconnect_volume: return (114ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:40:29 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Deleting instance files /opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2_del
Apr 12 10:40:29 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Deletion of /opt/stack/data/nova/instances/a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2_del complete
Apr 12 10:40:29 user nova-compute[71557]: INFO nova.compute.manager [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Took 1.02 seconds to destroy the instance on the hypervisor.
Apr 12 10:40:29 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:40:29 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:40:30 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:40:30 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Took 0.67 seconds to deallocate network for instance.
Apr 12 10:40:30 user nova-compute[71557]: WARNING nova.volume.cinder [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Attachment 23deb7a9-7397-4729-a558-8f1a2dfee654 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 23deb7a9-7397-4729-a558-8f1a2dfee654. (HTTP 404) (Request-ID: req-feec3e6c-0339-4539-9228-55e8d0a7c365)
Apr 12 10:40:30 user nova-compute[71557]: INFO nova.compute.manager [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Took 0.04 seconds to detach 1 volumes for instance.
Apr 12 10:40:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:30 user nova-compute[71557]: DEBUG nova.compute.manager [req-fe9ffa83-b63d-4007-a375-e6b2759666de req-09755bc0-b812-4c57-9749-fc854a35c333 service nova] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Received event network-vif-deleted-5eed0079-0c02-43b0-8124-4ef257a7eb1f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:30 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:40:30 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:40:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:30 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Deleted allocations for instance a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2
Apr 12 10:40:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5dec1cfb-9a16-4fda-b26f-5c1bda438062 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.329s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:31 user nova-compute[71557]: DEBUG nova.compute.manager [req-6b841230-e404-4f01-9c41-30de37d06fb7 req-3e69e47c-958c-46b3-bccf-5aa606fd5ec1 service nova] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Received event network-vif-plugged-5eed0079-0c02-43b0-8124-4ef257a7eb1f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6b841230-e404-4f01-9c41-30de37d06fb7 req-3e69e47c-958c-46b3-bccf-5aa606fd5ec1 service nova] Acquiring lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6b841230-e404-4f01-9c41-30de37d06fb7 req-3e69e47c-958c-46b3-bccf-5aa606fd5ec1 service nova] Lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6b841230-e404-4f01-9c41-30de37d06fb7 req-3e69e47c-958c-46b3-bccf-5aa606fd5ec1 service nova] Lock "a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:31 user nova-compute[71557]: DEBUG nova.compute.manager [req-6b841230-e404-4f01-9c41-30de37d06fb7 req-3e69e47c-958c-46b3-bccf-5aa606fd5ec1 service nova] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] No waiting events found dispatching network-vif-plugged-5eed0079-0c02-43b0-8124-4ef257a7eb1f {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:31 user nova-compute[71557]: WARNING nova.compute.manager [req-6b841230-e404-4f01-9c41-30de37d06fb7 req-3e69e47c-958c-46b3-bccf-5aa606fd5ec1 service nova] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Received unexpected event network-vif-plugged-5eed0079-0c02-43b0-8124-4ef257a7eb1f for instance with vm_state deleted and task_state None.
Apr 12 10:40:33 user nova-compute[71557]: DEBUG nova.compute.manager [req-3a492318-eddd-46ac-b230-aa78249b13d0 req-d6705ff8-7716-47e9-9762-82c3cd817129 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Received event network-changed-4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:33 user nova-compute[71557]: DEBUG nova.compute.manager [req-3a492318-eddd-46ac-b230-aa78249b13d0 req-d6705ff8-7716-47e9-9762-82c3cd817129 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Refreshing instance network info cache due to event network-changed-4de5a799-c343-4e41-88ef-ebaaa3adb14c. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:40:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3a492318-eddd-46ac-b230-aa78249b13d0 req-d6705ff8-7716-47e9-9762-82c3cd817129 service nova] Acquiring lock "refresh_cache-0bfafa79-ce40-42f1-9992-10e50734f7fa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:40:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3a492318-eddd-46ac-b230-aa78249b13d0 req-d6705ff8-7716-47e9-9762-82c3cd817129 service nova] Acquired lock "refresh_cache-0bfafa79-ce40-42f1-9992-10e50734f7fa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:40:33 user nova-compute[71557]: DEBUG nova.network.neutron [req-3a492318-eddd-46ac-b230-aa78249b13d0 req-d6705ff8-7716-47e9-9762-82c3cd817129 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Refreshing network info cache for port 4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:40:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:33 user nova-compute[71557]: DEBUG nova.network.neutron [req-3a492318-eddd-46ac-b230-aa78249b13d0 req-d6705ff8-7716-47e9-9762-82c3cd817129 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Updated VIF entry in instance network info cache for port 4de5a799-c343-4e41-88ef-ebaaa3adb14c. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:40:33 user nova-compute[71557]: DEBUG nova.network.neutron [req-3a492318-eddd-46ac-b230-aa78249b13d0 req-d6705ff8-7716-47e9-9762-82c3cd817129 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Updating instance_info_cache with network_info: [{"id": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "address": "fa:16:3e:6e:34:b4", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de5a799-c3", "ovs_interfaceid": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:40:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3a492318-eddd-46ac-b230-aa78249b13d0 req-d6705ff8-7716-47e9-9762-82c3cd817129 service nova] Releasing lock "refresh_cache-0bfafa79-ce40-42f1-9992-10e50734f7fa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:40:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "0bfafa79-ce40-42f1-9992-10e50734f7fa" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:36 user nova-compute[71557]: INFO nova.compute.manager [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Shelving
Apr 12 10:40:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-42df3eb9-a147-4c16-b396-d5e63e9fbd4a req-f8679767-923d-4476-9df1-a22f01302cd0 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Received event network-vif-unplugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-42df3eb9-a147-4c16-b396-d5e63e9fbd4a req-f8679767-923d-4476-9df1-a22f01302cd0 service nova] Acquiring lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-42df3eb9-a147-4c16-b396-d5e63e9fbd4a req-f8679767-923d-4476-9df1-a22f01302cd0 service nova] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-42df3eb9-a147-4c16-b396-d5e63e9fbd4a req-f8679767-923d-4476-9df1-a22f01302cd0 service nova] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-42df3eb9-a147-4c16-b396-d5e63e9fbd4a req-f8679767-923d-4476-9df1-a22f01302cd0 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] No waiting events found dispatching network-vif-unplugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:36 user nova-compute[71557]: WARNING nova.compute.manager [req-42df3eb9-a147-4c16-b396-d5e63e9fbd4a req-f8679767-923d-4476-9df1-a22f01302cd0 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Received unexpected event network-vif-unplugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c for instance with vm_state active and task_state shelving.
Apr 12 10:40:37 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Instance destroyed successfully.
Apr 12 10:40:37 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Beginning cold snapshot process
Apr 12 10:40:37 user nova-compute[71557]: DEBUG nova.privsep.utils [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71557) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 10:40:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk /opt/stack/data/nova/instances/snapshots/tmpgpf2n4sw/3d14c3b4555d42b19d435e44fe42c1c2 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:40:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk /opt/stack/data/nova/instances/snapshots/tmpgpf2n4sw/3d14c3b4555d42b19d435e44fe42c1c2" returned: 0 in 0.734s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:40:38 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Snapshot extracted, beginning image upload
Apr 12 10:40:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:38 user nova-compute[71557]: DEBUG nova.compute.manager [req-ef74f916-268e-40e5-a444-c3a52f92e1c8 req-c3066aaa-4d4e-4b16-8b90-9c5511bc299e service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Received event network-vif-plugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ef74f916-268e-40e5-a444-c3a52f92e1c8 req-c3066aaa-4d4e-4b16-8b90-9c5511bc299e service nova] Acquiring lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ef74f916-268e-40e5-a444-c3a52f92e1c8 req-c3066aaa-4d4e-4b16-8b90-9c5511bc299e service nova] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ef74f916-268e-40e5-a444-c3a52f92e1c8 req-c3066aaa-4d4e-4b16-8b90-9c5511bc299e service nova] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:38 user nova-compute[71557]: DEBUG nova.compute.manager [req-ef74f916-268e-40e5-a444-c3a52f92e1c8 req-c3066aaa-4d4e-4b16-8b90-9c5511bc299e service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] No waiting events found dispatching network-vif-plugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:38 user nova-compute[71557]: WARNING nova.compute.manager [req-ef74f916-268e-40e5-a444-c3a52f92e1c8 req-c3066aaa-4d4e-4b16-8b90-9c5511bc299e service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Received unexpected event network-vif-plugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c for instance with vm_state active and task_state shelving_image_uploading.
Apr 12 10:40:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:40 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Snapshot image upload complete
Apr 12 10:40:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:40:40 user nova-compute[71557]: INFO nova.compute.manager [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Shelve offloading
Apr 12 10:40:40 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Instance destroyed successfully.
Apr 12 10:40:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:40:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "refresh_cache-0bfafa79-ce40-42f1-9992-10e50734f7fa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:40:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquired lock "refresh_cache-0bfafa79-ce40-42f1-9992-10e50734f7fa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:40:40 user nova-compute[71557]: DEBUG nova.network.neutron [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG nova.network.neutron [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Updating instance_info_cache with network_info: [{"id": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "address": "fa:16:3e:6e:34:b4", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de5a799-c3", "ovs_interfaceid": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Releasing lock "refresh_cache-0bfafa79-ce40-42f1-9992-10e50734f7fa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "1c663163-6794-4c92-a401-5bc15d112c65" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "1c663163-6794-4c92-a401-5bc15d112c65" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "1c663163-6794-4c92-a401-5bc15d112c65-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "1c663163-6794-4c92-a401-5bc15d112c65-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "1c663163-6794-4c92-a401-5bc15d112c65-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:41 user nova-compute[71557]: INFO nova.compute.manager [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Terminating instance
Apr 12 10:40:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:41 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Instance destroyed successfully.
Apr 12 10:40:41 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'resources' on Instance uuid 0bfafa79-ce40-42f1-9992-10e50734f7fa {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1310544900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1310544900',id=15,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2Hsku+9Gq6PQ4eKPx2NZhPKKREpcJhVPgOkrPIzB0Og0vZ9OIo/sOZ0cMVzynU//y1O/biJFt/UdsDmp+9Toxz6/qyq8KmOhnHzR0d1UhA1wltYPUXYdlGdBHjOrPUqw==',key_name='tempest-keypair-1823760254',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:38:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='af33ce0944194932b663c3b8aef9783d',ramdisk_id='',reservation_id='r-oeqsk990',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-603525697',owner_user_name='tempest-AttachVolumeShelveTestJSON-603525697-project-member',shelved_at='2023-04-12T10:40:40.355253',shelved_host='user',shelved_image_id='da4f58e1-cfaf-45cc-a3da-fbec26a5cbcf'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d6279f1ce94008a2898ade6f730b40',uuid=0bfafa79-ce40-42f1-9992-10e50734f7fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "address": "fa:16:3e:6e:34:b4", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de5a799-c3", "ovs_interfaceid": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converting VIF {"id": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "address": "fa:16:3e:6e:34:b4", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de5a799-c3", "ovs_interfaceid": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:34:b4,bridge_name='br-int',has_traffic_filtering=True,id=4de5a799-c343-4e41-88ef-ebaaa3adb14c,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4de5a799-c3') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG os_vif [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:34:b4,bridge_name='br-int',has_traffic_filtering=True,id=4de5a799-c343-4e41-88ef-ebaaa3adb14c,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4de5a799-c3') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4de5a799-c3, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-976fa075-67e0-4bcf-903f-ee4113108649 req-6fa0258a-0bc5-4432-9bbc-56d852fa4149 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Received event network-changed-4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-976fa075-67e0-4bcf-903f-ee4113108649 req-6fa0258a-0bc5-4432-9bbc-56d852fa4149 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Refreshing instance network info cache due to event network-changed-4de5a799-c343-4e41-88ef-ebaaa3adb14c. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-976fa075-67e0-4bcf-903f-ee4113108649 req-6fa0258a-0bc5-4432-9bbc-56d852fa4149 service nova] Acquiring lock "refresh_cache-0bfafa79-ce40-42f1-9992-10e50734f7fa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-976fa075-67e0-4bcf-903f-ee4113108649 req-6fa0258a-0bc5-4432-9bbc-56d852fa4149 service nova] Acquired lock "refresh_cache-0bfafa79-ce40-42f1-9992-10e50734f7fa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG nova.network.neutron [req-976fa075-67e0-4bcf-903f-ee4113108649 req-6fa0258a-0bc5-4432-9bbc-56d852fa4149 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Refreshing network info cache for port 4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:40:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:41 user nova-compute[71557]: INFO os_vif [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:34:b4,bridge_name='br-int',has_traffic_filtering=True,id=4de5a799-c343-4e41-88ef-ebaaa3adb14c,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4de5a799-c3')
Apr 12 10:40:41 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Deleting instance files /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa_del
Apr 12 10:40:41 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Deletion of /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa_del complete
Apr 12 10:40:42 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Instance destroyed successfully.
Apr 12 10:40:42 user nova-compute[71557]: DEBUG nova.objects.instance [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lazy-loading 'resources' on Instance uuid 1c663163-6794-4c92-a401-5bc15d112c65 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:40:42 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1187530573',display_name='tempest-VolumesAdminNegativeTest-server-1187530573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1187530573',id=16,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:38:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cdb8217b1544db384bebe1059848bb6',ramdisk_id='',reservation_id='r-prp4479s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-375460860',owner_user_name='tempest-VolumesAdminNegativeTest-375460860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:38:52Z,user_data=None,user_id='a0a2243c6c9f431da846cc54ec181fcc',uuid=1c663163-6794-4c92-a401-5bc15d112c65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b5da29f-d5cb-4af2-ab48-c296b053e407", "address": "fa:16:3e:15:6b:44", "network": {"id": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-80273954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdb8217b1544db384bebe1059848bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5da29f-d5", "ovs_interfaceid": "6b5da29f-d5cb-4af2-ab48-c296b053e407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:40:42 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Converting VIF {"id": "6b5da29f-d5cb-4af2-ab48-c296b053e407", "address": "fa:16:3e:15:6b:44", "network": {"id": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-80273954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdb8217b1544db384bebe1059848bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5da29f-d5", "ovs_interfaceid": "6b5da29f-d5cb-4af2-ab48-c296b053e407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:40:42 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:6b:44,bridge_name='br-int',has_traffic_filtering=True,id=6b5da29f-d5cb-4af2-ab48-c296b053e407,network=Network(66f6d7b6-8980-47a3-a7b6-f62db8264cd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5da29f-d5') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:40:42 user nova-compute[71557]: DEBUG os_vif [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:6b:44,bridge_name='br-int',has_traffic_filtering=True,id=6b5da29f-d5cb-4af2-ab48-c296b053e407,network=Network(66f6d7b6-8980-47a3-a7b6-f62db8264cd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5da29f-d5') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:40:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b5da29f-d5, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:40:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:42 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Deleted allocations for instance 0bfafa79-ce40-42f1-9992-10e50734f7fa
Apr 12 10:40:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:40:42 user nova-compute[71557]: INFO os_vif [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:6b:44,bridge_name='br-int',has_traffic_filtering=True,id=6b5da29f-d5cb-4af2-ab48-c296b053e407,network=Network(66f6d7b6-8980-47a3-a7b6-f62db8264cd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5da29f-d5')
Apr 12 10:40:42 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Deleting instance files /opt/stack/data/nova/instances/1c663163-6794-4c92-a401-5bc15d112c65_del
Apr 12 10:40:42 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Deletion of /opt/stack/data/nova/instances/1c663163-6794-4c92-a401-5bc15d112c65_del complete
Apr 12 10:40:42 user nova-compute[71557]: INFO nova.compute.manager [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Took 0.74 seconds to destroy the instance on the hypervisor.
Apr 12 10:40:42 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:40:42 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:40:42 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:40:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:42 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'numa_topology' on Instance uuid 0bfafa79-ce40-42f1-9992-10e50734f7fa {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:40:42 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:40:42 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:40:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a95b1048-b359-4c8d-8912-c330adb59253 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.189s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:42 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:40:42 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Took 0.57 seconds to deallocate network for instance.
Apr 12 10:40:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:42 user nova-compute[71557]: DEBUG nova.compute.manager [req-44b0087f-a620-473a-aeed-711d43b42001 req-4cc885d0-5738-45dc-8e5e-f103437cf738 service nova] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Received event network-vif-deleted-6b5da29f-d5cb-4af2-ab48-c296b053e407 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:43 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:40:43 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:40:43 user nova-compute[71557]: DEBUG nova.network.neutron [req-976fa075-67e0-4bcf-903f-ee4113108649 req-6fa0258a-0bc5-4432-9bbc-56d852fa4149 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Updated VIF entry in instance network info cache for port 4de5a799-c343-4e41-88ef-ebaaa3adb14c. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:40:43 user nova-compute[71557]: DEBUG nova.network.neutron [req-976fa075-67e0-4bcf-903f-ee4113108649 req-6fa0258a-0bc5-4432-9bbc-56d852fa4149 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Updating instance_info_cache with network_info: [{"id": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "address": "fa:16:3e:6e:34:b4", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4de5a799-c3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:40:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-976fa075-67e0-4bcf-903f-ee4113108649 req-6fa0258a-0bc5-4432-9bbc-56d852fa4149 service nova] Releasing lock "refresh_cache-0bfafa79-ce40-42f1-9992-10e50734f7fa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:40:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:43 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Deleted allocations for instance 1c663163-6794-4c92-a401-5bc15d112c65
Apr 12 10:40:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f59ac5cc-89e3-452b-812d-34a525f8fc67 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "1c663163-6794-4c92-a401-5bc15d112c65" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.865s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-91f50223-1796-4aae-bf01-06e7d027a150 req-ee237471-7e00-4492-9216-fac5b4454ec1 service nova] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Received event network-vif-unplugged-6b5da29f-d5cb-4af2-ab48-c296b053e407 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-91f50223-1796-4aae-bf01-06e7d027a150 req-ee237471-7e00-4492-9216-fac5b4454ec1 service nova] Acquiring lock "1c663163-6794-4c92-a401-5bc15d112c65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-91f50223-1796-4aae-bf01-06e7d027a150 req-ee237471-7e00-4492-9216-fac5b4454ec1 service nova] Lock "1c663163-6794-4c92-a401-5bc15d112c65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-91f50223-1796-4aae-bf01-06e7d027a150 req-ee237471-7e00-4492-9216-fac5b4454ec1 service nova] Lock "1c663163-6794-4c92-a401-5bc15d112c65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-91f50223-1796-4aae-bf01-06e7d027a150 req-ee237471-7e00-4492-9216-fac5b4454ec1 service nova] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] No waiting events found dispatching network-vif-unplugged-6b5da29f-d5cb-4af2-ab48-c296b053e407 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:43 user nova-compute[71557]: WARNING nova.compute.manager [req-91f50223-1796-4aae-bf01-06e7d027a150 req-ee237471-7e00-4492-9216-fac5b4454ec1 service nova] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Received unexpected event network-vif-unplugged-6b5da29f-d5cb-4af2-ab48-c296b053e407 for instance with vm_state deleted and task_state None.
Apr 12 10:40:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-91f50223-1796-4aae-bf01-06e7d027a150 req-ee237471-7e00-4492-9216-fac5b4454ec1 service nova] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Received event network-vif-plugged-6b5da29f-d5cb-4af2-ab48-c296b053e407 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:40:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-91f50223-1796-4aae-bf01-06e7d027a150 req-ee237471-7e00-4492-9216-fac5b4454ec1 service nova] Acquiring lock "1c663163-6794-4c92-a401-5bc15d112c65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:40:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-91f50223-1796-4aae-bf01-06e7d027a150 req-ee237471-7e00-4492-9216-fac5b4454ec1 service nova] Lock "1c663163-6794-4c92-a401-5bc15d112c65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:40:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-91f50223-1796-4aae-bf01-06e7d027a150 req-ee237471-7e00-4492-9216-fac5b4454ec1 service nova] Lock "1c663163-6794-4c92-a401-5bc15d112c65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:40:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-91f50223-1796-4aae-bf01-06e7d027a150 req-ee237471-7e00-4492-9216-fac5b4454ec1 service nova] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] No waiting events found dispatching network-vif-plugged-6b5da29f-d5cb-4af2-ab48-c296b053e407 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:40:43 user nova-compute[71557]: WARNING nova.compute.manager [req-91f50223-1796-4aae-bf01-06e7d027a150 req-ee237471-7e00-4492-9216-fac5b4454ec1 service nova] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Received unexpected event network-vif-plugged-6b5da29f-d5cb-4af2-ab48-c296b053e407 for instance with vm_state deleted and task_state None.
Apr 12 10:40:44 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296029.372297, a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:40:44 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] VM Stopped (Lifecycle Event)
Apr 12 10:40:44 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ebd17224-4217-49b0-8111-2109c1f517f0 None None] [instance: a3a4c1b0-9ef0-4bfb-a5a2-6060435ce8c2] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:40:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:52 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296037.091559, 0bfafa79-ce40-42f1-9992-10e50734f7fa => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:40:52 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] VM Stopped (Lifecycle Event)
Apr 12 10:40:52 user nova-compute[71557]: DEBUG nova.compute.manager [None req-92c011c7-f747-43a8-9e39-741406bc801b None None] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:40:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:57 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296042.061844, 1c663163-6794-4c92-a401-5bc15d112c65 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:40:57 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] VM Stopped (Lifecycle Event)
Apr 12 10:40:57 user nova-compute[71557]: DEBUG nova.compute.manager [None req-21ad27e1-12de-41ad-9e3c-489a86bd25ba None None] [instance: 1c663163-6794-4c92-a401-5bc15d112c65] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:40:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:40:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:13 user nova-compute[71557]: INFO nova.compute.manager [None req-2843959a-dceb-4612-9105-756135a7ecd8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Unrescuing
Apr 12 10:41:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2843959a-dceb-4612-9105-756135a7ecd8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:41:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2843959a-dceb-4612-9105-756135a7ecd8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquired lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:41:13 user nova-compute[71557]: DEBUG nova.network.neutron [None req-2843959a-dceb-4612-9105-756135a7ecd8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:41:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:13 user nova-compute[71557]: DEBUG nova.network.neutron [None req-2843959a-dceb-4612-9105-756135a7ecd8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Updating instance_info_cache with network_info: [{"id": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "address": "fa:16:3e:97:77:c8", "network": {"id": "4d3f7dc3-82bc-43ab-be83-29e8f16f99de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-970702209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce2a3bde13e464f8df0a41f30c240ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5c1f1e-a7", "ovs_interfaceid": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:41:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2843959a-dceb-4612-9105-756135a7ecd8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Releasing lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:41:13 user nova-compute[71557]: DEBUG nova.objects.instance [None req-2843959a-dceb-4612-9105-756135a7ecd8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lazy-loading 'flavor' on Instance uuid f47d368e-3870-49d0-8522-a94991ec4ba5 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:41:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-e3c1b5b6-aa63-4a76-b787-af6bc354b710 req-810636b9-a9df-4233-8651-81f0965cdcde service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received event network-vif-unplugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e3c1b5b6-aa63-4a76-b787-af6bc354b710 req-810636b9-a9df-4233-8651-81f0965cdcde service nova] Acquiring lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e3c1b5b6-aa63-4a76-b787-af6bc354b710 req-810636b9-a9df-4233-8651-81f0965cdcde service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e3c1b5b6-aa63-4a76-b787-af6bc354b710 req-810636b9-a9df-4233-8651-81f0965cdcde service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-e3c1b5b6-aa63-4a76-b787-af6bc354b710 req-810636b9-a9df-4233-8651-81f0965cdcde service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] No waiting events found dispatching network-vif-unplugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:14 user nova-compute[71557]: WARNING nova.compute.manager [req-e3c1b5b6-aa63-4a76-b787-af6bc354b710 req-810636b9-a9df-4233-8651-81f0965cdcde service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received unexpected event network-vif-unplugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance with vm_state rescued and task_state unrescuing.
Apr 12 10:41:14 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Instance destroyed successfully.
Apr 12 10:41:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received event network-changed-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Refreshing instance network info cache due to event network-changed-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:41:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] Acquiring lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:41:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] Acquired lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:41:16 user nova-compute[71557]: DEBUG nova.network.neutron [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Refreshing network info cache for port 7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:41:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:17 user nova-compute[71557]: DEBUG nova.network.neutron [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Updated VIF entry in instance network info cache for port 7b5c1f1e-a739-4317-a7b5-d6d884d32f7c. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:41:17 user nova-compute[71557]: DEBUG nova.network.neutron [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Updating instance_info_cache with network_info: [{"id": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "address": "fa:16:3e:97:77:c8", "network": {"id": "4d3f7dc3-82bc-43ab-be83-29e8f16f99de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-970702209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce2a3bde13e464f8df0a41f30c240ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5c1f1e-a7", "ovs_interfaceid": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:41:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] Releasing lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:41:17 user nova-compute[71557]: DEBUG nova.compute.manager [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received event network-changed-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:17 user nova-compute[71557]: DEBUG nova.compute.manager [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Refreshing instance network info cache due to event network-changed-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:41:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] Acquiring lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:41:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] Acquired lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:41:17 user nova-compute[71557]: DEBUG nova.network.neutron [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Refreshing network info cache for port 7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG nova.network.neutron [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Updated VIF entry in instance network info cache for port 7b5c1f1e-a739-4317-a7b5-d6d884d32f7c. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG nova.network.neutron [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Updating instance_info_cache with network_info: [{"id": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "address": "fa:16:3e:97:77:c8", "network": {"id": "4d3f7dc3-82bc-43ab-be83-29e8f16f99de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-970702209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce2a3bde13e464f8df0a41f30c240ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5c1f1e-a7", "ovs_interfaceid": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] Releasing lock "refresh_cache-f47d368e-3870-49d0-8522-a94991ec4ba5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG nova.compute.manager [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received event network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] Acquiring lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG nova.compute.manager [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] No waiting events found dispatching network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:18 user nova-compute[71557]: WARNING nova.compute.manager [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received unexpected event network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance with vm_state rescued and task_state unrescuing.
Apr 12 10:41:18 user nova-compute[71557]: DEBUG nova.compute.manager [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received event network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] Acquiring lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG nova.compute.manager [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] No waiting events found dispatching network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:18 user nova-compute[71557]: WARNING nova.compute.manager [req-fefebae0-f8c0-4f32-863c-396665958f21 req-81f0c561-9548-4f37-a9d5-f082d3f1255d service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received unexpected event network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance with vm_state rescued and task_state unrescuing.
Apr 12 10:41:18 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-d04cb526-f77a-457c-90b1-3e5c202c0c30" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-d04cb526-f77a-457c-90b1-3e5c202c0c30" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG nova.compute.manager [req-ffad7374-7b6b-4227-9958-ef1a2b2e83a7 req-f442cffc-e375-41d6-86c5-00dbf57a6986 service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received event network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ffad7374-7b6b-4227-9958-ef1a2b2e83a7 req-f442cffc-e375-41d6-86c5-00dbf57a6986 service nova] Acquiring lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ffad7374-7b6b-4227-9958-ef1a2b2e83a7 req-f442cffc-e375-41d6-86c5-00dbf57a6986 service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ffad7374-7b6b-4227-9958-ef1a2b2e83a7 req-f442cffc-e375-41d6-86c5-00dbf57a6986 service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG nova.compute.manager [req-ffad7374-7b6b-4227-9958-ef1a2b2e83a7 req-f442cffc-e375-41d6-86c5-00dbf57a6986 service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] No waiting events found dispatching network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:18 user nova-compute[71557]: WARNING nova.compute.manager [req-ffad7374-7b6b-4227-9958-ef1a2b2e83a7 req-f442cffc-e375-41d6-86c5-00dbf57a6986 service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received unexpected event network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance with vm_state rescued and task_state unrescuing.
Apr 12 10:41:18 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2843959a-dceb-4612-9105-756135a7ecd8 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Removed pending event for f47d368e-3870-49d0-8522-a94991ec4ba5 due to event {{(pid=71557) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296078.6966183, f47d368e-3870-49d0-8522-a94991ec4ba5 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:41:18 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] VM Resumed (Lifecycle Event)
Apr 12 10:41:18 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:41:18 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 10:41:18 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296078.6972103, f47d368e-3870-49d0-8522-a94991ec4ba5 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:41:18 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] VM Started (Lifecycle Event)
Apr 12 10:41:18 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:41:18 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:41:19 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Updating instance_info_cache with network_info: [{"id": "d6cd169f-f736-45da-96ea-c0b933c882a0", "address": "fa:16:3e:ab:9d:90", "network": {"id": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-80273954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdb8217b1544db384bebe1059848bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6cd169f-f7", "ovs_interfaceid": "d6cd169f-f736-45da-96ea-c0b933c882a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:41:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-d04cb526-f77a-457c-90b1-3e5c202c0c30" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:41:19 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:41:19 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:41:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:19 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:41:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:41:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:41:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:41:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:41:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:41:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:41:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:22 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:41:22 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:41:22 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=7841MB free_disk=26.33737564086914GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance f47d368e-3870-49d0-8522-a94991ec4ba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance dc6eb5d4-d415-4459-a95b-5a470ec66586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance d04cb526-f77a-457c-90b1-3e5c202c0c30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.797s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Cleaning up deleted instances {{(pid=71557) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] There are 0 instances to clean {{(pid=71557) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Cleaning up deleted instances with incomplete migration  {{(pid=71557) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 10:41:22 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:41:23 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:41:23 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:41:23 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:41:23 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:41:23 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:41:23 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:41:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:41:23 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:41:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:41:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:23 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:41:23 user nova-compute[71557]: INFO nova.compute.claims [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Claim successful on node user
Apr 12 10:41:24 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:41:24 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:41:24 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:41:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:41:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:41:24 user nova-compute[71557]: DEBUG nova.network.neutron [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:41:24 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:41:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:41:24 user nova-compute[71557]: DEBUG nova.policy [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bccad0e37147441cb68130a22197a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bb70c871154a14947ea3421553a229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:41:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:41:24 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:41:24 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Creating image(s)
Apr 12 10:41:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "/opt/stack/data/nova/instances/aec86031-be71-4a8f-a8ad-cf04c506fdb4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "/opt/stack/data/nova/instances/aec86031-be71-4a8f-a8ad-cf04c506fdb4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "/opt/stack/data/nova/instances/aec86031-be71-4a8f-a8ad-cf04c506fdb4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.144s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.144s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/aec86031-be71-4a8f-a8ad-cf04c506fdb4/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/aec86031-be71-4a8f-a8ad-cf04c506fdb4/disk 1073741824" returned: 0 in 0.101s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.230s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:25 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aec86031-be71-4a8f-a8ad-cf04c506fdb4/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:41:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec86031-be71-4a8f-a8ad-cf04c506fdb4/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec86031-be71-4a8f-a8ad-cf04c506fdb4/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:25 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Cannot resize image /opt/stack/data/nova/instances/aec86031-be71-4a8f-a8ad-cf04c506fdb4/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:41:25 user nova-compute[71557]: DEBUG nova.objects.instance [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lazy-loading 'migration_context' on Instance uuid aec86031-be71-4a8f-a8ad-cf04c506fdb4 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:41:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:41:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Ensure instance console log exists: /opt/stack/data/nova/instances/aec86031-be71-4a8f-a8ad-cf04c506fdb4/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:41:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:26 user nova-compute[71557]: DEBUG nova.network.neutron [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Successfully created port: ad98480a-be93-49cd-8de6-0678546d7f68 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:41:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG nova.network.neutron [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Successfully updated port: ad98480a-be93-49cd-8de6-0678546d7f68 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "refresh_cache-aec86031-be71-4a8f-a8ad-cf04c506fdb4" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquired lock "refresh_cache-aec86031-be71-4a8f-a8ad-cf04c506fdb4" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG nova.network.neutron [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG nova.compute.manager [req-a2fd8a23-1112-40b6-b447-b9ec06d4a0bf req-3723d462-eeb4-41b6-8a1e-7c41bdaa5851 service nova] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Received event network-changed-ad98480a-be93-49cd-8de6-0678546d7f68 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG nova.compute.manager [req-a2fd8a23-1112-40b6-b447-b9ec06d4a0bf req-3723d462-eeb4-41b6-8a1e-7c41bdaa5851 service nova] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Refreshing instance network info cache due to event network-changed-ad98480a-be93-49cd-8de6-0678546d7f68. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a2fd8a23-1112-40b6-b447-b9ec06d4a0bf req-3723d462-eeb4-41b6-8a1e-7c41bdaa5851 service nova] Acquiring lock "refresh_cache-aec86031-be71-4a8f-a8ad-cf04c506fdb4" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG nova.network.neutron [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "7f834736-e836-49d3-b931-83ad82bef8f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "7f834736-e836-49d3-b931-83ad82bef8f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG nova.network.neutron [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Updating instance_info_cache with network_info: [{"id": "ad98480a-be93-49cd-8de6-0678546d7f68", "address": "fa:16:3e:b1:43:2e", "network": {"id": "1b1e97a6-2805-47eb-b62a-777fed79a136", "bridge": "br-int", "label": "tempest-VolumesActionsTest-625847221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "71bb70c871154a14947ea3421553a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad98480a-be", "ovs_interfaceid": "ad98480a-be93-49cd-8de6-0678546d7f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Releasing lock "refresh_cache-aec86031-be71-4a8f-a8ad-cf04c506fdb4" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG nova.compute.manager [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Instance network_info: |[{"id": "ad98480a-be93-49cd-8de6-0678546d7f68", "address": "fa:16:3e:b1:43:2e", "network": {"id": "1b1e97a6-2805-47eb-b62a-777fed79a136", "bridge": "br-int", "label": "tempest-VolumesActionsTest-625847221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "71bb70c871154a14947ea3421553a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad98480a-be", "ovs_interfaceid": "ad98480a-be93-49cd-8de6-0678546d7f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a2fd8a23-1112-40b6-b447-b9ec06d4a0bf req-3723d462-eeb4-41b6-8a1e-7c41bdaa5851 service nova] Acquired lock "refresh_cache-aec86031-be71-4a8f-a8ad-cf04c506fdb4" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG nova.network.neutron [req-a2fd8a23-1112-40b6-b447-b9ec06d4a0bf req-3723d462-eeb4-41b6-8a1e-7c41bdaa5851 service nova] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Refreshing network info cache for port ad98480a-be93-49cd-8de6-0678546d7f68 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Start _get_guest_xml network_info=[{"id": "ad98480a-be93-49cd-8de6-0678546d7f68", "address": "fa:16:3e:b1:43:2e", "network": {"id": "1b1e97a6-2805-47eb-b62a-777fed79a136", "bridge": "br-int", "label": "tempest-VolumesActionsTest-625847221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "71bb70c871154a14947ea3421553a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad98480a-be", "ovs_interfaceid": "ad98480a-be93-49cd-8de6-0678546d7f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:41:28 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:41:28 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:41:28 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:41:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1994532850',display_name='tempest-VolumesActionsTest-instance-1994532850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1994532850',id=18,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71bb70c871154a14947ea3421553a229',ramdisk_id='',reservation_id='r-d5l9rl26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-715093810',owner_user_name='tempest-VolumesActionsTest-715093810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:41:25Z,user_data=None,user_id='bccad0e37147441cb68130a22197a5d4',uuid=aec86031-be71-4a8f-a8ad-cf04c506fdb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad98480a-be93-49cd-8de6-0678546d7f68", "address": "fa:16:3e:b1:43:2e", "network": {"id": "1b1e97a6-2805-47eb-b62a-777fed79a136", "bridge": "br-int", "label": "tempest-VolumesActionsTest-625847221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "71bb70c871154a14947ea3421553a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad98480a-be", "ovs_interfaceid": "ad98480a-be93-49cd-8de6-0678546d7f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Converting VIF {"id": "ad98480a-be93-49cd-8de6-0678546d7f68", "address": "fa:16:3e:b1:43:2e", "network": {"id": "1b1e97a6-2805-47eb-b62a-777fed79a136", "bridge": "br-int", "label": "tempest-VolumesActionsTest-625847221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "71bb70c871154a14947ea3421553a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad98480a-be", "ovs_interfaceid": "ad98480a-be93-49cd-8de6-0678546d7f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:43:2e,bridge_name='br-int',has_traffic_filtering=True,id=ad98480a-be93-49cd-8de6-0678546d7f68,network=Network(1b1e97a6-2805-47eb-b62a-777fed79a136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad98480a-be') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.objects.instance [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lazy-loading 'pci_devices' on Instance uuid aec86031-be71-4a8f-a8ad-cf04c506fdb4 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:41:29 user nova-compute[71557]:   <uuid>aec86031-be71-4a8f-a8ad-cf04c506fdb4</uuid>
Apr 12 10:41:29 user nova-compute[71557]:   <name>instance-00000012</name>
Apr 12 10:41:29 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:41:29 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:41:29 user nova-compute[71557]:   <metadata>
Apr 12 10:41:29 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:41:29 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:41:29 user nova-compute[71557]:       <nova:name>tempest-VolumesActionsTest-instance-1994532850</nova:name>
Apr 12 10:41:29 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:41:28</nova:creationTime>
Apr 12 10:41:29 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:41:29 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:41:29 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:41:29 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:41:29 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:41:29 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:41:29 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:41:29 user nova-compute[71557]:       <nova:owner>
Apr 12 10:41:29 user nova-compute[71557]:         <nova:user uuid="bccad0e37147441cb68130a22197a5d4">tempest-VolumesActionsTest-715093810-project-member</nova:user>
Apr 12 10:41:29 user nova-compute[71557]:         <nova:project uuid="71bb70c871154a14947ea3421553a229">tempest-VolumesActionsTest-715093810</nova:project>
Apr 12 10:41:29 user nova-compute[71557]:       </nova:owner>
Apr 12 10:41:29 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:41:29 user nova-compute[71557]:       <nova:ports>
Apr 12 10:41:29 user nova-compute[71557]:         <nova:port uuid="ad98480a-be93-49cd-8de6-0678546d7f68">
Apr 12 10:41:29 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 10:41:29 user nova-compute[71557]:         </nova:port>
Apr 12 10:41:29 user nova-compute[71557]:       </nova:ports>
Apr 12 10:41:29 user nova-compute[71557]:     </nova:instance>
Apr 12 10:41:29 user nova-compute[71557]:   </metadata>
Apr 12 10:41:29 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:41:29 user nova-compute[71557]:     <system>
Apr 12 10:41:29 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:41:29 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:41:29 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:41:29 user nova-compute[71557]:       <entry name="serial">aec86031-be71-4a8f-a8ad-cf04c506fdb4</entry>
Apr 12 10:41:29 user nova-compute[71557]:       <entry name="uuid">aec86031-be71-4a8f-a8ad-cf04c506fdb4</entry>
Apr 12 10:41:29 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:41:29 user nova-compute[71557]:     </system>
Apr 12 10:41:29 user nova-compute[71557]:   </sysinfo>
Apr 12 10:41:29 user nova-compute[71557]:   <os>
Apr 12 10:41:29 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:41:29 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:41:29 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:41:29 user nova-compute[71557]:   </os>
Apr 12 10:41:29 user nova-compute[71557]:   <features>
Apr 12 10:41:29 user nova-compute[71557]:     <acpi/>
Apr 12 10:41:29 user nova-compute[71557]:     <apic/>
Apr 12 10:41:29 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:41:29 user nova-compute[71557]:   </features>
Apr 12 10:41:29 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:41:29 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:41:29 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:41:29 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:41:29 user nova-compute[71557]:   </clock>
Apr 12 10:41:29 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:41:29 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:41:29 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:41:29 user nova-compute[71557]:   </cpu>
Apr 12 10:41:29 user nova-compute[71557]:   <devices>
Apr 12 10:41:29 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:41:29 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:41:29 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/aec86031-be71-4a8f-a8ad-cf04c506fdb4/disk"/>
Apr 12 10:41:29 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:41:29 user nova-compute[71557]:     </disk>
Apr 12 10:41:29 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:41:29 user nova-compute[71557]:       <mac address="fa:16:3e:b1:43:2e"/>
Apr 12 10:41:29 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:41:29 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:41:29 user nova-compute[71557]:       <target dev="tapad98480a-be"/>
Apr 12 10:41:29 user nova-compute[71557]:     </interface>
Apr 12 10:41:29 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:41:29 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/aec86031-be71-4a8f-a8ad-cf04c506fdb4/console.log" append="off"/>
Apr 12 10:41:29 user nova-compute[71557]:     </serial>
Apr 12 10:41:29 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:41:29 user nova-compute[71557]:     <video>
Apr 12 10:41:29 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:41:29 user nova-compute[71557]:     </video>
Apr 12 10:41:29 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:41:29 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:41:29 user nova-compute[71557]:     </rng>
Apr 12 10:41:29 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:41:29 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:41:29 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:41:29 user nova-compute[71557]:     </memballoon>
Apr 12 10:41:29 user nova-compute[71557]:   </devices>
Apr 12 10:41:29 user nova-compute[71557]: </domain>
Apr 12 10:41:29 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1994532850',display_name='tempest-VolumesActionsTest-instance-1994532850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1994532850',id=18,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71bb70c871154a14947ea3421553a229',ramdisk_id='',reservation_id='r-d5l9rl26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-715093810',owner_user_name='tempest-VolumesActionsTest-715093810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:41:25Z,user_data=None,user_id='bccad0e37147441cb68130a22197a5d4',uuid=aec86031-be71-4a8f-a8ad-cf04c506fdb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad98480a-be93-49cd-8de6-0678546d7f68", "address": "fa:16:3e:b1:43:2e", "network": {"id": "1b1e97a6-2805-47eb-b62a-777fed79a136", "bridge": "br-int", "label": "tempest-VolumesActionsTest-625847221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "71bb70c871154a14947ea3421553a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad98480a-be", "ovs_interfaceid": "ad98480a-be93-49cd-8de6-0678546d7f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Converting VIF {"id": "ad98480a-be93-49cd-8de6-0678546d7f68", "address": "fa:16:3e:b1:43:2e", "network": {"id": "1b1e97a6-2805-47eb-b62a-777fed79a136", "bridge": "br-int", "label": "tempest-VolumesActionsTest-625847221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "71bb70c871154a14947ea3421553a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad98480a-be", "ovs_interfaceid": "ad98480a-be93-49cd-8de6-0678546d7f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:43:2e,bridge_name='br-int',has_traffic_filtering=True,id=ad98480a-be93-49cd-8de6-0678546d7f68,network=Network(1b1e97a6-2805-47eb-b62a-777fed79a136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad98480a-be') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG os_vif [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:43:2e,bridge_name='br-int',has_traffic_filtering=True,id=ad98480a-be93-49cd-8de6-0678546d7f68,network=Network(1b1e97a6-2805-47eb-b62a-777fed79a136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad98480a-be') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad98480a-be, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapad98480a-be, col_values=(('external_ids', {'iface-id': 'ad98480a-be93-49cd-8de6-0678546d7f68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:43:2e', 'vm-uuid': 'aec86031-be71-4a8f-a8ad-cf04c506fdb4'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:29 user nova-compute[71557]: INFO os_vif [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:43:2e,bridge_name='br-int',has_traffic_filtering=True,id=ad98480a-be93-49cd-8de6-0678546d7f68,network=Network(1b1e97a6-2805-47eb-b62a-777fed79a136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad98480a-be')
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:41:29 user nova-compute[71557]: INFO nova.compute.claims [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Claim successful on node user
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] No VIF found with MAC fa:16:3e:b1:43:2e, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.compute.manager [req-667e8630-fb4e-400b-9c71-0659e2110d43 req-6d371543-d73b-4508-843d-89f46b6b369d service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-changed-daf1aa56-7b24-4f41-93fd-a54cdf96428f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.compute.manager [req-667e8630-fb4e-400b-9c71-0659e2110d43 req-6d371543-d73b-4508-843d-89f46b6b369d service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Refreshing instance network info cache due to event network-changed-daf1aa56-7b24-4f41-93fd-a54cdf96428f. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-667e8630-fb4e-400b-9c71-0659e2110d43 req-6d371543-d73b-4508-843d-89f46b6b369d service nova] Acquiring lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-667e8630-fb4e-400b-9c71-0659e2110d43 req-6d371543-d73b-4508-843d-89f46b6b369d service nova] Acquired lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.network.neutron [req-667e8630-fb4e-400b-9c71-0659e2110d43 req-6d371543-d73b-4508-843d-89f46b6b369d service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Refreshing network info cache for port daf1aa56-7b24-4f41-93fd-a54cdf96428f {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:41:29 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.network.neutron [req-a2fd8a23-1112-40b6-b447-b9ec06d4a0bf req-3723d462-eeb4-41b6-8a1e-7c41bdaa5851 service nova] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Updated VIF entry in instance network info cache for port ad98480a-be93-49cd-8de6-0678546d7f68. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.network.neutron [req-a2fd8a23-1112-40b6-b447-b9ec06d4a0bf req-3723d462-eeb4-41b6-8a1e-7c41bdaa5851 service nova] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Updating instance_info_cache with network_info: [{"id": "ad98480a-be93-49cd-8de6-0678546d7f68", "address": "fa:16:3e:b1:43:2e", "network": {"id": "1b1e97a6-2805-47eb-b62a-777fed79a136", "bridge": "br-int", "label": "tempest-VolumesActionsTest-625847221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "71bb70c871154a14947ea3421553a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad98480a-be", "ovs_interfaceid": "ad98480a-be93-49cd-8de6-0678546d7f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a2fd8a23-1112-40b6-b447-b9ec06d4a0bf req-3723d462-eeb4-41b6-8a1e-7c41bdaa5851 service nova] Releasing lock "refresh_cache-aec86031-be71-4a8f-a8ad-cf04c506fdb4" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.policy [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c97c57a3e7142d088e1cf315f5d8d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16de154a6d344b18a939c6a1b1a679f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:41:29 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Creating image(s)
Apr 12 10:41:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f834736-e836-49d3-b931-83ad82bef8f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "/opt/stack/data/nova/instances/7f834736-e836-49d3-b931-83ad82bef8f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "/opt/stack/data/nova/instances/7f834736-e836-49d3-b931-83ad82bef8f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.152s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.147s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/7f834736-e836-49d3-b931-83ad82bef8f3/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/7f834736-e836-49d3-b931-83ad82bef8f3/disk 1073741824" returned: 0 in 0.070s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.163s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f834736-e836-49d3-b931-83ad82bef8f3/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f834736-e836-49d3-b931-83ad82bef8f3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG nova.network.neutron [req-667e8630-fb4e-400b-9c71-0659e2110d43 req-6d371543-d73b-4508-843d-89f46b6b369d service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Updated VIF entry in instance network info cache for port daf1aa56-7b24-4f41-93fd-a54cdf96428f. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG nova.network.neutron [req-667e8630-fb4e-400b-9c71-0659e2110d43 req-6d371543-d73b-4508-843d-89f46b6b369d service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Updating instance_info_cache with network_info: [{"id": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "address": "fa:16:3e:cf:11:4a", "network": {"id": "698d4aee-44be-48ca-ab9b-0d58aed34d96", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1402217495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf1aa56-7b", "ovs_interfaceid": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "address": "fa:16:3e:15:59:c8", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbdccd3-ba", "ovs_interfaceid": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "address": "fa:16:3e:20:f6:ea", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e56f7-00", "ovs_interfaceid": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb79e431-1d99-40eb-94a0-20032fa213fb", "address": "fa:16:3e:fe:d3:c6", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb79e431-1d", "ovs_interfaceid": "fb79e431-1d99-40eb-94a0-20032fa213fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "address": "fa:16:3e:fe:8f:eb", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825c6036-d1", "ovs_interfaceid": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "address": "fa:16:3e:59:ab:3b", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13923b13-db", "ovs_interfaceid": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "address": "fa:16:3e:9d:7d:33", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8cf480-05", "ovs_interfaceid": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f834736-e836-49d3-b931-83ad82bef8f3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Cannot resize image /opt/stack/data/nova/instances/7f834736-e836-49d3-b931-83ad82bef8f3/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG nova.objects.instance [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lazy-loading 'migration_context' on Instance uuid 7f834736-e836-49d3-b931-83ad82bef8f3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Successfully created port: 28905d4a-0e25-4d67-bab4-ee310dd9eea8 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Ensure instance console log exists: /opt/stack/data/nova/instances/7f834736-e836-49d3-b931-83ad82bef8f3/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-667e8630-fb4e-400b-9c71-0659e2110d43 req-6d371543-d73b-4508-843d-89f46b6b369d service nova] Releasing lock "refresh_cache-6b152adb-ca3d-45cf-a394-5ba5b36180a8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:31 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:31 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:31 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Successfully updated port: 28905d4a-0e25-4d67-bab4-ee310dd9eea8 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:41:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "refresh_cache-7f834736-e836-49d3-b931-83ad82bef8f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:41:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquired lock "refresh_cache-7f834736-e836-49d3-b931-83ad82bef8f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:41:31 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:41:31 user nova-compute[71557]: DEBUG nova.compute.manager [req-264d1ff6-e116-404c-9c7f-043b39f7fe76 req-d0a1f13a-a1fb-4b76-93a4-9c91f53721f2 service nova] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Received event network-vif-plugged-ad98480a-be93-49cd-8de6-0678546d7f68 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-264d1ff6-e116-404c-9c7f-043b39f7fe76 req-d0a1f13a-a1fb-4b76-93a4-9c91f53721f2 service nova] Acquiring lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-264d1ff6-e116-404c-9c7f-043b39f7fe76 req-d0a1f13a-a1fb-4b76-93a4-9c91f53721f2 service nova] Lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-264d1ff6-e116-404c-9c7f-043b39f7fe76 req-d0a1f13a-a1fb-4b76-93a4-9c91f53721f2 service nova] Lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:31 user nova-compute[71557]: DEBUG nova.compute.manager [req-264d1ff6-e116-404c-9c7f-043b39f7fe76 req-d0a1f13a-a1fb-4b76-93a4-9c91f53721f2 service nova] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] No waiting events found dispatching network-vif-plugged-ad98480a-be93-49cd-8de6-0678546d7f68 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:31 user nova-compute[71557]: WARNING nova.compute.manager [req-264d1ff6-e116-404c-9c7f-043b39f7fe76 req-d0a1f13a-a1fb-4b76-93a4-9c91f53721f2 service nova] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Received unexpected event network-vif-plugged-ad98480a-be93-49cd-8de6-0678546d7f68 for instance with vm_state building and task_state spawning.
Apr 12 10:41:31 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:41:31 user nova-compute[71557]: DEBUG nova.compute.manager [req-34d3e2cd-1870-4442-ad84-1226cd86625e req-b2e74b39-c8b8-419b-a44b-d4813a1c5acd service nova] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Received event network-changed-28905d4a-0e25-4d67-bab4-ee310dd9eea8 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:31 user nova-compute[71557]: DEBUG nova.compute.manager [req-34d3e2cd-1870-4442-ad84-1226cd86625e req-b2e74b39-c8b8-419b-a44b-d4813a1c5acd service nova] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Refreshing instance network info cache due to event network-changed-28905d4a-0e25-4d67-bab4-ee310dd9eea8. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:41:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-34d3e2cd-1870-4442-ad84-1226cd86625e req-b2e74b39-c8b8-419b-a44b-d4813a1c5acd service nova] Acquiring lock "refresh_cache-7f834736-e836-49d3-b931-83ad82bef8f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:32 user nova-compute[71557]: INFO nova.compute.manager [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Terminating instance
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.compute.manager [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Updating instance_info_cache with network_info: [{"id": "28905d4a-0e25-4d67-bab4-ee310dd9eea8", "address": "fa:16:3e:9e:5b:89", "network": {"id": "a5611852-639c-4e1f-8dbc-cc88bc5651d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1575956045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "16de154a6d344b18a939c6a1b1a679f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28905d4a-0e", "ovs_interfaceid": "28905d4a-0e25-4d67-bab4-ee310dd9eea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Releasing lock "refresh_cache-7f834736-e836-49d3-b931-83ad82bef8f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Instance network_info: |[{"id": "28905d4a-0e25-4d67-bab4-ee310dd9eea8", "address": "fa:16:3e:9e:5b:89", "network": {"id": "a5611852-639c-4e1f-8dbc-cc88bc5651d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1575956045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "16de154a6d344b18a939c6a1b1a679f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28905d4a-0e", "ovs_interfaceid": "28905d4a-0e25-4d67-bab4-ee310dd9eea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-34d3e2cd-1870-4442-ad84-1226cd86625e req-b2e74b39-c8b8-419b-a44b-d4813a1c5acd service nova] Acquired lock "refresh_cache-7f834736-e836-49d3-b931-83ad82bef8f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.network.neutron [req-34d3e2cd-1870-4442-ad84-1226cd86625e req-b2e74b39-c8b8-419b-a44b-d4813a1c5acd service nova] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Refreshing network info cache for port 28905d4a-0e25-4d67-bab4-ee310dd9eea8 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Start _get_guest_xml network_info=[{"id": "28905d4a-0e25-4d67-bab4-ee310dd9eea8", "address": "fa:16:3e:9e:5b:89", "network": {"id": "a5611852-639c-4e1f-8dbc-cc88bc5651d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1575956045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "16de154a6d344b18a939c6a1b1a679f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28905d4a-0e", "ovs_interfaceid": "28905d4a-0e25-4d67-bab4-ee310dd9eea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:32 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:41:32 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:41:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1856542060',display_name='tempest-VolumesSnapshotTestJSON-instance-1856542060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1856542060',id=19,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16de154a6d344b18a939c6a1b1a679f5',ramdisk_id='',reservation_id='r-zk7z1bow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-858479648',owner_user_name='tempest-VolumesSnapshotTestJSON-858479648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:41:30Z,user_data=None,user_id='2c97c57a3e7142d088e1cf315f5d8d72',uuid=7f834736-e836-49d3-b931-83ad82bef8f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28905d4a-0e25-4d67-bab4-ee310dd9eea8", "address": "fa:16:3e:9e:5b:89", "network": {"id": "a5611852-639c-4e1f-8dbc-cc88bc5651d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1575956045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "16de154a6d344b18a939c6a1b1a679f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28905d4a-0e", "ovs_interfaceid": "28905d4a-0e25-4d67-bab4-ee310dd9eea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Converting VIF {"id": "28905d4a-0e25-4d67-bab4-ee310dd9eea8", "address": "fa:16:3e:9e:5b:89", "network": {"id": "a5611852-639c-4e1f-8dbc-cc88bc5651d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1575956045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "16de154a6d344b18a939c6a1b1a679f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28905d4a-0e", "ovs_interfaceid": "28905d4a-0e25-4d67-bab4-ee310dd9eea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5b:89,bridge_name='br-int',has_traffic_filtering=True,id=28905d4a-0e25-4d67-bab4-ee310dd9eea8,network=Network(a5611852-639c-4e1f-8dbc-cc88bc5651d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28905d4a-0e') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.objects.instance [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f834736-e836-49d3-b931-83ad82bef8f3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:41:32 user nova-compute[71557]:   <uuid>7f834736-e836-49d3-b931-83ad82bef8f3</uuid>
Apr 12 10:41:32 user nova-compute[71557]:   <name>instance-00000013</name>
Apr 12 10:41:32 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:41:32 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:41:32 user nova-compute[71557]:   <metadata>
Apr 12 10:41:32 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:41:32 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:41:32 user nova-compute[71557]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1856542060</nova:name>
Apr 12 10:41:32 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:41:32</nova:creationTime>
Apr 12 10:41:32 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:41:32 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:41:32 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:41:32 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:41:32 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:41:32 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:41:32 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:41:32 user nova-compute[71557]:       <nova:owner>
Apr 12 10:41:32 user nova-compute[71557]:         <nova:user uuid="2c97c57a3e7142d088e1cf315f5d8d72">tempest-VolumesSnapshotTestJSON-858479648-project-member</nova:user>
Apr 12 10:41:32 user nova-compute[71557]:         <nova:project uuid="16de154a6d344b18a939c6a1b1a679f5">tempest-VolumesSnapshotTestJSON-858479648</nova:project>
Apr 12 10:41:32 user nova-compute[71557]:       </nova:owner>
Apr 12 10:41:32 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:41:32 user nova-compute[71557]:       <nova:ports>
Apr 12 10:41:32 user nova-compute[71557]:         <nova:port uuid="28905d4a-0e25-4d67-bab4-ee310dd9eea8">
Apr 12 10:41:32 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 10:41:32 user nova-compute[71557]:         </nova:port>
Apr 12 10:41:32 user nova-compute[71557]:       </nova:ports>
Apr 12 10:41:32 user nova-compute[71557]:     </nova:instance>
Apr 12 10:41:32 user nova-compute[71557]:   </metadata>
Apr 12 10:41:32 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:41:32 user nova-compute[71557]:     <system>
Apr 12 10:41:32 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:41:32 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:41:32 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:41:32 user nova-compute[71557]:       <entry name="serial">7f834736-e836-49d3-b931-83ad82bef8f3</entry>
Apr 12 10:41:32 user nova-compute[71557]:       <entry name="uuid">7f834736-e836-49d3-b931-83ad82bef8f3</entry>
Apr 12 10:41:32 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:41:32 user nova-compute[71557]:     </system>
Apr 12 10:41:32 user nova-compute[71557]:   </sysinfo>
Apr 12 10:41:32 user nova-compute[71557]:   <os>
Apr 12 10:41:32 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:41:32 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:41:32 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:41:32 user nova-compute[71557]:   </os>
Apr 12 10:41:32 user nova-compute[71557]:   <features>
Apr 12 10:41:32 user nova-compute[71557]:     <acpi/>
Apr 12 10:41:32 user nova-compute[71557]:     <apic/>
Apr 12 10:41:32 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:41:32 user nova-compute[71557]:   </features>
Apr 12 10:41:32 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:41:32 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:41:32 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:41:32 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:41:32 user nova-compute[71557]:   </clock>
Apr 12 10:41:32 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:41:32 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:41:32 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:41:32 user nova-compute[71557]:   </cpu>
Apr 12 10:41:32 user nova-compute[71557]:   <devices>
Apr 12 10:41:32 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:41:32 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:41:32 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/7f834736-e836-49d3-b931-83ad82bef8f3/disk"/>
Apr 12 10:41:32 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:41:32 user nova-compute[71557]:     </disk>
Apr 12 10:41:32 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:41:32 user nova-compute[71557]:       <mac address="fa:16:3e:9e:5b:89"/>
Apr 12 10:41:32 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:41:32 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:41:32 user nova-compute[71557]:       <target dev="tap28905d4a-0e"/>
Apr 12 10:41:32 user nova-compute[71557]:     </interface>
Apr 12 10:41:32 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:41:32 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/7f834736-e836-49d3-b931-83ad82bef8f3/console.log" append="off"/>
Apr 12 10:41:32 user nova-compute[71557]:     </serial>
Apr 12 10:41:32 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:41:32 user nova-compute[71557]:     <video>
Apr 12 10:41:32 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:41:32 user nova-compute[71557]:     </video>
Apr 12 10:41:32 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:41:32 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:41:32 user nova-compute[71557]:     </rng>
Apr 12 10:41:32 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:41:32 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:41:32 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:41:32 user nova-compute[71557]:     </memballoon>
Apr 12 10:41:32 user nova-compute[71557]:   </devices>
Apr 12 10:41:32 user nova-compute[71557]: </domain>
Apr 12 10:41:32 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:41:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1856542060',display_name='tempest-VolumesSnapshotTestJSON-instance-1856542060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1856542060',id=19,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16de154a6d344b18a939c6a1b1a679f5',ramdisk_id='',reservation_id='r-zk7z1bow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-858479648',owner_user_name='tempest-VolumesSnapshotTestJSON-858479648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:41:30Z,user_data=None,user_id='2c97c57a3e7142d088e1cf315f5d8d72',uuid=7f834736-e836-49d3-b931-83ad82bef8f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28905d4a-0e25-4d67-bab4-ee310dd9eea8", "address": "fa:16:3e:9e:5b:89", "network": {"id": "a5611852-639c-4e1f-8dbc-cc88bc5651d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1575956045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "16de154a6d344b18a939c6a1b1a679f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28905d4a-0e", "ovs_interfaceid": "28905d4a-0e25-4d67-bab4-ee310dd9eea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Converting VIF {"id": "28905d4a-0e25-4d67-bab4-ee310dd9eea8", "address": "fa:16:3e:9e:5b:89", "network": {"id": "a5611852-639c-4e1f-8dbc-cc88bc5651d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1575956045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "16de154a6d344b18a939c6a1b1a679f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28905d4a-0e", "ovs_interfaceid": "28905d4a-0e25-4d67-bab4-ee310dd9eea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5b:89,bridge_name='br-int',has_traffic_filtering=True,id=28905d4a-0e25-4d67-bab4-ee310dd9eea8,network=Network(a5611852-639c-4e1f-8dbc-cc88bc5651d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28905d4a-0e') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG os_vif [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5b:89,bridge_name='br-int',has_traffic_filtering=True,id=28905d4a-0e25-4d67-bab4-ee310dd9eea8,network=Network(a5611852-639c-4e1f-8dbc-cc88bc5651d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28905d4a-0e') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28905d4a-0e, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap28905d4a-0e, col_values=(('external_ids', {'iface-id': '28905d4a-0e25-4d67-bab4-ee310dd9eea8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:5b:89', 'vm-uuid': '7f834736-e836-49d3-b931-83ad82bef8f3'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:32 user nova-compute[71557]: INFO os_vif [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5b:89,bridge_name='br-int',has_traffic_filtering=True,id=28905d4a-0e25-4d67-bab4-ee310dd9eea8,network=Network(a5611852-639c-4e1f-8dbc-cc88bc5651d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28905d4a-0e')
Apr 12 10:41:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] No VIF found with MAC fa:16:3e:9e:5b:89, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.compute.manager [req-9aa3c33e-452b-494b-a503-7057085a4314 req-eeab5459-5d52-4ddb-9408-5fd71682d8dd service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-unplugged-daf1aa56-7b24-4f41-93fd-a54cdf96428f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9aa3c33e-452b-494b-a503-7057085a4314 req-eeab5459-5d52-4ddb-9408-5fd71682d8dd service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9aa3c33e-452b-494b-a503-7057085a4314 req-eeab5459-5d52-4ddb-9408-5fd71682d8dd service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9aa3c33e-452b-494b-a503-7057085a4314 req-eeab5459-5d52-4ddb-9408-5fd71682d8dd service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.compute.manager [req-9aa3c33e-452b-494b-a503-7057085a4314 req-eeab5459-5d52-4ddb-9408-5fd71682d8dd service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-unplugged-daf1aa56-7b24-4f41-93fd-a54cdf96428f {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.compute.manager [req-9aa3c33e-452b-494b-a503-7057085a4314 req-eeab5459-5d52-4ddb-9408-5fd71682d8dd service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-unplugged-daf1aa56-7b24-4f41-93fd-a54cdf96428f for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296093.7332952, aec86031-be71-4a8f-a8ad-cf04c506fdb4 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:41:33 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] VM Resumed (Lifecycle Event)
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.compute.manager [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:41:33 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Instance spawned successfully.
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:41:33 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296093.7372794, aec86031-be71-4a8f-a8ad-cf04c506fdb4 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:41:33 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] VM Started (Lifecycle Event)
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.network.neutron [req-34d3e2cd-1870-4442-ad84-1226cd86625e req-b2e74b39-c8b8-419b-a44b-d4813a1c5acd service nova] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Updated VIF entry in instance network info cache for port 28905d4a-0e25-4d67-bab4-ee310dd9eea8. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.network.neutron [req-34d3e2cd-1870-4442-ad84-1226cd86625e req-b2e74b39-c8b8-419b-a44b-d4813a1c5acd service nova] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Updating instance_info_cache with network_info: [{"id": "28905d4a-0e25-4d67-bab4-ee310dd9eea8", "address": "fa:16:3e:9e:5b:89", "network": {"id": "a5611852-639c-4e1f-8dbc-cc88bc5651d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1575956045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "16de154a6d344b18a939c6a1b1a679f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28905d4a-0e", "ovs_interfaceid": "28905d4a-0e25-4d67-bab4-ee310dd9eea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-34d3e2cd-1870-4442-ad84-1226cd86625e req-b2e74b39-c8b8-419b-a44b-d4813a1c5acd service nova] Releasing lock "refresh_cache-7f834736-e836-49d3-b931-83ad82bef8f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.compute.manager [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Received event network-vif-plugged-ad98480a-be93-49cd-8de6-0678546d7f68 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] Acquiring lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] Lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] Lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.compute.manager [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] No waiting events found dispatching network-vif-plugged-ad98480a-be93-49cd-8de6-0678546d7f68 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:33 user nova-compute[71557]: WARNING nova.compute.manager [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Received unexpected event network-vif-plugged-ad98480a-be93-49cd-8de6-0678546d7f68 for instance with vm_state building and task_state spawning.
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.compute.manager [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-unplugged-825c6036-d16c-43ab-9f6a-2bb133bf51b8 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.compute.manager [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-unplugged-825c6036-d16c-43ab-9f6a-2bb133bf51b8 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.compute.manager [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-unplugged-825c6036-d16c-43ab-9f6a-2bb133bf51b8 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.compute.manager [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-plugged-825c6036-d16c-43ab-9f6a-2bb133bf51b8 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.compute.manager [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-plugged-825c6036-d16c-43ab-9f6a-2bb133bf51b8 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:33 user nova-compute[71557]: WARNING nova.compute.manager [req-9c4fd034-78d4-4c2a-b7e1-a35d3eee1709 req-e734f854-ddd0-4e2e-921c-5cc6872d9e3d service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received unexpected event network-vif-plugged-825c6036-d16c-43ab-9f6a-2bb133bf51b8 for instance with vm_state active and task_state deleting.
Apr 12 10:41:33 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.compute.manager [req-5bb63fb6-28bd-4c4d-bae9-d1c49e037583 req-a7328570-2d76-4d82-b030-e23d1b0fda84 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-unplugged-fb79e431-1d99-40eb-94a0-20032fa213fb {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5bb63fb6-28bd-4c4d-bae9-d1c49e037583 req-a7328570-2d76-4d82-b030-e23d1b0fda84 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5bb63fb6-28bd-4c4d-bae9-d1c49e037583 req-a7328570-2d76-4d82-b030-e23d1b0fda84 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5bb63fb6-28bd-4c4d-bae9-d1c49e037583 req-a7328570-2d76-4d82-b030-e23d1b0fda84 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.compute.manager [req-5bb63fb6-28bd-4c4d-bae9-d1c49e037583 req-a7328570-2d76-4d82-b030-e23d1b0fda84 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-unplugged-fb79e431-1d99-40eb-94a0-20032fa213fb {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.compute.manager [req-5bb63fb6-28bd-4c4d-bae9-d1c49e037583 req-a7328570-2d76-4d82-b030-e23d1b0fda84 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-unplugged-fb79e431-1d99-40eb-94a0-20032fa213fb for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:41:33 user nova-compute[71557]: INFO nova.compute.manager [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Took 9.36 seconds to spawn the instance on the hypervisor.
Apr 12 10:41:33 user nova-compute[71557]: DEBUG nova.compute.manager [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:41:34 user nova-compute[71557]: INFO nova.compute.manager [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Took 10.11 seconds to build instance.
Apr 12 10:41:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-84ef798b-0290-4360-adcf-2800c8e45ea3 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.244s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:34 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Instance destroyed successfully.
Apr 12 10:41:34 user nova-compute[71557]: DEBUG nova.objects.instance [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lazy-loading 'resources' on Instance uuid 6b152adb-ca3d-45cf-a394-5ba5b36180a8 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-231402709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-231402709',id=17,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgrnV5i22OFRG0E5speJrbQ5C2cFr366R1ofK1KHnfKlkXjouVmIG6gTeCAblaA6aHPA7V/zt8E89wRDDgsgcclBN9hLWspmMoLKSmejTbAwlxWQgzo516k6V5HD6mhxg==',key_name='tempest-keypair-1587791170',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:40:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1ec9852adb94a5086dc3ef48871d5bc',ramdisk_id='',reservation_id='r-ajljxdx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1574485217',owner_user_name='tempest-TaggedBootDevicesTest-1574485217-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:40:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21034326c41f487181d19f60e0ccf219',uuid=6b152adb-ca3d-45cf-a394-5ba5b36180a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "address": "fa:16:3e:cf:11:4a", "network": {"id": "698d4aee-44be-48ca-ab9b-0d58aed34d96", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1402217495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf1aa56-7b", "ovs_interfaceid": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converting VIF {"id": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "address": "fa:16:3e:cf:11:4a", "network": {"id": "698d4aee-44be-48ca-ab9b-0d58aed34d96", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1402217495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf1aa56-7b", "ovs_interfaceid": "daf1aa56-7b24-4f41-93fd-a54cdf96428f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=daf1aa56-7b24-4f41-93fd-a54cdf96428f,network=Network(698d4aee-44be-48ca-ab9b-0d58aed34d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf1aa56-7b') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG os_vif [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=daf1aa56-7b24-4f41-93fd-a54cdf96428f,network=Network(698d4aee-44be-48ca-ab9b-0d58aed34d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf1aa56-7b') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdaf1aa56-7b, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:34 user nova-compute[71557]: INFO os_vif [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=daf1aa56-7b24-4f41-93fd-a54cdf96428f,network=Network(698d4aee-44be-48ca-ab9b-0d58aed34d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf1aa56-7b')
Apr 12 10:41:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-231402709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-231402709',id=17,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgrnV5i22OFRG0E5speJrbQ5C2cFr366R1ofK1KHnfKlkXjouVmIG6gTeCAblaA6aHPA7V/zt8E89wRDDgsgcclBN9hLWspmMoLKSmejTbAwlxWQgzo516k6V5HD6mhxg==',key_name='tempest-keypair-1587791170',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:40:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1ec9852adb94a5086dc3ef48871d5bc',ramdisk_id='',reservation_id='r-ajljxdx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1574485217',owner_user_name='tempest-TaggedBootDevicesTest-1574485217-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:40:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21034326c41f487181d19f60e0ccf219',uuid=6b152adb-ca3d-45cf-a394-5ba5b36180a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "address": "fa:16:3e:15:59:c8", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbdccd3-ba", "ovs_interfaceid": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converting VIF {"id": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "address": "fa:16:3e:15:59:c8", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbdccd3-ba", "ovs_interfaceid": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:59:c8,bridge_name='br-int',has_traffic_filtering=True,id=bbbdccd3-ba1c-46e2-90b5-10d6036f72c7,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbbbdccd3-ba') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG os_vif [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:59:c8,bridge_name='br-int',has_traffic_filtering=True,id=bbbdccd3-ba1c-46e2-90b5-10d6036f72c7,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbbbdccd3-ba') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbbdccd3-ba, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:34 user nova-compute[71557]: INFO os_vif [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:59:c8,bridge_name='br-int',has_traffic_filtering=True,id=bbbdccd3-ba1c-46e2-90b5-10d6036f72c7,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbbbdccd3-ba')
Apr 12 10:41:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-231402709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-231402709',id=17,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgrnV5i22OFRG0E5speJrbQ5C2cFr366R1ofK1KHnfKlkXjouVmIG6gTeCAblaA6aHPA7V/zt8E89wRDDgsgcclBN9hLWspmMoLKSmejTbAwlxWQgzo516k6V5HD6mhxg==',key_name='tempest-keypair-1587791170',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:40:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1ec9852adb94a5086dc3ef48871d5bc',ramdisk_id='',reservation_id='r-ajljxdx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1574485217',owner_user_name='tempest-TaggedBootDevicesTest-1574485217-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:40:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21034326c41f487181d19f60e0ccf219',uuid=6b152adb-ca3d-45cf-a394-5ba5b36180a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "address": "fa:16:3e:20:f6:ea", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e56f7-00", "ovs_interfaceid": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converting VIF {"id": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "address": "fa:16:3e:20:f6:ea", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e56f7-00", "ovs_interfaceid": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:f6:ea,bridge_name='br-int',has_traffic_filtering=True,id=e16e56f7-00ab-422d-95b3-d1b204f693a3,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape16e56f7-00') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG os_vif [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:f6:ea,bridge_name='br-int',has_traffic_filtering=True,id=e16e56f7-00ab-422d-95b3-d1b204f693a3,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape16e56f7-00') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape16e56f7-00, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:34 user nova-compute[71557]: INFO os_vif [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:f6:ea,bridge_name='br-int',has_traffic_filtering=True,id=e16e56f7-00ab-422d-95b3-d1b204f693a3,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape16e56f7-00')
Apr 12 10:41:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-231402709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-231402709',id=17,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgrnV5i22OFRG0E5speJrbQ5C2cFr366R1ofK1KHnfKlkXjouVmIG6gTeCAblaA6aHPA7V/zt8E89wRDDgsgcclBN9hLWspmMoLKSmejTbAwlxWQgzo516k6V5HD6mhxg==',key_name='tempest-keypair-1587791170',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:40:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1ec9852adb94a5086dc3ef48871d5bc',ramdisk_id='',reservation_id='r-ajljxdx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1574485217',owner_user_name='tempest-TaggedBootDevicesTest-1574485217-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:40:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21034326c41f487181d19f60e0ccf219',uuid=6b152adb-ca3d-45cf-a394-5ba5b36180a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb79e431-1d99-40eb-94a0-20032fa213fb", "address": "fa:16:3e:fe:d3:c6", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb79e431-1d", "ovs_interfaceid": "fb79e431-1d99-40eb-94a0-20032fa213fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converting VIF {"id": "fb79e431-1d99-40eb-94a0-20032fa213fb", "address": "fa:16:3e:fe:d3:c6", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb79e431-1d", "ovs_interfaceid": "fb79e431-1d99-40eb-94a0-20032fa213fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d3:c6,bridge_name='br-int',has_traffic_filtering=True,id=fb79e431-1d99-40eb-94a0-20032fa213fb,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb79e431-1d') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG os_vif [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d3:c6,bridge_name='br-int',has_traffic_filtering=True,id=fb79e431-1d99-40eb-94a0-20032fa213fb,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb79e431-1d') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb79e431-1d, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:34 user nova-compute[71557]: INFO os_vif [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:d3:c6,bridge_name='br-int',has_traffic_filtering=True,id=fb79e431-1d99-40eb-94a0-20032fa213fb,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb79e431-1d')
Apr 12 10:41:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-231402709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-231402709',id=17,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgrnV5i22OFRG0E5speJrbQ5C2cFr366R1ofK1KHnfKlkXjouVmIG6gTeCAblaA6aHPA7V/zt8E89wRDDgsgcclBN9hLWspmMoLKSmejTbAwlxWQgzo516k6V5HD6mhxg==',key_name='tempest-keypair-1587791170',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:40:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1ec9852adb94a5086dc3ef48871d5bc',ramdisk_id='',reservation_id='r-ajljxdx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1574485217',owner_user_name='tempest-TaggedBootDevicesTest-1574485217-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:40:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21034326c41f487181d19f60e0ccf219',uuid=6b152adb-ca3d-45cf-a394-5ba5b36180a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "address": "fa:16:3e:fe:8f:eb", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825c6036-d1", "ovs_interfaceid": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converting VIF {"id": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "address": "fa:16:3e:fe:8f:eb", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825c6036-d1", "ovs_interfaceid": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:8f:eb,bridge_name='br-int',has_traffic_filtering=True,id=825c6036-d16c-43ab-9f6a-2bb133bf51b8,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825c6036-d1') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG os_vif [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:8f:eb,bridge_name='br-int',has_traffic_filtering=True,id=825c6036-d16c-43ab-9f6a-2bb133bf51b8,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825c6036-d1') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap825c6036-d1, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:34 user nova-compute[71557]: INFO os_vif [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:8f:eb,bridge_name='br-int',has_traffic_filtering=True,id=825c6036-d16c-43ab-9f6a-2bb133bf51b8,network=Network(26d4148b-d50a-44e3-8b4b-5673f0395785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825c6036-d1')
Apr 12 10:41:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-231402709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-231402709',id=17,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgrnV5i22OFRG0E5speJrbQ5C2cFr366R1ofK1KHnfKlkXjouVmIG6gTeCAblaA6aHPA7V/zt8E89wRDDgsgcclBN9hLWspmMoLKSmejTbAwlxWQgzo516k6V5HD6mhxg==',key_name='tempest-keypair-1587791170',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:40:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1ec9852adb94a5086dc3ef48871d5bc',ramdisk_id='',reservation_id='r-ajljxdx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1574485217',owner_user_name='tempest-TaggedBootDevicesTest-1574485217-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:40:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21034326c41f487181d19f60e0ccf219',uuid=6b152adb-ca3d-45cf-a394-5ba5b36180a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "address": "fa:16:3e:59:ab:3b", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13923b13-db", "ovs_interfaceid": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converting VIF {"id": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "address": "fa:16:3e:59:ab:3b", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13923b13-db", "ovs_interfaceid": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:ab:3b,bridge_name='br-int',has_traffic_filtering=True,id=13923b13-db35-4b98-b2b0-e2e18fd8441e,network=Network(91288215-145e-4cd6-953e-edb9f28d5c84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13923b13-db') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG os_vif [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:ab:3b,bridge_name='br-int',has_traffic_filtering=True,id=13923b13-db35-4b98-b2b0-e2e18fd8441e,network=Network(91288215-145e-4cd6-953e-edb9f28d5c84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13923b13-db') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13923b13-db, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:34 user nova-compute[71557]: INFO os_vif [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:ab:3b,bridge_name='br-int',has_traffic_filtering=True,id=13923b13-db35-4b98-b2b0-e2e18fd8441e,network=Network(91288215-145e-4cd6-953e-edb9f28d5c84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13923b13-db')
Apr 12 10:41:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T10:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-231402709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-231402709',id=17,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgrnV5i22OFRG0E5speJrbQ5C2cFr366R1ofK1KHnfKlkXjouVmIG6gTeCAblaA6aHPA7V/zt8E89wRDDgsgcclBN9hLWspmMoLKSmejTbAwlxWQgzo516k6V5HD6mhxg==',key_name='tempest-keypair-1587791170',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:40:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1ec9852adb94a5086dc3ef48871d5bc',ramdisk_id='',reservation_id='r-ajljxdx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1574485217',owner_user_name='tempest-TaggedBootDevicesTest-1574485217-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:40:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21034326c41f487181d19f60e0ccf219',uuid=6b152adb-ca3d-45cf-a394-5ba5b36180a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "address": "fa:16:3e:9d:7d:33", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8cf480-05", "ovs_interfaceid": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converting VIF {"id": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "address": "fa:16:3e:9d:7d:33", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8cf480-05", "ovs_interfaceid": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:7d:33,bridge_name='br-int',has_traffic_filtering=True,id=3c8cf480-05d6-463a-a97e-a9d869ac3860,network=Network(91288215-145e-4cd6-953e-edb9f28d5c84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8cf480-05') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG os_vif [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:7d:33,bridge_name='br-int',has_traffic_filtering=True,id=3c8cf480-05d6-463a-a97e-a9d869ac3860,network=Network(91288215-145e-4cd6-953e-edb9f28d5c84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8cf480-05') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c8cf480-05, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:41:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:35 user nova-compute[71557]: INFO os_vif [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:7d:33,bridge_name='br-int',has_traffic_filtering=True,id=3c8cf480-05d6-463a-a97e-a9d869ac3860,network=Network(91288215-145e-4cd6-953e-edb9f28d5c84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8cf480-05')
Apr 12 10:41:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztxUfEvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:41:35 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c19f87a-ff1b-4bc0-8397-457f87451d13]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:41:35 user nova-compute[71557]: No targets found.
Apr 12 10:41:35 user nova-compute[71557]: iSNS:
Apr 12 10:41:35 user nova-compute[71557]: No targets found.
Apr 12 10:41:35 user nova-compute[71557]: STATIC:
Apr 12 10:41:35 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:41:35 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:41:35 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:41:35 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93
Apr 12 10:41:35 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:41:35 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:41:35 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7
Apr 12 10:41:35 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:41:35 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:41:35 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75
Apr 12 10:41:35 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:41:35 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:41:35 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666
Apr 12 10:41:35 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:41:35 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:41:35 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2
Apr 12 10:41:35 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:41:35 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:41:35 user nova-compute[71557]: FIRMWARE:
Apr 12 10:41:35 user nova-compute[71557]: No targets found.
Apr 12 10:41:35 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:41:35 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:41:35 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[744c660a-bc47-43be-8548-75d13d83caaa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG nova.compute.manager [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-plugged-daf1aa56-7b24-4f41-93fd-a54cdf96428f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG nova.compute.manager [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-plugged-daf1aa56-7b24-4f41-93fd-a54cdf96428f {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:35 user nova-compute[71557]: WARNING nova.compute.manager [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received unexpected event network-vif-plugged-daf1aa56-7b24-4f41-93fd-a54cdf96428f for instance with vm_state active and task_state deleting.
Apr 12 10:41:35 user nova-compute[71557]: DEBUG nova.compute.manager [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-unplugged-bbbdccd3-ba1c-46e2-90b5-10d6036f72c7 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG nova.compute.manager [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-unplugged-bbbdccd3-ba1c-46e2-90b5-10d6036f72c7 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG nova.compute.manager [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-unplugged-bbbdccd3-ba1c-46e2-90b5-10d6036f72c7 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG nova.compute.manager [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-plugged-bbbdccd3-ba1c-46e2-90b5-10d6036f72c7 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG nova.compute.manager [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-plugged-bbbdccd3-ba1c-46e2-90b5-10d6036f72c7 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:35 user nova-compute[71557]: WARNING nova.compute.manager [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received unexpected event network-vif-plugged-bbbdccd3-ba1c-46e2-90b5-10d6036f72c7 for instance with vm_state active and task_state deleting.
Apr 12 10:41:35 user nova-compute[71557]: DEBUG nova.compute.manager [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-unplugged-e16e56f7-00ab-422d-95b3-d1b204f693a3 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG nova.compute.manager [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-unplugged-e16e56f7-00ab-422d-95b3-d1b204f693a3 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG nova.compute.manager [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-unplugged-e16e56f7-00ab-422d-95b3-d1b204f693a3 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG nova.compute.manager [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-plugged-e16e56f7-00ab-422d-95b3-d1b204f693a3 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG nova.compute.manager [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-plugged-e16e56f7-00ab-422d-95b3-d1b204f693a3 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:35 user nova-compute[71557]: WARNING nova.compute.manager [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received unexpected event network-vif-plugged-e16e56f7-00ab-422d-95b3-d1b204f693a3 for instance with vm_state active and task_state deleting.
Apr 12 10:41:35 user nova-compute[71557]: DEBUG nova.compute.manager [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-unplugged-3c8cf480-05d6-463a-a97e-a9d869ac3860 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG nova.compute.manager [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-unplugged-3c8cf480-05d6-463a-a97e-a9d869ac3860 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG nova.compute.manager [req-2f338560-54f6-4bbb-acce-b5e3c767ce41 req-8f6a83c4-538e-44fc-8872-3f79dc05e097 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-unplugged-3c8cf480-05d6-463a-a97e-a9d869ac3860 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc1cbba-5521-4543-a951-29f5fd2692b1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:41:35 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:41:35 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:41:35 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:41:35 user nova-compute[71557]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)
Apr 12 10:41:35 user nova-compute[71557]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 (non-flash)
Apr 12 10:41:35 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:41:35 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:41:35 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:41:35 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:41:35 user nova-compute[71557]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)
Apr 12 10:41:35 user nova-compute[71557]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 (non-flash)
Apr 12 10:41:35 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fc42ee200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2'): ({'sdg'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Removing single pathed devices sdg {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[49146bbe-26d7-4544-ae0e-ea6d24014967]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f317e508-cfa4-4afc-874f-4787fb632b8b]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Flushing IO for device /dev/sdg {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c927a22d-b5f9-4d3f-b060-45ce12bf9ff0]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.059s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bb6202-b233-402a-8e13-bdfae64fe821]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] SCSI volumes sdg have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed66f10-9210-4a75-a5a8-20df498f4448]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57afce3-8cfd-4601-80ac-96190975a390]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2, portal: 172.16.0.220,3260]
Apr 12 10:41:35 user nova-compute[71557]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2, portal: 172.16.0.220,3260] successful.
Apr 12 10:41:35 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5d2f824-dd5b-4306-a67e-2a7aeda984a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc2f55d-2c24-4447-83e2-6eaab61a4be3]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.475s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] <== disconnect_volume: return (477ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvTGZRVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:41:35 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "d04cb526-f77a-457c-90b1-3e5c202c0c30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "d04cb526-f77a-457c-90b1-3e5c202c0c30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "d04cb526-f77a-457c-90b1-3e5c202c0c30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "d04cb526-f77a-457c-90b1-3e5c202c0c30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "d04cb526-f77a-457c-90b1-3e5c202c0c30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:35 user nova-compute[71557]: INFO nova.compute.manager [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Terminating instance
Apr 12 10:41:35 user nova-compute[71557]: DEBUG nova.compute.manager [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c95f67-54c1-4abe-96dc-ca09239b53dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:41:35 user nova-compute[71557]: No targets found.
Apr 12 10:41:35 user nova-compute[71557]: iSNS:
Apr 12 10:41:35 user nova-compute[71557]: No targets found.
Apr 12 10:41:35 user nova-compute[71557]: STATIC:
Apr 12 10:41:35 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:41:35 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:41:35 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:41:35 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93
Apr 12 10:41:35 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:41:35 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:41:35 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7
Apr 12 10:41:35 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:41:35 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:41:35 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75
Apr 12 10:41:35 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:41:35 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:41:35 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666
Apr 12 10:41:35 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:41:35 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:41:35 user nova-compute[71557]: FIRMWARE:
Apr 12 10:41:35 user nova-compute[71557]: No targets found.
Apr 12 10:41:35 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:41:35 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:41:35 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f450f9-f080-4ad7-a60f-1f2fac6f31f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e4f338-8825-4e7e-ab9c-d041b4ebb2c7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:41:35 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:41:35 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:41:35 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:41:35 user nova-compute[71557]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)
Apr 12 10:41:35 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:41:35 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:41:35 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:41:35 user nova-compute[71557]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 (non-flash)
Apr 12 10:41:35 user nova-compute[71557]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)
Apr 12 10:41:35 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fc42ef640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7'): ({'sde'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Removing single pathed devices sde {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb03fe37-3ab4-40bd-8a0e-990321f4b873]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.029s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c98a59-aa42-461d-91a0-05c8ffdb5c81]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Flushing IO for device /dev/sde {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c7aac0-4921-437c-9798-ee6a8978913a]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbac64b2-17fe-41e7-b612-9f81635706ef]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] SCSI volumes sde have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4c003e-dfc1-4c9f-a386-621f4001b352]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90d98dd-59eb-49b4-9f71-70b45acba16a]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7, portal: 172.16.0.220,3260]
Apr 12 10:41:35 user nova-compute[71557]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7, portal: 172.16.0.220,3260] successful.
Apr 12 10:41:35 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76b2ba5-6ae0-4392-9b42-e06b4a967ac7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2894a2d5-4fb3-49bd-839d-bd3a338a5d59]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] <== disconnect_volume: return (452ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OHLDsUfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:41:35 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[072ac36e-1c5a-4998-a8ec-98622519d83b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:41:35 user nova-compute[71557]: No targets found.
Apr 12 10:41:35 user nova-compute[71557]: iSNS:
Apr 12 10:41:35 user nova-compute[71557]: No targets found.
Apr 12 10:41:35 user nova-compute[71557]: STATIC:
Apr 12 10:41:35 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:41:35 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:41:35 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:41:35 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93
Apr 12 10:41:35 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:41:35 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:41:35 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75
Apr 12 10:41:35 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:41:35 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:41:35 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666
Apr 12 10:41:35 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:41:35 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:41:35 user nova-compute[71557]: FIRMWARE:
Apr 12 10:41:35 user nova-compute[71557]: No targets found.
Apr 12 10:41:35 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:41:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:41:35 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:41:35 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-plugged-fb79e431-1d99-40eb-94a0-20032fa213fb {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-plugged-fb79e431-1d99-40eb-94a0-20032fa213fb {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:36 user nova-compute[71557]: WARNING nova.compute.manager [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received unexpected event network-vif-plugged-fb79e431-1d99-40eb-94a0-20032fa213fb for instance with vm_state active and task_state deleting.
Apr 12 10:41:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-unplugged-13923b13-db35-4b98-b2b0-e2e18fd8441e {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-unplugged-13923b13-db35-4b98-b2b0-e2e18fd8441e {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-unplugged-13923b13-db35-4b98-b2b0-e2e18fd8441e for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-plugged-13923b13-db35-4b98-b2b0-e2e18fd8441e {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-plugged-13923b13-db35-4b98-b2b0-e2e18fd8441e {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:36 user nova-compute[71557]: WARNING nova.compute.manager [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received unexpected event network-vif-plugged-13923b13-db35-4b98-b2b0-e2e18fd8441e for instance with vm_state active and task_state deleting.
Apr 12 10:41:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Received event network-vif-plugged-28905d4a-0e25-4d67-bab4-ee310dd9eea8 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Acquiring lock "7f834736-e836-49d3-b931-83ad82bef8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Lock "7f834736-e836-49d3-b931-83ad82bef8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Lock "7f834736-e836-49d3-b931-83ad82bef8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] No waiting events found dispatching network-vif-plugged-28905d4a-0e25-4d67-bab4-ee310dd9eea8 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:36 user nova-compute[71557]: WARNING nova.compute.manager [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Received unexpected event network-vif-plugged-28905d4a-0e25-4d67-bab4-ee310dd9eea8 for instance with vm_state building and task_state spawning.
Apr 12 10:41:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Received event network-vif-plugged-28905d4a-0e25-4d67-bab4-ee310dd9eea8 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Acquiring lock "7f834736-e836-49d3-b931-83ad82bef8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Lock "7f834736-e836-49d3-b931-83ad82bef8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] Lock "7f834736-e836-49d3-b931-83ad82bef8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] No waiting events found dispatching network-vif-plugged-28905d4a-0e25-4d67-bab4-ee310dd9eea8 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:36 user nova-compute[71557]: WARNING nova.compute.manager [req-97def05a-8c48-426e-a173-449b5d90d7fb req-01aab6db-f2d6-41be-8de5-d8f50a19ff50 service nova] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Received unexpected event network-vif-plugged-28905d4a-0e25-4d67-bab4-ee310dd9eea8 for instance with vm_state building and task_state spawning.
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f42d8ca-eaa4-4fec-9cc7-02f3717832e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdf1969-bc29-40f0-afaa-ccd1b0692302]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:41:36 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:41:36 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:41:36 user nova-compute[71557]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)
Apr 12 10:41:36 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:41:36 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:41:36 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:41:36 user nova-compute[71557]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 (non-flash)
Apr 12 10:41:36 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fe1121090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75'): ({'sdf'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Removing single pathed devices sdf {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88a6421-9f28-4524-87fa-64ef02359b7b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[be34d533-c53f-4ed1-b788-6f1d6cb66343]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Flushing IO for device /dev/sdf {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37e3a21-322e-4827-b708-dc3bbb2be72d]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c837f97d-173f-466e-ada7-27d0290c5306]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] SCSI volumes sdf have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[398285da-0d6d-4e9d-8da0-b42382720d2d]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:36 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Instance destroyed successfully.
Apr 12 10:41:36 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lazy-loading 'resources' on Instance uuid d04cb526-f77a-457c-90b1-3e5c202c0c30 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.113s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d12d5c0-ccc8-45e2-9d94-36defc86bdc8]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75, portal: 172.16.0.220,3260]
Apr 12 10:41:36 user nova-compute[71557]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75, portal: 172.16.0.220,3260] successful.
Apr 12 10:41:36 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1739620818',display_name='tempest-VolumesAdminNegativeTest-server-1739620818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1739620818',id=7,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMgsXxSbNHsheROx1BN0FtpB7qh5cv6vGRZHqITyCcIMFeCSyHdp/zIeAbEJot43g3Qpc0b2rVShkKAnaPuRxIo8TB/FzjRPcSXAtyG2n+PHfMt7nLlc2G1KtiPlyKvOQ==',key_name='tempest-keypair-1653078636',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:36:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cdb8217b1544db384bebe1059848bb6',ramdisk_id='',reservation_id='r-0z68g5tv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-375460860',owner_user_name='tempest-VolumesAdminNegativeTest-375460860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0a2243c6c9f431da846cc54ec181fcc',uuid=d04cb526-f77a-457c-90b1-3e5c202c0c30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6cd169f-f736-45da-96ea-c0b933c882a0", "address": "fa:16:3e:ab:9d:90", "network": {"id": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-80273954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdb8217b1544db384bebe1059848bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6cd169f-f7", "ovs_interfaceid": "d6cd169f-f736-45da-96ea-c0b933c882a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Converting VIF {"id": "d6cd169f-f736-45da-96ea-c0b933c882a0", "address": "fa:16:3e:ab:9d:90", "network": {"id": "66f6d7b6-8980-47a3-a7b6-f62db8264cd0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-80273954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdb8217b1544db384bebe1059848bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6cd169f-f7", "ovs_interfaceid": "d6cd169f-f736-45da-96ea-c0b933c882a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=d6cd169f-f736-45da-96ea-c0b933c882a0,network=Network(66f6d7b6-8980-47a3-a7b6-f62db8264cd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6cd169f-f7') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG os_vif [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=d6cd169f-f736-45da-96ea-c0b933c882a0,network=Network(66f6d7b6-8980-47a3-a7b6-f62db8264cd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6cd169f-f7') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6cd169f-f7, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:41:36 user nova-compute[71557]: INFO os_vif [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=d6cd169f-f736-45da-96ea-c0b933c882a0,network=Network(66f6d7b6-8980-47a3-a7b6-f62db8264cd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6cd169f-f7')
Apr 12 10:41:36 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Deleting instance files /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30_del
Apr 12 10:41:36 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Deletion of /opt/stack/data/nova/instances/d04cb526-f77a-457c-90b1-3e5c202c0c30_del complete
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df938975-a760-4947-97c7-9d557f068c75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7726fe19-60a9-4381-958d-f1dbfeacee66]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.433s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] <== disconnect_volume: return (434ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:41:36 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Deleting instance files /opt/stack/data/nova/instances/6b152adb-ca3d-45cf-a394-5ba5b36180a8_del
Apr 12 10:41:36 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Deletion of /opt/stack/data/nova/instances/6b152adb-ca3d-45cf-a394-5ba5b36180a8_del complete
Apr 12 10:41:36 user nova-compute[71557]: INFO nova.compute.manager [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:41:36 user nova-compute[71557]: INFO nova.compute.manager [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Took 4.21 seconds to destroy the instance on the hypervisor.
Apr 12 10:41:36 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:41:36 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.compute.manager [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-plugged-3c8cf480-05d6-463a-a97e-a9d869ac3860 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.compute.manager [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] No waiting events found dispatching network-vif-plugged-3c8cf480-05d6-463a-a97e-a9d869ac3860 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:37 user nova-compute[71557]: WARNING nova.compute.manager [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received unexpected event network-vif-plugged-3c8cf480-05d6-463a-a97e-a9d869ac3860 for instance with vm_state active and task_state deleting.
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.compute.manager [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Received event network-vif-unplugged-d6cd169f-f736-45da-96ea-c0b933c882a0 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] Acquiring lock "d04cb526-f77a-457c-90b1-3e5c202c0c30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] Lock "d04cb526-f77a-457c-90b1-3e5c202c0c30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] Lock "d04cb526-f77a-457c-90b1-3e5c202c0c30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.compute.manager [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] No waiting events found dispatching network-vif-unplugged-d6cd169f-f736-45da-96ea-c0b933c882a0 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.compute.manager [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Received event network-vif-unplugged-d6cd169f-f736-45da-96ea-c0b933c882a0 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.compute.manager [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Received event network-vif-plugged-d6cd169f-f736-45da-96ea-c0b933c882a0 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] Acquiring lock "d04cb526-f77a-457c-90b1-3e5c202c0c30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] Lock "d04cb526-f77a-457c-90b1-3e5c202c0c30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] Lock "d04cb526-f77a-457c-90b1-3e5c202c0c30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.compute.manager [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] No waiting events found dispatching network-vif-plugged-d6cd169f-f736-45da-96ea-c0b933c882a0 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:37 user nova-compute[71557]: WARNING nova.compute.manager [req-6007b432-3445-43ab-b72e-5c0af6ad3dbd req-3834f1e1-deda-4d5f-bdf3-62a9f1386768 service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Received unexpected event network-vif-plugged-d6cd169f-f736-45da-96ea-c0b933c882a0 for instance with vm_state active and task_state deleting.
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:41:37 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Took 0.81 seconds to deallocate network for instance.
Apr 12 10:41:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:37 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Deleted allocations for instance d04cb526-f77a-457c-90b1-3e5c202c0c30
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296097.876597, 7f834736-e836-49d3-b931-83ad82bef8f3 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:41:37 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] VM Resumed (Lifecycle Event)
Apr 12 10:41:37 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Instance spawned successfully.
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a910d2cd-2c74-48ff-9b51-1088adcd9661 tempest-VolumesAdminNegativeTest-375460860 tempest-VolumesAdminNegativeTest-375460860-project-member] Lock "d04cb526-f77a-457c-90b1-3e5c202c0c30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.424s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:37 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296097.8769798, 7f834736-e836-49d3-b931-83ad82bef8f3 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:41:37 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] VM Started (Lifecycle Event)
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:41:37 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:41:38 user nova-compute[71557]: INFO nova.compute.manager [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Took 8.03 seconds to spawn the instance on the hypervisor.
Apr 12 10:41:38 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:41:38 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:41:38 user nova-compute[71557]: DEBUG nova.compute.manager [req-9a5c98b7-4f35-477f-81db-0ece2745d69d req-05e91a66-7b4d-424a-be81-c8b45b3d79f3 service nova] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Received event network-vif-deleted-d6cd169f-f736-45da-96ea-c0b933c882a0 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:38 user nova-compute[71557]: INFO nova.compute.manager [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Took 9.03 seconds to build instance.
Apr 12 10:41:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f4cf2d7a-e368-475d-815a-5e4cf40ef638 tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "7f834736-e836-49d3-b931-83ad82bef8f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.219s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-1bf44835-8b23-4b66-b58f-0b45a747a149 req-3191624a-41f4-42d7-ba32-6776dfc92bc7 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-deleted-daf1aa56-7b24-4f41-93fd-a54cdf96428f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:39 user nova-compute[71557]: INFO nova.compute.manager [req-1bf44835-8b23-4b66-b58f-0b45a747a149 req-3191624a-41f4-42d7-ba32-6776dfc92bc7 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Neutron deleted interface daf1aa56-7b24-4f41-93fd-a54cdf96428f; detaching it from the instance and deleting it from the info cache
Apr 12 10:41:39 user nova-compute[71557]: DEBUG nova.network.neutron [req-1bf44835-8b23-4b66-b58f-0b45a747a149 req-3191624a-41f4-42d7-ba32-6776dfc92bc7 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Updating instance_info_cache with network_info: [{"id": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "address": "fa:16:3e:15:59:c8", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbdccd3-ba", "ovs_interfaceid": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "address": "fa:16:3e:20:f6:ea", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e56f7-00", "ovs_interfaceid": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb79e431-1d99-40eb-94a0-20032fa213fb", "address": "fa:16:3e:fe:d3:c6", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb79e431-1d", "ovs_interfaceid": "fb79e431-1d99-40eb-94a0-20032fa213fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "address": "fa:16:3e:fe:8f:eb", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825c6036-d1", "ovs_interfaceid": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "address": "fa:16:3e:59:ab:3b", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13923b13-db", "ovs_interfaceid": "13923b13-db35-4b98-b2b0-e2e18fd8441e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "address": "fa:16:3e:9d:7d:33", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8cf480-05", "ovs_interfaceid": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:41:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-1bf44835-8b23-4b66-b58f-0b45a747a149 req-3191624a-41f4-42d7-ba32-6776dfc92bc7 service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Detach interface failed, port_id=daf1aa56-7b24-4f41-93fd-a54cdf96428f, reason: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. {{(pid=71557) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "68b29390-867e-4bf3-bc93-b401f32b130e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "68b29390-867e-4bf3-bc93-b401f32b130e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_power_states {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:41:40 user nova-compute[71557]: WARNING nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] While synchronizing instance power states, found 8 instances in the database and 7 instances on the hypervisor.
Apr 12 10:41:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid 0f55cab4-8530-4be0-a91d-65671f0dccd9 {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid f47d368e-3870-49d0-8522-a94991ec4ba5 {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid dc6eb5d4-d415-4459-a95b-5a470ec66586 {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid aec86031-be71-4a8f-a8ad-cf04c506fdb4 {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid 7f834736-e836-49d3-b931-83ad82bef8f3 {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid 6b152adb-ca3d-45cf-a394-5ba5b36180a8 {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "0f55cab4-8530-4be0-a91d-65671f0dccd9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "0f55cab4-8530-4be0-a91d-65671f0dccd9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "f47d368e-3870-49d0-8522-a94991ec4ba5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "dc6eb5d4-d415-4459-a95b-5a470ec66586" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "dc6eb5d4-d415-4459-a95b-5a470ec66586" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "7f834736-e836-49d3-b931-83ad82bef8f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "7f834736-e836-49d3-b931-83ad82bef8f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:41:40 user nova-compute[71557]: INFO nova.compute.claims [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Claim successful on node user
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "dc6eb5d4-d415-4459-a95b-5a470ec66586" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "0f55cab4-8530-4be0-a91d-65671f0dccd9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "7f834736-e836-49d3-b931-83ad82bef8f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG nova.network.neutron [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:41:41 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:41:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG nova.policy [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '574af27cae41457c9be3d5d50d347b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ef7aa45de34b01a97b6bc5e0acece5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:41:41 user nova-compute[71557]: INFO nova.virt.block_device [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Booting with volume e6850f05-a7ca-4a81-ad02-a1e4d506702b at /dev/vda
Apr 12 10:41:41 user nova-compute[71557]: DEBUG os_brick.utils [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-74f030db-0919-4bd1-b305-9a0a2cbb9e99 req-443159e4-9d19-462e-8b38-540aa4e22dca service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-deleted-13923b13-db35-4b98-b2b0-e2e18fd8441e {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:41 user nova-compute[71557]: INFO nova.compute.manager [req-74f030db-0919-4bd1-b305-9a0a2cbb9e99 req-443159e4-9d19-462e-8b38-540aa4e22dca service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Neutron deleted interface 13923b13-db35-4b98-b2b0-e2e18fd8441e; detaching it from the instance and deleting it from the info cache
Apr 12 10:41:41 user nova-compute[71557]: DEBUG nova.network.neutron [req-74f030db-0919-4bd1-b305-9a0a2cbb9e99 req-443159e4-9d19-462e-8b38-540aa4e22dca service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Updating instance_info_cache with network_info: [{"id": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "address": "fa:16:3e:15:59:c8", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbdccd3-ba", "ovs_interfaceid": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "address": "fa:16:3e:20:f6:ea", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e56f7-00", "ovs_interfaceid": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb79e431-1d99-40eb-94a0-20032fa213fb", "address": "fa:16:3e:fe:d3:c6", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb79e431-1d", "ovs_interfaceid": "fb79e431-1d99-40eb-94a0-20032fa213fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "address": "fa:16:3e:fe:8f:eb", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825c6036-d1", "ovs_interfaceid": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "address": "fa:16:3e:9d:7d:33", "network": {"id": "91288215-145e-4cd6-953e-edb9f28d5c84", "bridge": "br-int", "label": "tempest-device-tagging-net2-1016764621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8cf480-05", "ovs_interfaceid": "3c8cf480-05d6-463a-a97e-a9d869ac3860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a492ff2-1f8c-48a2-bda6-bbf43cf96488]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-74f030db-0919-4bd1-b305-9a0a2cbb9e99 req-443159e4-9d19-462e-8b38-540aa4e22dca service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Detach interface failed, port_id=13923b13-db35-4b98-b2b0-e2e18fd8441e, reason: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. {{(pid=71557) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-74f030db-0919-4bd1-b305-9a0a2cbb9e99 req-443159e4-9d19-462e-8b38-540aa4e22dca service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-deleted-3c8cf480-05d6-463a-a97e-a9d869ac3860 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:41 user nova-compute[71557]: INFO nova.compute.manager [req-74f030db-0919-4bd1-b305-9a0a2cbb9e99 req-443159e4-9d19-462e-8b38-540aa4e22dca service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Neutron deleted interface 3c8cf480-05d6-463a-a97e-a9d869ac3860; detaching it from the instance and deleting it from the info cache
Apr 12 10:41:41 user nova-compute[71557]: DEBUG nova.network.neutron [req-74f030db-0919-4bd1-b305-9a0a2cbb9e99 req-443159e4-9d19-462e-8b38-540aa4e22dca service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Updating instance_info_cache with network_info: [{"id": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "address": "fa:16:3e:15:59:c8", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbdccd3-ba", "ovs_interfaceid": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "address": "fa:16:3e:20:f6:ea", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e56f7-00", "ovs_interfaceid": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb79e431-1d99-40eb-94a0-20032fa213fb", "address": "fa:16:3e:fe:d3:c6", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb79e431-1d", "ovs_interfaceid": "fb79e431-1d99-40eb-94a0-20032fa213fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "address": "fa:16:3e:fe:8f:eb", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825c6036-d1", "ovs_interfaceid": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd075e0-7179-4c1b-b342-8749d7e4c09f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-74f030db-0919-4bd1-b305-9a0a2cbb9e99 req-443159e4-9d19-462e-8b38-540aa4e22dca service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Detach interface failed, port_id=3c8cf480-05d6-463a-a97e-a9d869ac3860, reason: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. {{(pid=71557) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-74f030db-0919-4bd1-b305-9a0a2cbb9e99 req-443159e4-9d19-462e-8b38-540aa4e22dca service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-deleted-fb79e431-1d99-40eb-94a0-20032fa213fb {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:41 user nova-compute[71557]: INFO nova.compute.manager [req-74f030db-0919-4bd1-b305-9a0a2cbb9e99 req-443159e4-9d19-462e-8b38-540aa4e22dca service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Neutron deleted interface fb79e431-1d99-40eb-94a0-20032fa213fb; detaching it from the instance and deleting it from the info cache
Apr 12 10:41:41 user nova-compute[71557]: DEBUG nova.network.neutron [req-74f030db-0919-4bd1-b305-9a0a2cbb9e99 req-443159e4-9d19-462e-8b38-540aa4e22dca service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Updating instance_info_cache with network_info: [{"id": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "address": "fa:16:3e:15:59:c8", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbdccd3-ba", "ovs_interfaceid": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "address": "fa:16:3e:20:f6:ea", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e56f7-00", "ovs_interfaceid": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "address": "fa:16:3e:fe:8f:eb", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825c6036-d1", "ovs_interfaceid": "825c6036-d16c-43ab-9f6a-2bb133bf51b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03a63c3-4660-4f13-922c-8d03d4b09456]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:41 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Took 4.83 seconds to deallocate network for instance.
Apr 12 10:41:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff3fd97-a3d3-4da1-9f66-a9fe2179546f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:41:41 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:41:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fa60db-52c4-4161-a4a3-244757d3ec2c]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-74f030db-0919-4bd1-b305-9a0a2cbb9e99 req-443159e4-9d19-462e-8b38-540aa4e22dca service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Detach interface failed, port_id=fb79e431-1d99-40eb-94a0-20032fa213fb, reason: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. {{(pid=71557) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG os_brick.utils [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] <== get_connector_properties: return (201ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Updating existing volume attachment record: 1378f552-8aab-4cd4-b388-42762375b159 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:41:41 user nova-compute[71557]: DEBUG nova.network.neutron [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Successfully created port: 78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:41:42 user nova-compute[71557]: DEBUG nova.network.neutron [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Successfully updated port: 78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:41:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:41:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquired lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:41:42 user nova-compute[71557]: DEBUG nova.network.neutron [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:41:42 user nova-compute[71557]: DEBUG nova.compute.manager [req-0a794ae9-90d7-4d62-a079-98af9245f78d req-2076f12c-0020-4da4-abec-d03bb795a5fc service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Received event network-changed-78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:42 user nova-compute[71557]: DEBUG nova.compute.manager [req-0a794ae9-90d7-4d62-a079-98af9245f78d req-2076f12c-0020-4da4-abec-d03bb795a5fc service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Refreshing instance network info cache due to event network-changed-78a8426a-653a-44cb-80b7-8a8b14d78cf4. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:41:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0a794ae9-90d7-4d62-a079-98af9245f78d req-2076f12c-0020-4da4-abec-d03bb795a5fc service nova] Acquiring lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:41:42 user nova-compute[71557]: DEBUG nova.network.neutron [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:41:43 user nova-compute[71557]: DEBUG nova.network.neutron [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Updating instance_info_cache with network_info: [{"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:41:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Releasing lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:41:43 user nova-compute[71557]: DEBUG nova.compute.manager [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Instance network_info: |[{"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:41:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0a794ae9-90d7-4d62-a079-98af9245f78d req-2076f12c-0020-4da4-abec-d03bb795a5fc service nova] Acquired lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:41:43 user nova-compute[71557]: DEBUG nova.network.neutron [req-0a794ae9-90d7-4d62-a079-98af9245f78d req-2076f12c-0020-4da4-abec-d03bb795a5fc service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Refreshing network info cache for port 78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:41:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-64be0430-5155-4481-ab2f-ae0723255347 req-16c242b9-53d9-4aeb-9b87-924887081e9f service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Received event network-vif-deleted-825c6036-d16c-43ab-9f6a-2bb133bf51b8 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:43 user nova-compute[71557]: INFO nova.compute.manager [req-64be0430-5155-4481-ab2f-ae0723255347 req-16c242b9-53d9-4aeb-9b87-924887081e9f service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Neutron deleted interface 825c6036-d16c-43ab-9f6a-2bb133bf51b8; detaching it from the instance and deleting it from the info cache
Apr 12 10:41:43 user nova-compute[71557]: DEBUG nova.network.neutron [req-64be0430-5155-4481-ab2f-ae0723255347 req-16c242b9-53d9-4aeb-9b87-924887081e9f service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Updating instance_info_cache with network_info: [{"id": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "address": "fa:16:3e:15:59:c8", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbbdccd3-ba", "ovs_interfaceid": "bbbdccd3-ba1c-46e2-90b5-10d6036f72c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "address": "fa:16:3e:20:f6:ea", "network": {"id": "26d4148b-d50a-44e3-8b4b-5673f0395785", "bridge": "br-int", "label": "tempest-device-tagging-net1-296749680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f1ec9852adb94a5086dc3ef48871d5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16e56f7-00", "ovs_interfaceid": "e16e56f7-00ab-422d-95b3-d1b204f693a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:41:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-64be0430-5155-4481-ab2f-ae0723255347 req-16c242b9-53d9-4aeb-9b87-924887081e9f service nova] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Detach interface failed, port_id=825c6036-d16c-43ab-9f6a-2bb133bf51b8, reason: Instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8 could not be found. {{(pid=71557) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 10:41:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:43 user nova-compute[71557]: DEBUG nova.network.neutron [req-0a794ae9-90d7-4d62-a079-98af9245f78d req-2076f12c-0020-4da4-abec-d03bb795a5fc service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Updated VIF entry in instance network info cache for port 78a8426a-653a-44cb-80b7-8a8b14d78cf4. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:41:43 user nova-compute[71557]: DEBUG nova.network.neutron [req-0a794ae9-90d7-4d62-a079-98af9245f78d req-2076f12c-0020-4da4-abec-d03bb795a5fc service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Updating instance_info_cache with network_info: [{"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:41:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0a794ae9-90d7-4d62-a079-98af9245f78d req-2076f12c-0020-4da4-abec-d03bb795a5fc service nova] Releasing lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:41:44 user nova-compute[71557]: INFO nova.compute.manager [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Took 2.68 seconds to detach 3 volumes for instance.
Apr 12 10:41:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:44 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:41:44 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:41:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:44 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Deleted allocations for instance 6b152adb-ca3d-45cf-a394-5ba5b36180a8
Apr 12 10:41:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d35d0814-62e5-4fe6-84d6-d4ed90bba983 tempest-TaggedBootDevicesTest-1574485217 tempest-TaggedBootDevicesTest-1574485217-project-member] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.254s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.077s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:44 user nova-compute[71557]: INFO nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] During sync_power_state the instance has a pending task (deleting). Skip.
Apr 12 10:41:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "6b152adb-ca3d-45cf-a394-5ba5b36180a8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:41:46 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Creating image(s)
Apr 12 10:41:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Did not create local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Ensure instance console log exists: /opt/stack/data/nova/instances/68b29390-867e-4bf3-bc93-b401f32b130e/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Start _get_guest_xml network_info=[{"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': '1378f552-8aab-4cd4-b388-42762375b159', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AuHwQTaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '68b29390-867e-4bf3-bc93-b401f32b130e', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6850f05-a7ca-4a81-ad02-a1e4d506702b', 'serial': 'e6850f05-a7ca-4a81-ad02-a1e4d506702b'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:41:46 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:41:46 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:41:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AuHwQTaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:41:46 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:41:46 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:41:46 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be0fcc1-4556-49cd-beb4-d98595c3a63d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:41:46 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3428c556-96f8-4827-a603-6a161554fa2c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b] added
Apr 12 10:41:46 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd0d0dc-3e36-4346-be72-e81069a7a9ac]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2508a7c9-9e65-4a8c-875a-8527c9fcf5e8]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AuHwQTaV {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AuHwQTaV" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdab89c-902e-4269-9d68-dda6fe3f0821]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AuHwQTaV'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[440e25e4-539c-424f-b3de-5ba1e4ab6825]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "f47d368e-3870-49d0-8522-a94991ec4ba5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[55201311-9c69-43e8-a0e5-60cf87b04270]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:41:46 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:41:46 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:41:46 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:41:46 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:41:46 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:41:46 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:41:46 user nova-compute[71557]: INFO nova.compute.manager [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Detaching volume afb7485e-496d-4fb9-a5b1-613d21171666
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7411d9a2-f2ed-41c3-9679-9c89800456f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b, portal: 172.16.0.220,3260]
Apr 12 10:41:46 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b, portal: 172.16.0.220,3260] successful.
Apr 12 10:41:46 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:41:46 user nova-compute[71557]: INFO nova.virt.block_device [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Attempting to driver detach volume afb7485e-496d-4fb9-a5b1-613d21171666 from mountpoint /dev/vdb
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Attempting to detach device vdb from instance f47d368e-3870-49d0-8522-a94991ec4ba5 from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:41:46 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:41:46 user nova-compute[71557]:   <source dev="/dev/sdc"/>
Apr 12 10:41:46 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:41:46 user nova-compute[71557]:   <serial>afb7485e-496d-4fb9-a5b1-613d21171666</serial>
Apr 12 10:41:46 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:41:46 user nova-compute[71557]: </disk>
Apr 12 10:41:46 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa48b1d9-b1d4-407a-8172-1aabbbfc5f4e]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:46 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Successfully detached device vdb from instance f47d368e-3870-49d0-8522-a94991ec4ba5 from the persistent domain config.
Apr 12 10:41:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f47d368e-3870-49d0-8522-a94991ec4ba5 from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:41:46 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:41:46 user nova-compute[71557]:   <source dev="/dev/sdc"/>
Apr 12 10:41:46 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:41:46 user nova-compute[71557]:   <serial>afb7485e-496d-4fb9-a5b1-613d21171666</serial>
Apr 12 10:41:46 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:41:46 user nova-compute[71557]: </disk>
Apr 12 10:41:46 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1503416-e34a-4f71-b8d4-d40676bb19e4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:41:46 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:41:46 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:41:46 user nova-compute[71557]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:41:46 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:41:46 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:41:46 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:41:46 user nova-compute[71557]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:41:46 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[74aa5f60-8b62-4373-b805-e6d7beb948c1]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:41:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AuHwQTaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681296107.0165076, f47d368e-3870-49d0-8522-a94991ec4ba5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f47d368e-3870-49d0-8522-a94991ec4ba5 {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 10:41:47 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Successfully detached device vdb from instance f47d368e-3870-49d0-8522-a94991ec4ba5 from the live domain config.
Apr 12 10:41:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IliQbaxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:41:47 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23763313534396162', 'path': '/dev/sde'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763313534396162', 'path': '/dev/sde'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.529s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:41:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1222922378',display_name='tempest-TestShelveInstance-server-1222922378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1222922378',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOk2UPAom5CjZdHfplY6HjUNzNcB4NEAH+k/X71Ve1S4CsmjYhLiu/vz+zIBK/KpJ2uQiNOTfsgNS8zhPMGpKrvMmQM5PVNKr7l+PqrgS24giNXUhI2aB8tdrnYrhcS2EQ==',key_name='tempest-TestShelveInstance-577615131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90ef7aa45de34b01a97b6bc5e0acece5',ramdisk_id='',reservation_id='r-yukf9uzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1176962424',owner_user_name='tempest-TestShelveInstance-1176962424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:41:41Z,user_data=None,user_id='574af27cae41457c9be3d5d50d347b27',uuid=68b29390-867e-4bf3-bc93-b401f32b130e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Converting VIF {"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d2:fe,bridge_name='br-int',has_traffic_filtering=True,id=78a8426a-653a-44cb-80b7-8a8b14d78cf4,network=Network(f87563f2-62e3-4d56-b03a-0a830493f69b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a8426a-65') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG nova.objects.instance [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lazy-loading 'pci_devices' on Instance uuid 68b29390-867e-4bf3-bc93-b401f32b130e {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0fe22a-aff4-4975-9ab2-9e49c7bff80f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:41:47 user nova-compute[71557]: No targets found.
Apr 12 10:41:47 user nova-compute[71557]: iSNS:
Apr 12 10:41:47 user nova-compute[71557]: No targets found.
Apr 12 10:41:47 user nova-compute[71557]: STATIC:
Apr 12 10:41:47 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:41:47 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:41:47 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:41:47 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b
Apr 12 10:41:47 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:41:47 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:41:47 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93
Apr 12 10:41:47 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:41:47 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:41:47 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666
Apr 12 10:41:47 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:41:47 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:41:47 user nova-compute[71557]: FIRMWARE:
Apr 12 10:41:47 user nova-compute[71557]: No targets found.
Apr 12 10:41:47 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:41:47 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:41:47 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:41:47 user nova-compute[71557]:   <uuid>68b29390-867e-4bf3-bc93-b401f32b130e</uuid>
Apr 12 10:41:47 user nova-compute[71557]:   <name>instance-00000014</name>
Apr 12 10:41:47 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:41:47 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:41:47 user nova-compute[71557]:   <metadata>
Apr 12 10:41:47 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:41:47 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:41:47 user nova-compute[71557]:       <nova:name>tempest-TestShelveInstance-server-1222922378</nova:name>
Apr 12 10:41:47 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:41:46</nova:creationTime>
Apr 12 10:41:47 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:41:47 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:41:47 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:41:47 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:41:47 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:41:47 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:41:47 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:41:47 user nova-compute[71557]:       <nova:owner>
Apr 12 10:41:47 user nova-compute[71557]:         <nova:user uuid="574af27cae41457c9be3d5d50d347b27">tempest-TestShelveInstance-1176962424-project-member</nova:user>
Apr 12 10:41:47 user nova-compute[71557]:         <nova:project uuid="90ef7aa45de34b01a97b6bc5e0acece5">tempest-TestShelveInstance-1176962424</nova:project>
Apr 12 10:41:47 user nova-compute[71557]:       </nova:owner>
Apr 12 10:41:47 user nova-compute[71557]:       <nova:ports>
Apr 12 10:41:47 user nova-compute[71557]:         <nova:port uuid="78a8426a-653a-44cb-80b7-8a8b14d78cf4">
Apr 12 10:41:47 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 10:41:47 user nova-compute[71557]:         </nova:port>
Apr 12 10:41:47 user nova-compute[71557]:       </nova:ports>
Apr 12 10:41:47 user nova-compute[71557]:     </nova:instance>
Apr 12 10:41:47 user nova-compute[71557]:   </metadata>
Apr 12 10:41:47 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:41:47 user nova-compute[71557]:     <system>
Apr 12 10:41:47 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:41:47 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:41:47 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:41:47 user nova-compute[71557]:       <entry name="serial">68b29390-867e-4bf3-bc93-b401f32b130e</entry>
Apr 12 10:41:47 user nova-compute[71557]:       <entry name="uuid">68b29390-867e-4bf3-bc93-b401f32b130e</entry>
Apr 12 10:41:47 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:41:47 user nova-compute[71557]:     </system>
Apr 12 10:41:47 user nova-compute[71557]:   </sysinfo>
Apr 12 10:41:47 user nova-compute[71557]:   <os>
Apr 12 10:41:47 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:41:47 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:41:47 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:41:47 user nova-compute[71557]:   </os>
Apr 12 10:41:47 user nova-compute[71557]:   <features>
Apr 12 10:41:47 user nova-compute[71557]:     <acpi/>
Apr 12 10:41:47 user nova-compute[71557]:     <apic/>
Apr 12 10:41:47 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:41:47 user nova-compute[71557]:   </features>
Apr 12 10:41:47 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:41:47 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:41:47 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:41:47 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:41:47 user nova-compute[71557]:   </clock>
Apr 12 10:41:47 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:41:47 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:41:47 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:41:47 user nova-compute[71557]:   </cpu>
Apr 12 10:41:47 user nova-compute[71557]:   <devices>
Apr 12 10:41:47 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:41:47 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:41:47 user nova-compute[71557]:       <source dev="/dev/sde"/>
Apr 12 10:41:47 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:41:47 user nova-compute[71557]:       <serial>e6850f05-a7ca-4a81-ad02-a1e4d506702b</serial>
Apr 12 10:41:47 user nova-compute[71557]:     </disk>
Apr 12 10:41:47 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:41:47 user nova-compute[71557]:       <mac address="fa:16:3e:6a:d2:fe"/>
Apr 12 10:41:47 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:41:47 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:41:47 user nova-compute[71557]:       <target dev="tap78a8426a-65"/>
Apr 12 10:41:47 user nova-compute[71557]:     </interface>
Apr 12 10:41:47 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:41:47 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/68b29390-867e-4bf3-bc93-b401f32b130e/console.log" append="off"/>
Apr 12 10:41:47 user nova-compute[71557]:     </serial>
Apr 12 10:41:47 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:41:47 user nova-compute[71557]:     <video>
Apr 12 10:41:47 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:41:47 user nova-compute[71557]:     </video>
Apr 12 10:41:47 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:41:47 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:41:47 user nova-compute[71557]:     </rng>
Apr 12 10:41:47 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:41:47 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:41:47 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:41:47 user nova-compute[71557]:     </memballoon>
Apr 12 10:41:47 user nova-compute[71557]:   </devices>
Apr 12 10:41:47 user nova-compute[71557]: </domain>
Apr 12 10:41:47 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:41:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1222922378',display_name='tempest-TestShelveInstance-server-1222922378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1222922378',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOk2UPAom5CjZdHfplY6HjUNzNcB4NEAH+k/X71Ve1S4CsmjYhLiu/vz+zIBK/KpJ2uQiNOTfsgNS8zhPMGpKrvMmQM5PVNKr7l+PqrgS24giNXUhI2aB8tdrnYrhcS2EQ==',key_name='tempest-TestShelveInstance-577615131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90ef7aa45de34b01a97b6bc5e0acece5',ramdisk_id='',reservation_id='r-yukf9uzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1176962424',owner_user_name='tempest-TestShelveInstance-1176962424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:41:41Z,user_data=None,user_id='574af27cae41457c9be3d5d50d347b27',uuid=68b29390-867e-4bf3-bc93-b401f32b130e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Converting VIF {"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d2:fe,bridge_name='br-int',has_traffic_filtering=True,id=78a8426a-653a-44cb-80b7-8a8b14d78cf4,network=Network(f87563f2-62e3-4d56-b03a-0a830493f69b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a8426a-65') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_vif [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d2:fe,bridge_name='br-int',has_traffic_filtering=True,id=78a8426a-653a-44cb-80b7-8a8b14d78cf4,network=Network(f87563f2-62e3-4d56-b03a-0a830493f69b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a8426a-65') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79d1cab-5a88-4db9-81a1-20a4bcd2ca60]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78a8426a-65, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap78a8426a-65, col_values=(('external_ids', {'iface-id': '78a8426a-653a-44cb-80b7-8a8b14d78cf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:d2:fe', 'vm-uuid': '68b29390-867e-4bf3-bc93-b401f32b130e'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:47 user nova-compute[71557]: INFO os_vif [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d2:fe,bridge_name='br-int',has_traffic_filtering=True,id=78a8426a-653a-44cb-80b7-8a8b14d78cf4,network=Network(f87563f2-62e3-4d56-b03a-0a830493f69b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a8426a-65')
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[40586046-6413-44bf-b025-533af0528dd0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:41:47 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:41:47 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:41:47 user nova-compute[71557]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:41:47 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:41:47 user nova-compute[71557]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 (non-flash)
Apr 12 10:41:47 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:41:47 user nova-compute[71557]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:41:47 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd4247760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666'): ({'sdc'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Removing single pathed devices sdc {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb68abe6-7ae6-4eec-8521-889fd694556b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e429f0-6635-4627-931d-2eef9f239a45]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Flushing IO for device /dev/sdc {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] No VIF found with MAC fa:16:3e:6a:d2:fe, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[935d66c2-8036-402e-bc86-aa97ac87c7d7]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7ec076-d343-499c-9902-648b8c47a242]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] SCSI volumes sdc have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[095084d4-3a78-4a5d-bae2-b29889ec6871]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3a7a53-2954-48e1-bb65-f0574253fdda]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666, portal: 172.16.0.220,3260]
Apr 12 10:41:47 user nova-compute[71557]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666, portal: 172.16.0.220,3260] successful.
Apr 12 10:41:47 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb7485e-496d-4fb9-a5b1-613d21171666 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a21035-9e17-4b44-81a6-0790f3a8c26c]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] <== disconnect_volume: return (885ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:41:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:41:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:48 user nova-compute[71557]: DEBUG nova.objects.instance [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lazy-loading 'flavor' on Instance uuid f47d368e-3870-49d0-8522-a94991ec4ba5 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:41:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1a5ed46f-b8c4-4004-bdeb-b7bea3c72cd4 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.326s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:49 user nova-compute[71557]: DEBUG nova.compute.manager [req-c5381229-c07e-4187-b4e0-682c2d401f88 req-cc1675f0-5c24-4430-91b8-c8d5311e4310 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Received event network-vif-plugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c5381229-c07e-4187-b4e0-682c2d401f88 req-cc1675f0-5c24-4430-91b8-c8d5311e4310 service nova] Acquiring lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c5381229-c07e-4187-b4e0-682c2d401f88 req-cc1675f0-5c24-4430-91b8-c8d5311e4310 service nova] Lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c5381229-c07e-4187-b4e0-682c2d401f88 req-cc1675f0-5c24-4430-91b8-c8d5311e4310 service nova] Lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:49 user nova-compute[71557]: DEBUG nova.compute.manager [req-c5381229-c07e-4187-b4e0-682c2d401f88 req-cc1675f0-5c24-4430-91b8-c8d5311e4310 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] No waiting events found dispatching network-vif-plugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:49 user nova-compute[71557]: WARNING nova.compute.manager [req-c5381229-c07e-4187-b4e0-682c2d401f88 req-cc1675f0-5c24-4430-91b8-c8d5311e4310 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Received unexpected event network-vif-plugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 for instance with vm_state building and task_state spawning.
Apr 12 10:41:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:49 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296094.5242772, 6b152adb-ca3d-45cf-a394-5ba5b36180a8 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:41:49 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] VM Stopped (Lifecycle Event)
Apr 12 10:41:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f9e6a391-7377-4d78-bd48-81282ef7fff9 None None] [instance: 6b152adb-ca3d-45cf-a394-5ba5b36180a8] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:41:51 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296111.0627563, 68b29390-867e-4bf3-bc93-b401f32b130e => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:41:51 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] VM Resumed (Lifecycle Event)
Apr 12 10:41:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:41:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:41:51 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Instance spawned successfully.
Apr 12 10:41:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:41:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:41:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:41:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:41:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:41:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:41:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:41:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:41:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:41:51 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:41:51 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296111.0636656, 68b29390-867e-4bf3-bc93-b401f32b130e => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:41:51 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] VM Started (Lifecycle Event)
Apr 12 10:41:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:41:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:41:51 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:41:51 user nova-compute[71557]: INFO nova.compute.manager [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Took 5.05 seconds to spawn the instance on the hypervisor.
Apr 12 10:41:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:41:51 user nova-compute[71557]: DEBUG nova.compute.manager [req-26571ed8-2534-4a71-ba77-13b6328224c7 req-fec72ec3-a0ca-4691-85ec-fc29e4f2b608 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Received event network-vif-plugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:41:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-26571ed8-2534-4a71-ba77-13b6328224c7 req-fec72ec3-a0ca-4691-85ec-fc29e4f2b608 service nova] Acquiring lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:41:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-26571ed8-2534-4a71-ba77-13b6328224c7 req-fec72ec3-a0ca-4691-85ec-fc29e4f2b608 service nova] Lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:41:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-26571ed8-2534-4a71-ba77-13b6328224c7 req-fec72ec3-a0ca-4691-85ec-fc29e4f2b608 service nova] Lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:51 user nova-compute[71557]: DEBUG nova.compute.manager [req-26571ed8-2534-4a71-ba77-13b6328224c7 req-fec72ec3-a0ca-4691-85ec-fc29e4f2b608 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] No waiting events found dispatching network-vif-plugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:41:51 user nova-compute[71557]: WARNING nova.compute.manager [req-26571ed8-2534-4a71-ba77-13b6328224c7 req-fec72ec3-a0ca-4691-85ec-fc29e4f2b608 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Received unexpected event network-vif-plugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 for instance with vm_state building and task_state spawning.
Apr 12 10:41:51 user nova-compute[71557]: INFO nova.compute.manager [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Took 10.78 seconds to build instance.
Apr 12 10:41:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-76622687-72a6-4085-948a-06da261095d3 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "68b29390-867e-4bf3-bc93-b401f32b130e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.923s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:41:51 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296096.3403852, d04cb526-f77a-457c-90b1-3e5c202c0c30 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:41:51 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] VM Stopped (Lifecycle Event)
Apr 12 10:41:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2d6e9217-e616-48c1-b79b-09b49c75364b None None] [instance: d04cb526-f77a-457c-90b1-3e5c202c0c30] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:41:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:41:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:05 user nova-compute[71557]: INFO nova.compute.manager [None req-ad504e38-508a-4e77-bb04-32f947a20d2b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Unrescuing
Apr 12 10:42:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ad504e38-508a-4e77-bb04-32f947a20d2b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "refresh_cache-8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:42:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ad504e38-508a-4e77-bb04-32f947a20d2b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquired lock "refresh_cache-8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:42:05 user nova-compute[71557]: DEBUG nova.network.neutron [None req-ad504e38-508a-4e77-bb04-32f947a20d2b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:42:05 user nova-compute[71557]: DEBUG nova.network.neutron [None req-ad504e38-508a-4e77-bb04-32f947a20d2b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Updating instance_info_cache with network_info: [{"id": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "address": "fa:16:3e:e8:3f:f9", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e23fbbf-0b", "ovs_interfaceid": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:42:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ad504e38-508a-4e77-bb04-32f947a20d2b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Releasing lock "refresh_cache-8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:42:05 user nova-compute[71557]: DEBUG nova.objects.instance [None req-ad504e38-508a-4e77-bb04-32f947a20d2b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'flavor' on Instance uuid 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:42:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:05 user nova-compute[71557]: DEBUG nova.compute.manager [req-0647716e-1462-4783-a6c6-ac3fb8938f92 req-a7846b4b-5152-46ce-9b0c-a7782526c7ec service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received event network-vif-unplugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:42:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0647716e-1462-4783-a6c6-ac3fb8938f92 req-a7846b4b-5152-46ce-9b0c-a7782526c7ec service nova] Acquiring lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0647716e-1462-4783-a6c6-ac3fb8938f92 req-a7846b4b-5152-46ce-9b0c-a7782526c7ec service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0647716e-1462-4783-a6c6-ac3fb8938f92 req-a7846b4b-5152-46ce-9b0c-a7782526c7ec service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:05 user nova-compute[71557]: DEBUG nova.compute.manager [req-0647716e-1462-4783-a6c6-ac3fb8938f92 req-a7846b4b-5152-46ce-9b0c-a7782526c7ec service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] No waiting events found dispatching network-vif-unplugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:42:05 user nova-compute[71557]: WARNING nova.compute.manager [req-0647716e-1462-4783-a6c6-ac3fb8938f92 req-a7846b4b-5152-46ce-9b0c-a7782526c7ec service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received unexpected event network-vif-unplugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance with vm_state rescued and task_state unrescuing.
Apr 12 10:42:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:06 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Instance destroyed successfully.
Apr 12 10:42:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:07 user nova-compute[71557]: DEBUG nova.compute.manager [req-52cbc5e5-8c12-458f-a556-5dcab660be42 req-6cb4cb5b-fd7e-417c-9f2b-3b03875de8c2 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received event network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:42:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-52cbc5e5-8c12-458f-a556-5dcab660be42 req-6cb4cb5b-fd7e-417c-9f2b-3b03875de8c2 service nova] Acquiring lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-52cbc5e5-8c12-458f-a556-5dcab660be42 req-6cb4cb5b-fd7e-417c-9f2b-3b03875de8c2 service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-52cbc5e5-8c12-458f-a556-5dcab660be42 req-6cb4cb5b-fd7e-417c-9f2b-3b03875de8c2 service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:07 user nova-compute[71557]: DEBUG nova.compute.manager [req-52cbc5e5-8c12-458f-a556-5dcab660be42 req-6cb4cb5b-fd7e-417c-9f2b-3b03875de8c2 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] No waiting events found dispatching network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:42:07 user nova-compute[71557]: WARNING nova.compute.manager [req-52cbc5e5-8c12-458f-a556-5dcab660be42 req-6cb4cb5b-fd7e-417c-9f2b-3b03875de8c2 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received unexpected event network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance with vm_state rescued and task_state unrescuing.
Apr 12 10:42:07 user nova-compute[71557]: DEBUG nova.compute.manager [req-52cbc5e5-8c12-458f-a556-5dcab660be42 req-6cb4cb5b-fd7e-417c-9f2b-3b03875de8c2 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received event network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:42:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-52cbc5e5-8c12-458f-a556-5dcab660be42 req-6cb4cb5b-fd7e-417c-9f2b-3b03875de8c2 service nova] Acquiring lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-52cbc5e5-8c12-458f-a556-5dcab660be42 req-6cb4cb5b-fd7e-417c-9f2b-3b03875de8c2 service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-52cbc5e5-8c12-458f-a556-5dcab660be42 req-6cb4cb5b-fd7e-417c-9f2b-3b03875de8c2 service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:07 user nova-compute[71557]: DEBUG nova.compute.manager [req-52cbc5e5-8c12-458f-a556-5dcab660be42 req-6cb4cb5b-fd7e-417c-9f2b-3b03875de8c2 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] No waiting events found dispatching network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:42:07 user nova-compute[71557]: WARNING nova.compute.manager [req-52cbc5e5-8c12-458f-a556-5dcab660be42 req-6cb4cb5b-fd7e-417c-9f2b-3b03875de8c2 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received unexpected event network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance with vm_state rescued and task_state unrescuing.
Apr 12 10:42:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:09 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Removed pending event for 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 due to event {{(pid=71557) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 10:42:09 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296129.7192352, 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:42:09 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] VM Resumed (Lifecycle Event)
Apr 12 10:42:09 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ad504e38-508a-4e77-bb04-32f947a20d2b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:42:09 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:42:09 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:42:09 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 10:42:09 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296129.7201412, 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:42:09 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] VM Started (Lifecycle Event)
Apr 12 10:42:09 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:42:09 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:42:09 user nova-compute[71557]: DEBUG nova.compute.manager [req-e5308045-8750-4f49-b232-9a72509f566b req-6714d7ee-2851-43bc-b314-80e4eb97527b service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received event network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:42:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e5308045-8750-4f49-b232-9a72509f566b req-6714d7ee-2851-43bc-b314-80e4eb97527b service nova] Acquiring lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e5308045-8750-4f49-b232-9a72509f566b req-6714d7ee-2851-43bc-b314-80e4eb97527b service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e5308045-8750-4f49-b232-9a72509f566b req-6714d7ee-2851-43bc-b314-80e4eb97527b service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:09 user nova-compute[71557]: DEBUG nova.compute.manager [req-e5308045-8750-4f49-b232-9a72509f566b req-6714d7ee-2851-43bc-b314-80e4eb97527b service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] No waiting events found dispatching network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:42:09 user nova-compute[71557]: WARNING nova.compute.manager [req-e5308045-8750-4f49-b232-9a72509f566b req-6714d7ee-2851-43bc-b314-80e4eb97527b service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received unexpected event network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance with vm_state active and task_state None.
Apr 12 10:42:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:15 user nova-compute[71557]: INFO nova.compute.manager [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Detaching volume 028bc65f-dc6d-4486-a99f-19a5ae874a93
Apr 12 10:42:15 user nova-compute[71557]: INFO nova.virt.block_device [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Attempting to driver detach volume 028bc65f-dc6d-4486-a99f-19a5ae874a93 from mountpoint /dev/vdb
Apr 12 10:42:15 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Attempting to detach device vdb from instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 10:42:15 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:42:15 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:42:15 user nova-compute[71557]:   <source dev="/dev/sdd"/>
Apr 12 10:42:15 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:42:15 user nova-compute[71557]:   <serial>028bc65f-dc6d-4486-a99f-19a5ae874a93</serial>
Apr 12 10:42:15 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 10:42:15 user nova-compute[71557]: </disk>
Apr 12 10:42:15 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:42:15 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Successfully detached device vdb from instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b from the persistent domain config.
Apr 12 10:42:15 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 10:42:15 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:42:15 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:42:15 user nova-compute[71557]:   <source dev="/dev/sdd"/>
Apr 12 10:42:15 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:42:15 user nova-compute[71557]:   <serial>028bc65f-dc6d-4486-a99f-19a5ae874a93</serial>
Apr 12 10:42:15 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 10:42:15 user nova-compute[71557]: </disk>
Apr 12 10:42:15 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681296136.0791698, bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 10:42:16 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Successfully detached device vdb from instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b from the live domain config.
Apr 12 10:42:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCjTdIwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:42:16 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:42:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9676af78-522f-4ef2-9309-56f171bb038a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:42:16 user nova-compute[71557]: No targets found.
Apr 12 10:42:16 user nova-compute[71557]: iSNS:
Apr 12 10:42:16 user nova-compute[71557]: No targets found.
Apr 12 10:42:16 user nova-compute[71557]: STATIC:
Apr 12 10:42:16 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:42:16 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:42:16 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:42:16 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b
Apr 12 10:42:16 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:42:16 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:42:16 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93
Apr 12 10:42:16 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:42:16 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:42:16 user nova-compute[71557]: FIRMWARE:
Apr 12 10:42:16 user nova-compute[71557]: No targets found.
Apr 12 10:42:16 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:42:16 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:42:16 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[66be7249-26d6-489a-9d58-ee33a072821b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea5a19e-33e1-4b2c-8539-9af6d2cfefee]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:42:16 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:42:16 user nova-compute[71557]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:42:16 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:42:16 user nova-compute[71557]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 (non-flash)
Apr 12 10:42:16 user nova-compute[71557]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:42:16 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd45e20e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93'): ({'sdd'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Removing single pathed devices sdd {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[95256813-68a7-40a4-81c6-9333411efba9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[93278a4f-f7e9-403c-ba6b-93fa5e353569]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flushing IO for device /dev/sdd {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c2cd29-e194-478a-84c4-9203055e1282]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe69e930-72c0-43be-a892-3054d24b1962]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] SCSI volumes sdd have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[34402717-7ac4-42f8-aa81-b46db3217dfa]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ff1b94-ad87-4eab-8a28-9f56754d7c27]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93, portal: 172.16.0.220,3260]
Apr 12 10:42:16 user nova-compute[71557]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93, portal: 172.16.0.220,3260] successful.
Apr 12 10:42:16 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028bc65f-dc6d-4486-a99f-19a5ae874a93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0559ffc-3008-44a3-9f88-53338b26c3ea]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] <== disconnect_volume: return (313ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:42:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:42:17 user nova-compute[71557]: DEBUG nova.objects.instance [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'flavor' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:42:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-28ed4bfd-369b-45d5-b44e-7b6025086c77 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.710s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:18 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:19 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:42:19 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:42:19 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Didn't find any instances for network info cache update. {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 10:42:19 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:42:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:19 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:42:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:42:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f834736-e836-49d3-b931-83ad82bef8f3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f834736-e836-49d3-b931-83ad82bef8f3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f834736-e836-49d3-b931-83ad82bef8f3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f834736-e836-49d3-b931-83ad82bef8f3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec86031-be71-4a8f-a8ad-cf04c506fdb4/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec86031-be71-4a8f-a8ad-cf04c506fdb4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec86031-be71-4a8f-a8ad-cf04c506fdb4/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aec86031-be71-4a8f-a8ad-cf04c506fdb4/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:42:21 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:42:21 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:42:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=7780MB free_disk=26.29045867919922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:42:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:42:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance f47d368e-3870-49d0-8522-a94991ec4ba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:42:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:42:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance dc6eb5d4-d415-4459-a95b-5a470ec66586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:42:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:42:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance aec86031-be71-4a8f-a8ad-cf04c506fdb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:42:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 7f834736-e836-49d3-b931-83ad82bef8f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:42:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 68b29390-867e-4bf3-bc93-b401f32b130e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:42:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:42:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:42:21 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Refreshing inventories for resource provider 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 10:42:21 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Updating ProviderTree inventory for provider 24299bcb-a671-492d-9d13-df83697a8f87 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 10:42:21 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Updating inventory in ProviderTree for provider 24299bcb-a671-492d-9d13-df83697a8f87 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 10:42:21 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Refreshing aggregate associations for resource provider 24299bcb-a671-492d-9d13-df83697a8f87, aggregates: None {{(pid=71557) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 10:42:22 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Refreshing trait associations for resource provider 24299bcb-a671-492d-9d13-df83697a8f87, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=71557) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 10:42:22 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:42:22 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:42:22 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:42:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.680s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:23 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:42:23 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:42:23 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:42:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:42:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:24 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:42:24 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:42:24 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:42:25 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:42:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "0bfafa79-ce40-42f1-9992-10e50734f7fa" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:28 user nova-compute[71557]: INFO nova.compute.manager [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Unshelving
Apr 12 10:42:28 user nova-compute[71557]: INFO nova.virt.block_device [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Booting with volume ae5450fe-d7d1-435d-bf24-e15cfd92e3fc at /dev/vdc
Apr 12 10:42:28 user nova-compute[71557]: DEBUG os_brick.utils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:42:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:28 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c081331-9da6-4f8b-882b-a0a40132d360]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:28 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3e5933-e2a0-4afe-96b6-9341c3e8bafc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:28 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4193cd5e-29d2-4b03-9147-5cca2e380ba9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:28 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7027574-e99f-4b29-ae34-2596743ba203]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:42:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:42:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:42:29 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:42:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[24683cef-bff1-4822-8b71-7f3d9cfee6c7]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:42:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:42:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:42:29 user nova-compute[71557]: DEBUG os_brick.utils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:42:29 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Updating existing volume attachment record: c2ae6de3-93eb-4ec9-9a81-f7e88e7081b5 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:42:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:33 user nova-compute[71557]: DEBUG nova.objects.instance [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'pci_requests' on Instance uuid 0bfafa79-ce40-42f1-9992-10e50734f7fa {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:42:33 user nova-compute[71557]: DEBUG nova.objects.instance [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'numa_topology' on Instance uuid 0bfafa79-ce40-42f1-9992-10e50734f7fa {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:42:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:33 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:42:33 user nova-compute[71557]: INFO nova.compute.claims [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Claim successful on node user
Apr 12 10:42:33 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:42:33 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:42:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:34 user nova-compute[71557]: INFO nova.network.neutron [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Updating port 4de5a799-c343-4e41-88ef-ebaaa3adb14c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 10:42:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "refresh_cache-0bfafa79-ce40-42f1-9992-10e50734f7fa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:42:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquired lock "refresh_cache-0bfafa79-ce40-42f1-9992-10e50734f7fa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:42:35 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:42:35 user nova-compute[71557]: DEBUG nova.compute.manager [req-4be91e32-6dcf-4968-8ff0-83d9266b49eb req-b036f041-f864-4388-b927-08b8091008c9 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Received event network-changed-4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:42:35 user nova-compute[71557]: DEBUG nova.compute.manager [req-4be91e32-6dcf-4968-8ff0-83d9266b49eb req-b036f041-f864-4388-b927-08b8091008c9 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Refreshing instance network info cache due to event network-changed-4de5a799-c343-4e41-88ef-ebaaa3adb14c. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:42:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4be91e32-6dcf-4968-8ff0-83d9266b49eb req-b036f041-f864-4388-b927-08b8091008c9 service nova] Acquiring lock "refresh_cache-0bfafa79-ce40-42f1-9992-10e50734f7fa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:42:36 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Updating instance_info_cache with network_info: [{"id": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "address": "fa:16:3e:6e:34:b4", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de5a799-c3", "ovs_interfaceid": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:42:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Releasing lock "refresh_cache-0bfafa79-ce40-42f1-9992-10e50734f7fa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:42:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:42:36 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Creating image(s)
Apr 12 10:42:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "/opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "/opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "/opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:36 user nova-compute[71557]: DEBUG nova.objects.instance [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0bfafa79-ce40-42f1-9992-10e50734f7fa {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:42:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4be91e32-6dcf-4968-8ff0-83d9266b49eb req-b036f041-f864-4388-b927-08b8091008c9 service nova] Acquired lock "refresh_cache-0bfafa79-ce40-42f1-9992-10e50734f7fa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:42:36 user nova-compute[71557]: DEBUG nova.network.neutron [req-4be91e32-6dcf-4968-8ff0-83d9266b49eb req-b036f041-f864-4388-b927-08b8091008c9 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Refreshing network info cache for port 4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:42:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "3a4cee6084b59313a683d9a6fb4cd01b3fb5f2e0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "3a4cee6084b59313a683d9a6fb4cd01b3fb5f2e0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a4cee6084b59313a683d9a6fb4cd01b3fb5f2e0.part --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a4cee6084b59313a683d9a6fb4cd01b3fb5f2e0.part --force-share --output=json" returned: 0 in 0.153s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:37 user nova-compute[71557]: DEBUG nova.virt.images [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] da4f58e1-cfaf-45cc-a3da-fbec26a5cbcf was qcow2, converting to raw {{(pid=71557) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 10:42:37 user nova-compute[71557]: DEBUG nova.privsep.utils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71557) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 10:42:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3a4cee6084b59313a683d9a6fb4cd01b3fb5f2e0.part /opt/stack/data/nova/instances/_base/3a4cee6084b59313a683d9a6fb4cd01b3fb5f2e0.converted {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:37 user nova-compute[71557]: DEBUG nova.network.neutron [req-4be91e32-6dcf-4968-8ff0-83d9266b49eb req-b036f041-f864-4388-b927-08b8091008c9 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Updated VIF entry in instance network info cache for port 4de5a799-c343-4e41-88ef-ebaaa3adb14c. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:42:37 user nova-compute[71557]: DEBUG nova.network.neutron [req-4be91e32-6dcf-4968-8ff0-83d9266b49eb req-b036f041-f864-4388-b927-08b8091008c9 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Updating instance_info_cache with network_info: [{"id": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "address": "fa:16:3e:6e:34:b4", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de5a799-c3", "ovs_interfaceid": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:42:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4be91e32-6dcf-4968-8ff0-83d9266b49eb req-b036f041-f864-4388-b927-08b8091008c9 service nova] Releasing lock "refresh_cache-0bfafa79-ce40-42f1-9992-10e50734f7fa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:42:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3a4cee6084b59313a683d9a6fb4cd01b3fb5f2e0.part /opt/stack/data/nova/instances/_base/3a4cee6084b59313a683d9a6fb4cd01b3fb5f2e0.converted" returned: 0 in 0.331s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a4cee6084b59313a683d9a6fb4cd01b3fb5f2e0.converted --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a4cee6084b59313a683d9a6fb4cd01b3fb5f2e0.converted --force-share --output=json" returned: 0 in 0.142s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "3a4cee6084b59313a683d9a6fb4cd01b3fb5f2e0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.439s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a4cee6084b59313a683d9a6fb4cd01b3fb5f2e0 --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a4cee6084b59313a683d9a6fb4cd01b3fb5f2e0 --force-share --output=json" returned: 0 in 0.165s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "3a4cee6084b59313a683d9a6fb4cd01b3fb5f2e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "3a4cee6084b59313a683d9a6fb4cd01b3fb5f2e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a4cee6084b59313a683d9a6fb4cd01b3fb5f2e0 --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a4cee6084b59313a683d9a6fb4cd01b3fb5f2e0 --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3a4cee6084b59313a683d9a6fb4cd01b3fb5f2e0,backing_fmt=raw /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3a4cee6084b59313a683d9a6fb4cd01b3fb5f2e0,backing_fmt=raw /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk 1073741824" returned: 0 in 0.050s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "3a4cee6084b59313a683d9a6fb4cd01b3fb5f2e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a4cee6084b59313a683d9a6fb4cd01b3fb5f2e0 --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3a4cee6084b59313a683d9a6fb4cd01b3fb5f2e0 --force-share --output=json" returned: 0 in 0.139s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:38 user nova-compute[71557]: DEBUG nova.objects.instance [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'migration_context' on Instance uuid 0bfafa79-ce40-42f1-9992-10e50734f7fa {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:42:38 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Rebasing disk image.
Apr 12 10:42:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c -F raw /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "f47d368e-3870-49d0-8522-a94991ec4ba5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:39 user nova-compute[71557]: INFO nova.compute.manager [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Terminating instance
Apr 12 10:42:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:42:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-48de4e0d-fa5d-4dc9-9654-7123c2d6ff86 req-553e7653-9e81-4a32-96dc-7d9533736462 service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received event network-vif-unplugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:42:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-48de4e0d-fa5d-4dc9-9654-7123c2d6ff86 req-553e7653-9e81-4a32-96dc-7d9533736462 service nova] Acquiring lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-48de4e0d-fa5d-4dc9-9654-7123c2d6ff86 req-553e7653-9e81-4a32-96dc-7d9533736462 service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-48de4e0d-fa5d-4dc9-9654-7123c2d6ff86 req-553e7653-9e81-4a32-96dc-7d9533736462 service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-48de4e0d-fa5d-4dc9-9654-7123c2d6ff86 req-553e7653-9e81-4a32-96dc-7d9533736462 service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] No waiting events found dispatching network-vif-unplugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:42:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-48de4e0d-fa5d-4dc9-9654-7123c2d6ff86 req-553e7653-9e81-4a32-96dc-7d9533736462 service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received event network-vif-unplugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:42:40 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Instance destroyed successfully.
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.objects.instance [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lazy-loading 'resources' on Instance uuid f47d368e-3870-49d0-8522-a94991ec4ba5 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1850921758',display_name='tempest-ServerStableDeviceRescueTest-server-1850921758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1850921758',id=3,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6J/cK5G69Rc1hFnFymuRzf/sxnh8tJeZCIsgDUrpU33tRNE8M9FW28e93IetT70vO+0CYZlhg4APAc6iRcEFv6hlCiC5vyIOseX+/85okbnJjZIoECICRAjLKoMj3fbA==',key_name='tempest-keypair-1741756118',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:39:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ce2a3bde13e464f8df0a41f30c240ab',ramdisk_id='',reservation_id='r-fqkamg1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1030861486',owner_user_name='tempest-ServerStableDeviceRescueTest-1030861486-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:41:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c757f04065b9488ba75739e59d7be377',uuid=f47d368e-3870-49d0-8522-a94991ec4ba5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "address": "fa:16:3e:97:77:c8", "network": {"id": "4d3f7dc3-82bc-43ab-be83-29e8f16f99de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-970702209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce2a3bde13e464f8df0a41f30c240ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5c1f1e-a7", "ovs_interfaceid": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Converting VIF {"id": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "address": "fa:16:3e:97:77:c8", "network": {"id": "4d3f7dc3-82bc-43ab-be83-29e8f16f99de", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-970702209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ce2a3bde13e464f8df0a41f30c240ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5c1f1e-a7", "ovs_interfaceid": "7b5c1f1e-a739-4317-a7b5-d6d884d32f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:77:c8,bridge_name='br-int',has_traffic_filtering=True,id=7b5c1f1e-a739-4317-a7b5-d6d884d32f7c,network=Network(4d3f7dc3-82bc-43ab-be83-29e8f16f99de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b5c1f1e-a7') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG os_vif [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:77:c8,bridge_name='br-int',has_traffic_filtering=True,id=7b5c1f1e-a739-4317-a7b5-d6d884d32f7c,network=Network(4d3f7dc3-82bc-43ab-be83-29e8f16f99de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b5c1f1e-a7') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b5c1f1e-a7, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:42:40 user nova-compute[71557]: INFO os_vif [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:77:c8,bridge_name='br-int',has_traffic_filtering=True,id=7b5c1f1e-a739-4317-a7b5-d6d884d32f7c,network=Network(4d3f7dc3-82bc-43ab-be83-29e8f16f99de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b5c1f1e-a7')
Apr 12 10:42:40 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Deleting instance files /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5_del
Apr 12 10:42:40 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Deletion of /opt/stack/data/nova/instances/f47d368e-3870-49d0-8522-a94991ec4ba5_del complete
Apr 12 10:42:40 user nova-compute[71557]: INFO nova.compute.manager [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c -F raw /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk" returned: 0 in 2.179s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Ensure instance console log exists: /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Start _get_guest_xml network_info=[{"id": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "address": "fa:16:3e:6e:34:b4", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de5a799-c3", "ovs_interfaceid": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='650e018c6a8f98223b9ecdae274b1201',container_format='bare',created_at=2023-04-12T10:40:36Z,direct_url=<?>,disk_format='qcow2',id=da4f58e1-cfaf-45cc-a3da-fbec26a5cbcf,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1310544900-shelved',owner='af33ce0944194932b663c3b8aef9783d',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T10:40:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'attachment_id': 'c2ae6de3-93eb-4ec9-9a81-f7e88e7081b5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TPfrgkzF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '0bfafa79-ce40-42f1-9992-10e50734f7fa', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae5450fe-d7d1-435d-bf24-e15cfd92e3fc', 'serial': 'ae5450fe-d7d1-435d-bf24-e15cfd92e3fc'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:42:40 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:42:40 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='650e018c6a8f98223b9ecdae274b1201',container_format='bare',created_at=2023-04-12T10:40:36Z,direct_url=<?>,disk_format='qcow2',id=da4f58e1-cfaf-45cc-a3da-fbec26a5cbcf,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1310544900-shelved',owner='af33ce0944194932b663c3b8aef9783d',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T10:40:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.objects.instance [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0bfafa79-ce40-42f1-9992-10e50734f7fa {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TPfrgkzF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:42:40 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:42:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:42:40 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:42:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:42:40 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc -p 172.16.0.220:3260" returned: 21 in 0.033s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ccad63-457d-428d-9bf2-6a83d401c60b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:42:40 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf22071-ab7a-4aea-affc-03d2551293d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc] added
Apr 12 10:42:40 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fd3b33-62fa-4a9a-9bf3-c704e72b442c]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[497adf57-9ae0-4d56-98af-e0f9507a0c18]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TPfrgkzF {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TPfrgkzF" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c10057-69e7-46bf-801a-d718dbbe3e24]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TPfrgkzF'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cad256f-bdb5-4ae3-898b-d18947de3c2d]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdc349d-f456-4937-81de-eb261bf79366]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:42:40 user nova-compute[71557]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:42:40 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:42:40 user nova-compute[71557]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:42:40 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:42:40 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Took 0.80 seconds to deallocate network for instance.
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[717d7566-97c0-4c60-8bd6-7a98633a67f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc, portal: 172.16.0.220,3260]
Apr 12 10:42:40 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc, portal: 172.16.0.220,3260] successful.
Apr 12 10:42:40 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6202dcc-e454-48a9-bc8e-5f7ba8cb245e]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd34d92e-d977-4a6c-beb0-cb06d3111975]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:42:41 user nova-compute[71557]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:42:41 user nova-compute[71557]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)
Apr 12 10:42:41 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:42:41 user nova-compute[71557]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:42:41 user nova-compute[71557]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)
Apr 12 10:42:41 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e31ffa-fb0e-4096-b07e-43ea6a6a12ff]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TPfrgkzF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:41 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Deleted allocations for instance f47d368e-3870-49d0-8522-a94991ec4ba5
Apr 12 10:42:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-091d722c-4498-4828-80b5-9529c0a5fa12 tempest-ServerStableDeviceRescueTest-1030861486 tempest-ServerStableDeviceRescueTest-1030861486-project-member] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.228s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-8be707e7-a8ef-43e1-a502-6edd1a8e5baf req-0656bb0e-bf55-4550-b4c9-d8240c0ee6b1 service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received event network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8be707e7-a8ef-43e1-a502-6edd1a8e5baf req-0656bb0e-bf55-4550-b4c9-d8240c0ee6b1 service nova] Acquiring lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8be707e7-a8ef-43e1-a502-6edd1a8e5baf req-0656bb0e-bf55-4550-b4c9-d8240c0ee6b1 service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8be707e7-a8ef-43e1-a502-6edd1a8e5baf req-0656bb0e-bf55-4550-b4c9-d8240c0ee6b1 service nova] Lock "f47d368e-3870-49d0-8522-a94991ec4ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-8be707e7-a8ef-43e1-a502-6edd1a8e5baf req-0656bb0e-bf55-4550-b4c9-d8240c0ee6b1 service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] No waiting events found dispatching network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:42:41 user nova-compute[71557]: WARNING nova.compute.manager [req-8be707e7-a8ef-43e1-a502-6edd1a8e5baf req-0656bb0e-bf55-4550-b4c9-d8240c0ee6b1 service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received unexpected event network-vif-plugged-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c for instance with vm_state deleted and task_state None.
Apr 12 10:42:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-8be707e7-a8ef-43e1-a502-6edd1a8e5baf req-0656bb0e-bf55-4550-b4c9-d8240c0ee6b1 service nova] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Received event network-vif-deleted-7b5c1f1e-a739-4317-a7b5-d6d884d32f7c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26463386664353332', 'path': '/dev/sdc'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463386664353332', 'path': '/dev/sdc'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T10:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1310544900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1310544900',id=15,image_ref='da4f58e1-cfaf-45cc-a3da-fbec26a5cbcf',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1823760254',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:38:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='af33ce0944194932b663c3b8aef9783d',ramdisk_id='',reservation_id='r-oeqsk990',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-603525697',owner_user_name='tempest-AttachVolumeShelveTestJSON-603525697-project-member',shelved_at='2023-04-12T10:40:40.355253',shelved_host='user',shelved_image_id='da4f58e1-cfaf-45cc-a3da-fbec26a5cbcf'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:42:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d6279f1ce94008a2898ade6f730b40',uuid=0bfafa79-ce40-42f1-9992-10e50734f7fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "address": "fa:16:3e:6e:34:b4", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de5a799-c3", "ovs_interfaceid": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converting VIF {"id": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "address": "fa:16:3e:6e:34:b4", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de5a799-c3", "ovs_interfaceid": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:34:b4,bridge_name='br-int',has_traffic_filtering=True,id=4de5a799-c343-4e41-88ef-ebaaa3adb14c,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4de5a799-c3') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG nova.objects.instance [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bfafa79-ce40-42f1-9992-10e50734f7fa {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:42:42 user nova-compute[71557]:   <uuid>0bfafa79-ce40-42f1-9992-10e50734f7fa</uuid>
Apr 12 10:42:42 user nova-compute[71557]:   <name>instance-0000000f</name>
Apr 12 10:42:42 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:42:42 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:42:42 user nova-compute[71557]:   <metadata>
Apr 12 10:42:42 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:42:42 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:42:42 user nova-compute[71557]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1310544900</nova:name>
Apr 12 10:42:42 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:42:40</nova:creationTime>
Apr 12 10:42:42 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:42:42 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:42:42 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:42:42 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:42:42 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:42:42 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:42:42 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:42:42 user nova-compute[71557]:       <nova:owner>
Apr 12 10:42:42 user nova-compute[71557]:         <nova:user uuid="47d6279f1ce94008a2898ade6f730b40">tempest-AttachVolumeShelveTestJSON-603525697-project-member</nova:user>
Apr 12 10:42:42 user nova-compute[71557]:         <nova:project uuid="af33ce0944194932b663c3b8aef9783d">tempest-AttachVolumeShelveTestJSON-603525697</nova:project>
Apr 12 10:42:42 user nova-compute[71557]:       </nova:owner>
Apr 12 10:42:42 user nova-compute[71557]:       <nova:root type="image" uuid="da4f58e1-cfaf-45cc-a3da-fbec26a5cbcf"/>
Apr 12 10:42:42 user nova-compute[71557]:       <nova:ports>
Apr 12 10:42:42 user nova-compute[71557]:         <nova:port uuid="4de5a799-c343-4e41-88ef-ebaaa3adb14c">
Apr 12 10:42:42 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 10:42:42 user nova-compute[71557]:         </nova:port>
Apr 12 10:42:42 user nova-compute[71557]:       </nova:ports>
Apr 12 10:42:42 user nova-compute[71557]:     </nova:instance>
Apr 12 10:42:42 user nova-compute[71557]:   </metadata>
Apr 12 10:42:42 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:42:42 user nova-compute[71557]:     <system>
Apr 12 10:42:42 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:42:42 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:42:42 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:42:42 user nova-compute[71557]:       <entry name="serial">0bfafa79-ce40-42f1-9992-10e50734f7fa</entry>
Apr 12 10:42:42 user nova-compute[71557]:       <entry name="uuid">0bfafa79-ce40-42f1-9992-10e50734f7fa</entry>
Apr 12 10:42:42 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:42:42 user nova-compute[71557]:     </system>
Apr 12 10:42:42 user nova-compute[71557]:   </sysinfo>
Apr 12 10:42:42 user nova-compute[71557]:   <os>
Apr 12 10:42:42 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:42:42 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:42:42 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:42:42 user nova-compute[71557]:   </os>
Apr 12 10:42:42 user nova-compute[71557]:   <features>
Apr 12 10:42:42 user nova-compute[71557]:     <acpi/>
Apr 12 10:42:42 user nova-compute[71557]:     <apic/>
Apr 12 10:42:42 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:42:42 user nova-compute[71557]:   </features>
Apr 12 10:42:42 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:42:42 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:42:42 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:42:42 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:42:42 user nova-compute[71557]:   </clock>
Apr 12 10:42:42 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:42:42 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:42:42 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:42:42 user nova-compute[71557]:   </cpu>
Apr 12 10:42:42 user nova-compute[71557]:   <devices>
Apr 12 10:42:42 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:42:42 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:42:42 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk"/>
Apr 12 10:42:42 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:42:42 user nova-compute[71557]:     </disk>
Apr 12 10:42:42 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:42:42 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:42:42 user nova-compute[71557]:       <source dev="/dev/sdc"/>
Apr 12 10:42:42 user nova-compute[71557]:       <target dev="vdc" bus="virtio"/>
Apr 12 10:42:42 user nova-compute[71557]:       <serial>ae5450fe-d7d1-435d-bf24-e15cfd92e3fc</serial>
Apr 12 10:42:42 user nova-compute[71557]:     </disk>
Apr 12 10:42:42 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:42:42 user nova-compute[71557]:       <mac address="fa:16:3e:6e:34:b4"/>
Apr 12 10:42:42 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:42:42 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:42:42 user nova-compute[71557]:       <target dev="tap4de5a799-c3"/>
Apr 12 10:42:42 user nova-compute[71557]:     </interface>
Apr 12 10:42:42 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:42:42 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/console.log" append="off"/>
Apr 12 10:42:42 user nova-compute[71557]:     </serial>
Apr 12 10:42:42 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:42:42 user nova-compute[71557]:     <video>
Apr 12 10:42:42 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:42:42 user nova-compute[71557]:     </video>
Apr 12 10:42:42 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:42:42 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:42:42 user nova-compute[71557]:     </rng>
Apr 12 10:42:42 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:42:42 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:42:42 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:42:42 user nova-compute[71557]:     </memballoon>
Apr 12 10:42:42 user nova-compute[71557]:   </devices>
Apr 12 10:42:42 user nova-compute[71557]: </domain>
Apr 12 10:42:42 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T10:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1310544900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1310544900',id=15,image_ref='da4f58e1-cfaf-45cc-a3da-fbec26a5cbcf',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1823760254',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:38:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='af33ce0944194932b663c3b8aef9783d',ramdisk_id='',reservation_id='r-oeqsk990',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-603525697',owner_user_name='tempest-AttachVolumeShelveTestJSON-603525697-project-member',shelved_at='2023-04-12T10:40:40.355253',shelved_host='user',shelved_image_id='da4f58e1-cfaf-45cc-a3da-fbec26a5cbcf'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:42:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d6279f1ce94008a2898ade6f730b40',uuid=0bfafa79-ce40-42f1-9992-10e50734f7fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "address": "fa:16:3e:6e:34:b4", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de5a799-c3", "ovs_interfaceid": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converting VIF {"id": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "address": "fa:16:3e:6e:34:b4", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de5a799-c3", "ovs_interfaceid": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:34:b4,bridge_name='br-int',has_traffic_filtering=True,id=4de5a799-c343-4e41-88ef-ebaaa3adb14c,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4de5a799-c3') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG os_vif [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:34:b4,bridge_name='br-int',has_traffic_filtering=True,id=4de5a799-c343-4e41-88ef-ebaaa3adb14c,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4de5a799-c3') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4de5a799-c3, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4de5a799-c3, col_values=(('external_ids', {'iface-id': '4de5a799-c343-4e41-88ef-ebaaa3adb14c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:34:b4', 'vm-uuid': '0bfafa79-ce40-42f1-9992-10e50734f7fa'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:42 user nova-compute[71557]: INFO os_vif [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:34:b4,bridge_name='br-int',has_traffic_filtering=True,id=4de5a799-c343-4e41-88ef-ebaaa3adb14c,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4de5a799-c3')
Apr 12 10:42:42 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:42:42 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] No VIF found with MAC fa:16:3e:6e:34:b4, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:42:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-61727e5a-7373-464b-ac94-ca182108c0de req-672f71b0-b788-408c-b05f-198bcd0876f7 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Received event network-vif-plugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:42:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-61727e5a-7373-464b-ac94-ca182108c0de req-672f71b0-b788-408c-b05f-198bcd0876f7 service nova] Acquiring lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-61727e5a-7373-464b-ac94-ca182108c0de req-672f71b0-b788-408c-b05f-198bcd0876f7 service nova] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-61727e5a-7373-464b-ac94-ca182108c0de req-672f71b0-b788-408c-b05f-198bcd0876f7 service nova] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-61727e5a-7373-464b-ac94-ca182108c0de req-672f71b0-b788-408c-b05f-198bcd0876f7 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] No waiting events found dispatching network-vif-plugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:42:44 user nova-compute[71557]: WARNING nova.compute.manager [req-61727e5a-7373-464b-ac94-ca182108c0de req-672f71b0-b788-408c-b05f-198bcd0876f7 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Received unexpected event network-vif-plugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 10:42:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:46 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296166.2031157, 0bfafa79-ce40-42f1-9992-10e50734f7fa => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:42:46 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] VM Resumed (Lifecycle Event)
Apr 12 10:42:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:42:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:42:46 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Instance spawned successfully.
Apr 12 10:42:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:42:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:42:46 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:42:46 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296166.2045493, 0bfafa79-ce40-42f1-9992-10e50734f7fa => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:42:46 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] VM Started (Lifecycle Event)
Apr 12 10:42:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:42:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:42:46 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:42:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-ea83a137-c3e3-40bd-931e-98e69f993b1d req-05ecf56f-420b-416f-bc09-2ef88eaaf962 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Received event network-vif-plugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:42:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ea83a137-c3e3-40bd-931e-98e69f993b1d req-05ecf56f-420b-416f-bc09-2ef88eaaf962 service nova] Acquiring lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ea83a137-c3e3-40bd-931e-98e69f993b1d req-05ecf56f-420b-416f-bc09-2ef88eaaf962 service nova] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ea83a137-c3e3-40bd-931e-98e69f993b1d req-05ecf56f-420b-416f-bc09-2ef88eaaf962 service nova] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-ea83a137-c3e3-40bd-931e-98e69f993b1d req-05ecf56f-420b-416f-bc09-2ef88eaaf962 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] No waiting events found dispatching network-vif-plugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:42:46 user nova-compute[71557]: WARNING nova.compute.manager [req-ea83a137-c3e3-40bd-931e-98e69f993b1d req-05ecf56f-420b-416f-bc09-2ef88eaaf962 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Received unexpected event network-vif-plugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 10:42:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:42:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5d1dd64c-529d-4454-b07f-e7e069a8a837 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.813s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:47 user nova-compute[71557]: DEBUG nova.compute.manager [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:42:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:47 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:42:47 user nova-compute[71557]: INFO nova.compute.claims [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Claim successful on node user
Apr 12 10:42:47 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:42:47 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:42:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:47 user nova-compute[71557]: DEBUG nova.compute.manager [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG nova.network.neutron [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:42:48 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:42:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:42:48 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Creating image(s)
Apr 12 10:42:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "/opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "/opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.215s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG nova.policy [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ec47d3cdacb45e5a39509e76b546e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cecbfbfd5f42dbb663367f6fbdf3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.146s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk 1073741824" returned: 0 in 0.047s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.141s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Cannot resize image /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG nova.objects.instance [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'migration_context' on Instance uuid 4b79f4d7-f34e-4971-8a6f-171c2d71d683 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Ensure instance console log exists: /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:49 user nova-compute[71557]: DEBUG nova.network.neutron [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Successfully created port: ac9512bb-5122-4a70-b970-f82605ed0606 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:42:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "be3f67e5-420d-42a2-b68a-7cadff22fa48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:42:51 user nova-compute[71557]: DEBUG nova.network.neutron [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Successfully updated port: ac9512bb-5122-4a70-b970-f82605ed0606 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:42:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "refresh_cache-4b79f4d7-f34e-4971-8a6f-171c2d71d683" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:42:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquired lock "refresh_cache-4b79f4d7-f34e-4971-8a6f-171c2d71d683" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:42:51 user nova-compute[71557]: DEBUG nova.network.neutron [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:42:51 user nova-compute[71557]: DEBUG nova.compute.manager [req-287984fd-37a9-4baf-acd0-33328bfa1f59 req-307541ef-1f6a-453f-8e33-8dfb6bbb7a28 service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Received event network-changed-ac9512bb-5122-4a70-b970-f82605ed0606 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:42:51 user nova-compute[71557]: DEBUG nova.compute.manager [req-287984fd-37a9-4baf-acd0-33328bfa1f59 req-307541ef-1f6a-453f-8e33-8dfb6bbb7a28 service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Refreshing instance network info cache due to event network-changed-ac9512bb-5122-4a70-b970-f82605ed0606. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:42:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-287984fd-37a9-4baf-acd0-33328bfa1f59 req-307541ef-1f6a-453f-8e33-8dfb6bbb7a28 service nova] Acquiring lock "refresh_cache-4b79f4d7-f34e-4971-8a6f-171c2d71d683" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:42:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:51 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:42:51 user nova-compute[71557]: INFO nova.compute.claims [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Claim successful on node user
Apr 12 10:42:51 user nova-compute[71557]: DEBUG nova.network.neutron [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.network.neutron [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Updating instance_info_cache with network_info: [{"id": "ac9512bb-5122-4a70-b970-f82605ed0606", "address": "fa:16:3e:74:3e:82", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9512bb-51", "ovs_interfaceid": "ac9512bb-5122-4a70-b970-f82605ed0606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Releasing lock "refresh_cache-4b79f4d7-f34e-4971-8a6f-171c2d71d683" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.compute.manager [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Instance network_info: |[{"id": "ac9512bb-5122-4a70-b970-f82605ed0606", "address": "fa:16:3e:74:3e:82", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9512bb-51", "ovs_interfaceid": "ac9512bb-5122-4a70-b970-f82605ed0606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-287984fd-37a9-4baf-acd0-33328bfa1f59 req-307541ef-1f6a-453f-8e33-8dfb6bbb7a28 service nova] Acquired lock "refresh_cache-4b79f4d7-f34e-4971-8a6f-171c2d71d683" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.network.neutron [req-287984fd-37a9-4baf-acd0-33328bfa1f59 req-307541ef-1f6a-453f-8e33-8dfb6bbb7a28 service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Refreshing network info cache for port ac9512bb-5122-4a70-b970-f82605ed0606 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Start _get_guest_xml network_info=[{"id": "ac9512bb-5122-4a70-b970-f82605ed0606", "address": "fa:16:3e:74:3e:82", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9512bb-51", "ovs_interfaceid": "ac9512bb-5122-4a70-b970-f82605ed0606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:42:52 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:42:52 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:42:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-454382670',display_name='tempest-AttachVolumeNegativeTest-server-454382670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-454382670',id=21,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLI/6/yskGDC/kneATQrlM5ySdnkfz5IHk2qD3yn85kz4nSdofboB+BktBB+DBbMhyOy23QhYD/YquSqOPbUt1xakLZAcNyRXoXQD1kQSLURiFJdfuh9KazJ/4uYci+IOg==',key_name='tempest-keypair-427188730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3cecbfbfd5f42dbb663367f6fbdf3b0',ramdisk_id='',reservation_id='r-dsoszcjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-249658876',owner_user_name='tempest-AttachVolumeNegativeTest-249658876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ec47d3cdacb45e5a39509e76b546e34',uuid=4b79f4d7-f34e-4971-8a6f-171c2d71d683,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac9512bb-5122-4a70-b970-f82605ed0606", "address": "fa:16:3e:74:3e:82", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9512bb-51", "ovs_interfaceid": "ac9512bb-5122-4a70-b970-f82605ed0606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converting VIF {"id": "ac9512bb-5122-4a70-b970-f82605ed0606", "address": "fa:16:3e:74:3e:82", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9512bb-51", "ovs_interfaceid": "ac9512bb-5122-4a70-b970-f82605ed0606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:3e:82,bridge_name='br-int',has_traffic_filtering=True,id=ac9512bb-5122-4a70-b970-f82605ed0606,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac9512bb-51') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.objects.instance [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b79f4d7-f34e-4971-8a6f-171c2d71d683 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:42:52 user nova-compute[71557]:   <uuid>4b79f4d7-f34e-4971-8a6f-171c2d71d683</uuid>
Apr 12 10:42:52 user nova-compute[71557]:   <name>instance-00000015</name>
Apr 12 10:42:52 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:42:52 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:42:52 user nova-compute[71557]:   <metadata>
Apr 12 10:42:52 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:42:52 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:42:52 user nova-compute[71557]:       <nova:name>tempest-AttachVolumeNegativeTest-server-454382670</nova:name>
Apr 12 10:42:52 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:42:52</nova:creationTime>
Apr 12 10:42:52 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:42:52 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:42:52 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:42:52 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:42:52 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:42:52 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:42:52 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:42:52 user nova-compute[71557]:       <nova:owner>
Apr 12 10:42:52 user nova-compute[71557]:         <nova:user uuid="7ec47d3cdacb45e5a39509e76b546e34">tempest-AttachVolumeNegativeTest-249658876-project-member</nova:user>
Apr 12 10:42:52 user nova-compute[71557]:         <nova:project uuid="c3cecbfbfd5f42dbb663367f6fbdf3b0">tempest-AttachVolumeNegativeTest-249658876</nova:project>
Apr 12 10:42:52 user nova-compute[71557]:       </nova:owner>
Apr 12 10:42:52 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:42:52 user nova-compute[71557]:       <nova:ports>
Apr 12 10:42:52 user nova-compute[71557]:         <nova:port uuid="ac9512bb-5122-4a70-b970-f82605ed0606">
Apr 12 10:42:52 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 10:42:52 user nova-compute[71557]:         </nova:port>
Apr 12 10:42:52 user nova-compute[71557]:       </nova:ports>
Apr 12 10:42:52 user nova-compute[71557]:     </nova:instance>
Apr 12 10:42:52 user nova-compute[71557]:   </metadata>
Apr 12 10:42:52 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:42:52 user nova-compute[71557]:     <system>
Apr 12 10:42:52 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:42:52 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:42:52 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:42:52 user nova-compute[71557]:       <entry name="serial">4b79f4d7-f34e-4971-8a6f-171c2d71d683</entry>
Apr 12 10:42:52 user nova-compute[71557]:       <entry name="uuid">4b79f4d7-f34e-4971-8a6f-171c2d71d683</entry>
Apr 12 10:42:52 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:42:52 user nova-compute[71557]:     </system>
Apr 12 10:42:52 user nova-compute[71557]:   </sysinfo>
Apr 12 10:42:52 user nova-compute[71557]:   <os>
Apr 12 10:42:52 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:42:52 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:42:52 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:42:52 user nova-compute[71557]:   </os>
Apr 12 10:42:52 user nova-compute[71557]:   <features>
Apr 12 10:42:52 user nova-compute[71557]:     <acpi/>
Apr 12 10:42:52 user nova-compute[71557]:     <apic/>
Apr 12 10:42:52 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:42:52 user nova-compute[71557]:   </features>
Apr 12 10:42:52 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:42:52 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:42:52 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:42:52 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:42:52 user nova-compute[71557]:   </clock>
Apr 12 10:42:52 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:42:52 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:42:52 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:42:52 user nova-compute[71557]:   </cpu>
Apr 12 10:42:52 user nova-compute[71557]:   <devices>
Apr 12 10:42:52 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:42:52 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:42:52 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk"/>
Apr 12 10:42:52 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:42:52 user nova-compute[71557]:     </disk>
Apr 12 10:42:52 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:42:52 user nova-compute[71557]:       <mac address="fa:16:3e:74:3e:82"/>
Apr 12 10:42:52 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:42:52 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:42:52 user nova-compute[71557]:       <target dev="tapac9512bb-51"/>
Apr 12 10:42:52 user nova-compute[71557]:     </interface>
Apr 12 10:42:52 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:42:52 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/console.log" append="off"/>
Apr 12 10:42:52 user nova-compute[71557]:     </serial>
Apr 12 10:42:52 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:42:52 user nova-compute[71557]:     <video>
Apr 12 10:42:52 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:42:52 user nova-compute[71557]:     </video>
Apr 12 10:42:52 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:42:52 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:42:52 user nova-compute[71557]:     </rng>
Apr 12 10:42:52 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:42:52 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:42:52 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:42:52 user nova-compute[71557]:     </memballoon>
Apr 12 10:42:52 user nova-compute[71557]:   </devices>
Apr 12 10:42:52 user nova-compute[71557]: </domain>
Apr 12 10:42:52 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:42:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-454382670',display_name='tempest-AttachVolumeNegativeTest-server-454382670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-454382670',id=21,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLI/6/yskGDC/kneATQrlM5ySdnkfz5IHk2qD3yn85kz4nSdofboB+BktBB+DBbMhyOy23QhYD/YquSqOPbUt1xakLZAcNyRXoXQD1kQSLURiFJdfuh9KazJ/4uYci+IOg==',key_name='tempest-keypair-427188730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3cecbfbfd5f42dbb663367f6fbdf3b0',ramdisk_id='',reservation_id='r-dsoszcjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-249658876',owner_user_name='tempest-AttachVolumeNegativeTest-249658876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ec47d3cdacb45e5a39509e76b546e34',uuid=4b79f4d7-f34e-4971-8a6f-171c2d71d683,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac9512bb-5122-4a70-b970-f82605ed0606", "address": "fa:16:3e:74:3e:82", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9512bb-51", "ovs_interfaceid": "ac9512bb-5122-4a70-b970-f82605ed0606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converting VIF {"id": "ac9512bb-5122-4a70-b970-f82605ed0606", "address": "fa:16:3e:74:3e:82", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9512bb-51", "ovs_interfaceid": "ac9512bb-5122-4a70-b970-f82605ed0606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:3e:82,bridge_name='br-int',has_traffic_filtering=True,id=ac9512bb-5122-4a70-b970-f82605ed0606,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac9512bb-51') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG os_vif [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:3e:82,bridge_name='br-int',has_traffic_filtering=True,id=ac9512bb-5122-4a70-b970-f82605ed0606,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac9512bb-51') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac9512bb-51, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapac9512bb-51, col_values=(('external_ids', {'iface-id': 'ac9512bb-5122-4a70-b970-f82605ed0606', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:3e:82', 'vm-uuid': '4b79f4d7-f34e-4971-8a6f-171c2d71d683'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:52 user nova-compute[71557]: INFO os_vif [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:3e:82,bridge_name='br-int',has_traffic_filtering=True,id=ac9512bb-5122-4a70-b970-f82605ed0606,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac9512bb-51')
Apr 12 10:42:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.compute.manager [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] No VIF found with MAC fa:16:3e:74:3e:82, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "97bafe22-36bf-4939-baf8-9602551bad52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "97bafe22-36bf-4939-baf8-9602551bad52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.compute.manager [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.network.neutron [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.compute.manager [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:42:52 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.compute.manager [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.policy [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abdf772f2c7341c29159b6f1f2ce7ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b39cd8e55b54a86a7784f2934273e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:42:52 user nova-compute[71557]: INFO nova.compute.claims [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Claim successful on node user
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.compute.manager [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:42:52 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Creating image(s)
Apr 12 10:42:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "/opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "/opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "/opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.network.neutron [req-287984fd-37a9-4baf-acd0-33328bfa1f59 req-307541ef-1f6a-453f-8e33-8dfb6bbb7a28 service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Updated VIF entry in instance network info cache for port ac9512bb-5122-4a70-b970-f82605ed0606. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG nova.network.neutron [req-287984fd-37a9-4baf-acd0-33328bfa1f59 req-307541ef-1f6a-453f-8e33-8dfb6bbb7a28 service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Updating instance_info_cache with network_info: [{"id": "ac9512bb-5122-4a70-b970-f82605ed0606", "address": "fa:16:3e:74:3e:82", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9512bb-51", "ovs_interfaceid": "ac9512bb-5122-4a70-b970-f82605ed0606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-287984fd-37a9-4baf-acd0-33328bfa1f59 req-307541ef-1f6a-453f-8e33-8dfb6bbb7a28 service nova] Releasing lock "refresh_cache-4b79f4d7-f34e-4971-8a6f-171c2d71d683" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.145s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk 1073741824" returned: 0 in 0.054s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:52 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.147s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.671s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG nova.compute.manager [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Cannot resize image /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG nova.objects.instance [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'migration_context' on Instance uuid be3f67e5-420d-42a2-b68a-7cadff22fa48 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Ensure instance console log exists: /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG nova.network.neutron [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Successfully created port: 943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG nova.compute.manager [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG nova.network.neutron [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:42:53 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:42:53 user nova-compute[71557]: DEBUG nova.compute.manager [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG nova.compute.manager [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:42:53 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Creating image(s)
Apr 12 10:42:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "/opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "/opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "/opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG nova.policy [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abdf772f2c7341c29159b6f1f2ce7ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b39cd8e55b54a86a7784f2934273e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.141s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk 1073741824" returned: 0 in 0.070s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.160s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:42:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG nova.compute.manager [req-716772f0-bd3b-443c-bb3a-79a817907845 req-c23b97bb-e1e4-46e8-aba9-8ccd80275214 service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Received event network-vif-plugged-ac9512bb-5122-4a70-b970-f82605ed0606 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-716772f0-bd3b-443c-bb3a-79a817907845 req-c23b97bb-e1e4-46e8-aba9-8ccd80275214 service nova] Acquiring lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-716772f0-bd3b-443c-bb3a-79a817907845 req-c23b97bb-e1e4-46e8-aba9-8ccd80275214 service nova] Lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-716772f0-bd3b-443c-bb3a-79a817907845 req-c23b97bb-e1e4-46e8-aba9-8ccd80275214 service nova] Lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG nova.compute.manager [req-716772f0-bd3b-443c-bb3a-79a817907845 req-c23b97bb-e1e4-46e8-aba9-8ccd80275214 service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] No waiting events found dispatching network-vif-plugged-ac9512bb-5122-4a70-b970-f82605ed0606 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:42:54 user nova-compute[71557]: WARNING nova.compute.manager [req-716772f0-bd3b-443c-bb3a-79a817907845 req-c23b97bb-e1e4-46e8-aba9-8ccd80275214 service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Received unexpected event network-vif-plugged-ac9512bb-5122-4a70-b970-f82605ed0606 for instance with vm_state building and task_state spawning.
Apr 12 10:42:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Cannot resize image /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG nova.objects.instance [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'migration_context' on Instance uuid 97bafe22-36bf-4939-baf8-9602551bad52 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Ensure instance console log exists: /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG nova.network.neutron [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Successfully updated port: 943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "refresh_cache-be3f67e5-420d-42a2-b68a-7cadff22fa48" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquired lock "refresh_cache-be3f67e5-420d-42a2-b68a-7cadff22fa48" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG nova.network.neutron [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG nova.compute.manager [req-24f1b11d-4220-416c-a301-57457c35c994 req-481f4128-667b-44a3-8c5d-f31d09c77a96 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received event network-changed-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG nova.compute.manager [req-24f1b11d-4220-416c-a301-57457c35c994 req-481f4128-667b-44a3-8c5d-f31d09c77a96 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Refreshing instance network info cache due to event network-changed-943dbed4-3180-4221-b27c-710c0118b7cf. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-24f1b11d-4220-416c-a301-57457c35c994 req-481f4128-667b-44a3-8c5d-f31d09c77a96 service nova] Acquiring lock "refresh_cache-be3f67e5-420d-42a2-b68a-7cadff22fa48" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG nova.network.neutron [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:54 user nova-compute[71557]: DEBUG nova.network.neutron [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Successfully created port: 580ed46e-ff10-494f-b864-42eda726a7ff {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296160.0773306, f47d368e-3870-49d0-8522-a94991ec4ba5 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:42:55 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] VM Stopped (Lifecycle Event)
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.network.neutron [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Updating instance_info_cache with network_info: [{"id": "943dbed4-3180-4221-b27c-710c0118b7cf", "address": "fa:16:3e:d5:a9:3b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap943dbed4-31", "ovs_interfaceid": "943dbed4-3180-4221-b27c-710c0118b7cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4369965f-d68e-4c11-8348-1c1c9d60e3c8 None None] [instance: f47d368e-3870-49d0-8522-a94991ec4ba5] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Releasing lock "refresh_cache-be3f67e5-420d-42a2-b68a-7cadff22fa48" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.compute.manager [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Instance network_info: |[{"id": "943dbed4-3180-4221-b27c-710c0118b7cf", "address": "fa:16:3e:d5:a9:3b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap943dbed4-31", "ovs_interfaceid": "943dbed4-3180-4221-b27c-710c0118b7cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-24f1b11d-4220-416c-a301-57457c35c994 req-481f4128-667b-44a3-8c5d-f31d09c77a96 service nova] Acquired lock "refresh_cache-be3f67e5-420d-42a2-b68a-7cadff22fa48" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.network.neutron [req-24f1b11d-4220-416c-a301-57457c35c994 req-481f4128-667b-44a3-8c5d-f31d09c77a96 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Refreshing network info cache for port 943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Start _get_guest_xml network_info=[{"id": "943dbed4-3180-4221-b27c-710c0118b7cf", "address": "fa:16:3e:d5:a9:3b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap943dbed4-31", "ovs_interfaceid": "943dbed4-3180-4221-b27c-710c0118b7cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:42:55 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:42:55 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1871933050',display_name='tempest-ServerRescueNegativeTestJSON-server-1871933050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1871933050',id=22,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b39cd8e55b54a86a7784f2934273e20',ramdisk_id='',reservation_id='r-14dvps6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1632398833',owner_user_name='tempest-ServerRescueNegativeTestJSON-1632398833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:42:53Z,user_data=None,user_id='abdf772f2c7341c29159b6f1f2ce7ccb',uuid=be3f67e5-420d-42a2-b68a-7cadff22fa48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "943dbed4-3180-4221-b27c-710c0118b7cf", "address": "fa:16:3e:d5:a9:3b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap943dbed4-31", "ovs_interfaceid": "943dbed4-3180-4221-b27c-710c0118b7cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converting VIF {"id": "943dbed4-3180-4221-b27c-710c0118b7cf", "address": "fa:16:3e:d5:a9:3b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap943dbed4-31", "ovs_interfaceid": "943dbed4-3180-4221-b27c-710c0118b7cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a9:3b,bridge_name='br-int',has_traffic_filtering=True,id=943dbed4-3180-4221-b27c-710c0118b7cf,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap943dbed4-31') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.objects.instance [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'pci_devices' on Instance uuid be3f67e5-420d-42a2-b68a-7cadff22fa48 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:42:55 user nova-compute[71557]:   <uuid>be3f67e5-420d-42a2-b68a-7cadff22fa48</uuid>
Apr 12 10:42:55 user nova-compute[71557]:   <name>instance-00000016</name>
Apr 12 10:42:55 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:42:55 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:42:55 user nova-compute[71557]:   <metadata>
Apr 12 10:42:55 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:42:55 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:42:55 user nova-compute[71557]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1871933050</nova:name>
Apr 12 10:42:55 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:42:55</nova:creationTime>
Apr 12 10:42:55 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:42:55 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:42:55 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:42:55 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:42:55 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:42:55 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:42:55 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:42:55 user nova-compute[71557]:       <nova:owner>
Apr 12 10:42:55 user nova-compute[71557]:         <nova:user uuid="abdf772f2c7341c29159b6f1f2ce7ccb">tempest-ServerRescueNegativeTestJSON-1632398833-project-member</nova:user>
Apr 12 10:42:55 user nova-compute[71557]:         <nova:project uuid="2b39cd8e55b54a86a7784f2934273e20">tempest-ServerRescueNegativeTestJSON-1632398833</nova:project>
Apr 12 10:42:55 user nova-compute[71557]:       </nova:owner>
Apr 12 10:42:55 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:42:55 user nova-compute[71557]:       <nova:ports>
Apr 12 10:42:55 user nova-compute[71557]:         <nova:port uuid="943dbed4-3180-4221-b27c-710c0118b7cf">
Apr 12 10:42:55 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 10:42:55 user nova-compute[71557]:         </nova:port>
Apr 12 10:42:55 user nova-compute[71557]:       </nova:ports>
Apr 12 10:42:55 user nova-compute[71557]:     </nova:instance>
Apr 12 10:42:55 user nova-compute[71557]:   </metadata>
Apr 12 10:42:55 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:42:55 user nova-compute[71557]:     <system>
Apr 12 10:42:55 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:42:55 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:42:55 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:42:55 user nova-compute[71557]:       <entry name="serial">be3f67e5-420d-42a2-b68a-7cadff22fa48</entry>
Apr 12 10:42:55 user nova-compute[71557]:       <entry name="uuid">be3f67e5-420d-42a2-b68a-7cadff22fa48</entry>
Apr 12 10:42:55 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:42:55 user nova-compute[71557]:     </system>
Apr 12 10:42:55 user nova-compute[71557]:   </sysinfo>
Apr 12 10:42:55 user nova-compute[71557]:   <os>
Apr 12 10:42:55 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:42:55 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:42:55 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:42:55 user nova-compute[71557]:   </os>
Apr 12 10:42:55 user nova-compute[71557]:   <features>
Apr 12 10:42:55 user nova-compute[71557]:     <acpi/>
Apr 12 10:42:55 user nova-compute[71557]:     <apic/>
Apr 12 10:42:55 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:42:55 user nova-compute[71557]:   </features>
Apr 12 10:42:55 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:42:55 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:42:55 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:42:55 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:42:55 user nova-compute[71557]:   </clock>
Apr 12 10:42:55 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:42:55 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:42:55 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:42:55 user nova-compute[71557]:   </cpu>
Apr 12 10:42:55 user nova-compute[71557]:   <devices>
Apr 12 10:42:55 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:42:55 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:42:55 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk"/>
Apr 12 10:42:55 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:42:55 user nova-compute[71557]:     </disk>
Apr 12 10:42:55 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:42:55 user nova-compute[71557]:       <mac address="fa:16:3e:d5:a9:3b"/>
Apr 12 10:42:55 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:42:55 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:42:55 user nova-compute[71557]:       <target dev="tap943dbed4-31"/>
Apr 12 10:42:55 user nova-compute[71557]:     </interface>
Apr 12 10:42:55 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:42:55 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/console.log" append="off"/>
Apr 12 10:42:55 user nova-compute[71557]:     </serial>
Apr 12 10:42:55 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:42:55 user nova-compute[71557]:     <video>
Apr 12 10:42:55 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:42:55 user nova-compute[71557]:     </video>
Apr 12 10:42:55 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:42:55 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:42:55 user nova-compute[71557]:     </rng>
Apr 12 10:42:55 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:42:55 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:42:55 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:42:55 user nova-compute[71557]:     </memballoon>
Apr 12 10:42:55 user nova-compute[71557]:   </devices>
Apr 12 10:42:55 user nova-compute[71557]: </domain>
Apr 12 10:42:55 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1871933050',display_name='tempest-ServerRescueNegativeTestJSON-server-1871933050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1871933050',id=22,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b39cd8e55b54a86a7784f2934273e20',ramdisk_id='',reservation_id='r-14dvps6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1632398833',owner_user_name='tempest-ServerRescueNegativeTestJSON-1632398833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:42:53Z,user_data=None,user_id='abdf772f2c7341c29159b6f1f2ce7ccb',uuid=be3f67e5-420d-42a2-b68a-7cadff22fa48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "943dbed4-3180-4221-b27c-710c0118b7cf", "address": "fa:16:3e:d5:a9:3b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap943dbed4-31", "ovs_interfaceid": "943dbed4-3180-4221-b27c-710c0118b7cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converting VIF {"id": "943dbed4-3180-4221-b27c-710c0118b7cf", "address": "fa:16:3e:d5:a9:3b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap943dbed4-31", "ovs_interfaceid": "943dbed4-3180-4221-b27c-710c0118b7cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a9:3b,bridge_name='br-int',has_traffic_filtering=True,id=943dbed4-3180-4221-b27c-710c0118b7cf,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap943dbed4-31') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG os_vif [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a9:3b,bridge_name='br-int',has_traffic_filtering=True,id=943dbed4-3180-4221-b27c-710c0118b7cf,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap943dbed4-31') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap943dbed4-31, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap943dbed4-31, col_values=(('external_ids', {'iface-id': '943dbed4-3180-4221-b27c-710c0118b7cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:a9:3b', 'vm-uuid': 'be3f67e5-420d-42a2-b68a-7cadff22fa48'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.network.neutron [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Successfully updated port: 580ed46e-ff10-494f-b864-42eda726a7ff {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:55 user nova-compute[71557]: INFO os_vif [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a9:3b,bridge_name='br-int',has_traffic_filtering=True,id=943dbed4-3180-4221-b27c-710c0118b7cf,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap943dbed4-31')
Apr 12 10:42:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "refresh_cache-97bafe22-36bf-4939-baf8-9602551bad52" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquired lock "refresh_cache-97bafe22-36bf-4939-baf8-9602551bad52" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.network.neutron [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] No VIF found with MAC fa:16:3e:d5:a9:3b, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.network.neutron [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.network.neutron [req-24f1b11d-4220-416c-a301-57457c35c994 req-481f4128-667b-44a3-8c5d-f31d09c77a96 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Updated VIF entry in instance network info cache for port 943dbed4-3180-4221-b27c-710c0118b7cf. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.network.neutron [req-24f1b11d-4220-416c-a301-57457c35c994 req-481f4128-667b-44a3-8c5d-f31d09c77a96 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Updating instance_info_cache with network_info: [{"id": "943dbed4-3180-4221-b27c-710c0118b7cf", "address": "fa:16:3e:d5:a9:3b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap943dbed4-31", "ovs_interfaceid": "943dbed4-3180-4221-b27c-710c0118b7cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-24f1b11d-4220-416c-a301-57457c35c994 req-481f4128-667b-44a3-8c5d-f31d09c77a96 service nova] Releasing lock "refresh_cache-be3f67e5-420d-42a2-b68a-7cadff22fa48" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.network.neutron [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Updating instance_info_cache with network_info: [{"id": "580ed46e-ff10-494f-b864-42eda726a7ff", "address": "fa:16:3e:a7:62:8b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580ed46e-ff", "ovs_interfaceid": "580ed46e-ff10-494f-b864-42eda726a7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Releasing lock "refresh_cache-97bafe22-36bf-4939-baf8-9602551bad52" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.compute.manager [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Instance network_info: |[{"id": "580ed46e-ff10-494f-b864-42eda726a7ff", "address": "fa:16:3e:a7:62:8b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580ed46e-ff", "ovs_interfaceid": "580ed46e-ff10-494f-b864-42eda726a7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Start _get_guest_xml network_info=[{"id": "580ed46e-ff10-494f-b864-42eda726a7ff", "address": "fa:16:3e:a7:62:8b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580ed46e-ff", "ovs_interfaceid": "580ed46e-ff10-494f-b864-42eda726a7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:42:55 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:42:55 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-755364809',display_name='tempest-ServerRescueNegativeTestJSON-server-755364809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-755364809',id=23,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b39cd8e55b54a86a7784f2934273e20',ramdisk_id='',reservation_id='r-8rwff9ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1632398833',owner_user_name='tempest-ServerRescueNegativeTestJSON-1632398833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:42:53Z,user_data=None,user_id='abdf772f2c7341c29159b6f1f2ce7ccb',uuid=97bafe22-36bf-4939-baf8-9602551bad52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "580ed46e-ff10-494f-b864-42eda726a7ff", "address": "fa:16:3e:a7:62:8b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580ed46e-ff", "ovs_interfaceid": "580ed46e-ff10-494f-b864-42eda726a7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converting VIF {"id": "580ed46e-ff10-494f-b864-42eda726a7ff", "address": "fa:16:3e:a7:62:8b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580ed46e-ff", "ovs_interfaceid": "580ed46e-ff10-494f-b864-42eda726a7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:62:8b,bridge_name='br-int',has_traffic_filtering=True,id=580ed46e-ff10-494f-b864-42eda726a7ff,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580ed46e-ff') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.objects.instance [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'pci_devices' on Instance uuid 97bafe22-36bf-4939-baf8-9602551bad52 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:42:55 user nova-compute[71557]:   <uuid>97bafe22-36bf-4939-baf8-9602551bad52</uuid>
Apr 12 10:42:55 user nova-compute[71557]:   <name>instance-00000017</name>
Apr 12 10:42:55 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:42:55 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:42:55 user nova-compute[71557]:   <metadata>
Apr 12 10:42:55 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:42:55 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:42:55 user nova-compute[71557]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-755364809</nova:name>
Apr 12 10:42:55 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:42:55</nova:creationTime>
Apr 12 10:42:55 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:42:55 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:42:55 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:42:55 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:42:55 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:42:55 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:42:55 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:42:55 user nova-compute[71557]:       <nova:owner>
Apr 12 10:42:55 user nova-compute[71557]:         <nova:user uuid="abdf772f2c7341c29159b6f1f2ce7ccb">tempest-ServerRescueNegativeTestJSON-1632398833-project-member</nova:user>
Apr 12 10:42:55 user nova-compute[71557]:         <nova:project uuid="2b39cd8e55b54a86a7784f2934273e20">tempest-ServerRescueNegativeTestJSON-1632398833</nova:project>
Apr 12 10:42:55 user nova-compute[71557]:       </nova:owner>
Apr 12 10:42:55 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:42:55 user nova-compute[71557]:       <nova:ports>
Apr 12 10:42:55 user nova-compute[71557]:         <nova:port uuid="580ed46e-ff10-494f-b864-42eda726a7ff">
Apr 12 10:42:55 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 10:42:55 user nova-compute[71557]:         </nova:port>
Apr 12 10:42:55 user nova-compute[71557]:       </nova:ports>
Apr 12 10:42:55 user nova-compute[71557]:     </nova:instance>
Apr 12 10:42:55 user nova-compute[71557]:   </metadata>
Apr 12 10:42:55 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:42:55 user nova-compute[71557]:     <system>
Apr 12 10:42:55 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:42:55 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:42:55 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:42:55 user nova-compute[71557]:       <entry name="serial">97bafe22-36bf-4939-baf8-9602551bad52</entry>
Apr 12 10:42:55 user nova-compute[71557]:       <entry name="uuid">97bafe22-36bf-4939-baf8-9602551bad52</entry>
Apr 12 10:42:55 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:42:55 user nova-compute[71557]:     </system>
Apr 12 10:42:55 user nova-compute[71557]:   </sysinfo>
Apr 12 10:42:55 user nova-compute[71557]:   <os>
Apr 12 10:42:55 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:42:55 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:42:55 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:42:55 user nova-compute[71557]:   </os>
Apr 12 10:42:55 user nova-compute[71557]:   <features>
Apr 12 10:42:55 user nova-compute[71557]:     <acpi/>
Apr 12 10:42:55 user nova-compute[71557]:     <apic/>
Apr 12 10:42:55 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:42:55 user nova-compute[71557]:   </features>
Apr 12 10:42:55 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:42:55 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:42:55 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:42:55 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:42:55 user nova-compute[71557]:   </clock>
Apr 12 10:42:55 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:42:55 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:42:55 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:42:55 user nova-compute[71557]:   </cpu>
Apr 12 10:42:55 user nova-compute[71557]:   <devices>
Apr 12 10:42:55 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:42:55 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:42:55 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk"/>
Apr 12 10:42:55 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:42:55 user nova-compute[71557]:     </disk>
Apr 12 10:42:55 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:42:55 user nova-compute[71557]:       <mac address="fa:16:3e:a7:62:8b"/>
Apr 12 10:42:55 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:42:55 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:42:55 user nova-compute[71557]:       <target dev="tap580ed46e-ff"/>
Apr 12 10:42:55 user nova-compute[71557]:     </interface>
Apr 12 10:42:55 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:42:55 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/console.log" append="off"/>
Apr 12 10:42:55 user nova-compute[71557]:     </serial>
Apr 12 10:42:55 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:42:55 user nova-compute[71557]:     <video>
Apr 12 10:42:55 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:42:55 user nova-compute[71557]:     </video>
Apr 12 10:42:55 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:42:55 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:42:55 user nova-compute[71557]:     </rng>
Apr 12 10:42:55 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:42:55 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:42:55 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:42:55 user nova-compute[71557]:     </memballoon>
Apr 12 10:42:55 user nova-compute[71557]:   </devices>
Apr 12 10:42:55 user nova-compute[71557]: </domain>
Apr 12 10:42:55 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-755364809',display_name='tempest-ServerRescueNegativeTestJSON-server-755364809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-755364809',id=23,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b39cd8e55b54a86a7784f2934273e20',ramdisk_id='',reservation_id='r-8rwff9ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1632398833',owner_user_name='tempest-ServerRescueNegativeTestJSON-1632398833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:42:53Z,user_data=None,user_id='abdf772f2c7341c29159b6f1f2ce7ccb',uuid=97bafe22-36bf-4939-baf8-9602551bad52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "580ed46e-ff10-494f-b864-42eda726a7ff", "address": "fa:16:3e:a7:62:8b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580ed46e-ff", "ovs_interfaceid": "580ed46e-ff10-494f-b864-42eda726a7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converting VIF {"id": "580ed46e-ff10-494f-b864-42eda726a7ff", "address": "fa:16:3e:a7:62:8b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580ed46e-ff", "ovs_interfaceid": "580ed46e-ff10-494f-b864-42eda726a7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:62:8b,bridge_name='br-int',has_traffic_filtering=True,id=580ed46e-ff10-494f-b864-42eda726a7ff,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580ed46e-ff') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG os_vif [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:62:8b,bridge_name='br-int',has_traffic_filtering=True,id=580ed46e-ff10-494f-b864-42eda726a7ff,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580ed46e-ff') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap580ed46e-ff, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap580ed46e-ff, col_values=(('external_ids', {'iface-id': '580ed46e-ff10-494f-b864-42eda726a7ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:62:8b', 'vm-uuid': '97bafe22-36bf-4939-baf8-9602551bad52'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:55 user nova-compute[71557]: INFO os_vif [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:62:8b,bridge_name='br-int',has_traffic_filtering=True,id=580ed46e-ff10-494f-b864-42eda726a7ff,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580ed46e-ff')
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:42:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] No VIF found with MAC fa:16:3e:a7:62:8b, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296176.116839, 4b79f4d7-f34e-4971-8a6f-171c2d71d683 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:42:56 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] VM Resumed (Lifecycle Event)
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.compute.manager [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:42:56 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Instance spawned successfully.
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:42:56 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296176.1204586, 4b79f4d7-f34e-4971-8a6f-171c2d71d683 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:42:56 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] VM Started (Lifecycle Event)
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.compute.manager [req-1f794367-4d52-4af5-9f79-52e6a76a3a06 req-d625bc20-6c99-47c7-a8c3-a13a08fa3530 service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Received event network-vif-plugged-ac9512bb-5122-4a70-b970-f82605ed0606 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-1f794367-4d52-4af5-9f79-52e6a76a3a06 req-d625bc20-6c99-47c7-a8c3-a13a08fa3530 service nova] Acquiring lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-1f794367-4d52-4af5-9f79-52e6a76a3a06 req-d625bc20-6c99-47c7-a8c3-a13a08fa3530 service nova] Lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-1f794367-4d52-4af5-9f79-52e6a76a3a06 req-d625bc20-6c99-47c7-a8c3-a13a08fa3530 service nova] Lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.compute.manager [req-1f794367-4d52-4af5-9f79-52e6a76a3a06 req-d625bc20-6c99-47c7-a8c3-a13a08fa3530 service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] No waiting events found dispatching network-vif-plugged-ac9512bb-5122-4a70-b970-f82605ed0606 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:42:56 user nova-compute[71557]: WARNING nova.compute.manager [req-1f794367-4d52-4af5-9f79-52e6a76a3a06 req-d625bc20-6c99-47c7-a8c3-a13a08fa3530 service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Received unexpected event network-vif-plugged-ac9512bb-5122-4a70-b970-f82605ed0606 for instance with vm_state building and task_state spawning.
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.compute.manager [req-1f794367-4d52-4af5-9f79-52e6a76a3a06 req-d625bc20-6c99-47c7-a8c3-a13a08fa3530 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Received event network-changed-580ed46e-ff10-494f-b864-42eda726a7ff {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.compute.manager [req-1f794367-4d52-4af5-9f79-52e6a76a3a06 req-d625bc20-6c99-47c7-a8c3-a13a08fa3530 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Refreshing instance network info cache due to event network-changed-580ed46e-ff10-494f-b864-42eda726a7ff. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-1f794367-4d52-4af5-9f79-52e6a76a3a06 req-d625bc20-6c99-47c7-a8c3-a13a08fa3530 service nova] Acquiring lock "refresh_cache-97bafe22-36bf-4939-baf8-9602551bad52" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-1f794367-4d52-4af5-9f79-52e6a76a3a06 req-d625bc20-6c99-47c7-a8c3-a13a08fa3530 service nova] Acquired lock "refresh_cache-97bafe22-36bf-4939-baf8-9602551bad52" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.network.neutron [req-1f794367-4d52-4af5-9f79-52e6a76a3a06 req-d625bc20-6c99-47c7-a8c3-a13a08fa3530 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Refreshing network info cache for port 580ed46e-ff10-494f-b864-42eda726a7ff {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:42:56 user nova-compute[71557]: INFO nova.compute.manager [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Took 8.06 seconds to spawn the instance on the hypervisor.
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.compute.manager [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:42:56 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:42:56 user nova-compute[71557]: INFO nova.compute.manager [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Took 8.86 seconds to build instance.
Apr 12 10:42:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8e8c1d8d-aeab-4c33-a620-86cd1f4a0e63 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.949s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.network.neutron [req-1f794367-4d52-4af5-9f79-52e6a76a3a06 req-d625bc20-6c99-47c7-a8c3-a13a08fa3530 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Updated VIF entry in instance network info cache for port 580ed46e-ff10-494f-b864-42eda726a7ff. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG nova.network.neutron [req-1f794367-4d52-4af5-9f79-52e6a76a3a06 req-d625bc20-6c99-47c7-a8c3-a13a08fa3530 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Updating instance_info_cache with network_info: [{"id": "580ed46e-ff10-494f-b864-42eda726a7ff", "address": "fa:16:3e:a7:62:8b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580ed46e-ff", "ovs_interfaceid": "580ed46e-ff10-494f-b864-42eda726a7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:42:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-1f794367-4d52-4af5-9f79-52e6a76a3a06 req-d625bc20-6c99-47c7-a8c3-a13a08fa3530 service nova] Releasing lock "refresh_cache-97bafe22-36bf-4939-baf8-9602551bad52" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:42:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:58 user nova-compute[71557]: DEBUG nova.compute.manager [req-c7f77878-ed36-4191-b667-0d31dc4c0835 req-ae75263d-33e8-4e9a-8bbb-716ccb42155e service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received event network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:42:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c7f77878-ed36-4191-b667-0d31dc4c0835 req-ae75263d-33e8-4e9a-8bbb-716ccb42155e service nova] Acquiring lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c7f77878-ed36-4191-b667-0d31dc4c0835 req-ae75263d-33e8-4e9a-8bbb-716ccb42155e service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c7f77878-ed36-4191-b667-0d31dc4c0835 req-ae75263d-33e8-4e9a-8bbb-716ccb42155e service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:58 user nova-compute[71557]: DEBUG nova.compute.manager [req-c7f77878-ed36-4191-b667-0d31dc4c0835 req-ae75263d-33e8-4e9a-8bbb-716ccb42155e service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] No waiting events found dispatching network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:42:58 user nova-compute[71557]: WARNING nova.compute.manager [req-c7f77878-ed36-4191-b667-0d31dc4c0835 req-ae75263d-33e8-4e9a-8bbb-716ccb42155e service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received unexpected event network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf for instance with vm_state building and task_state spawning.
Apr 12 10:42:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:58 user nova-compute[71557]: DEBUG nova.compute.manager [req-8cb12b4d-a622-436b-88a9-be1f40a15d8a req-96141d36-79c6-4785-ae85-39eceaa14dcc service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Received event network-vif-plugged-580ed46e-ff10-494f-b864-42eda726a7ff {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:42:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8cb12b4d-a622-436b-88a9-be1f40a15d8a req-96141d36-79c6-4785-ae85-39eceaa14dcc service nova] Acquiring lock "97bafe22-36bf-4939-baf8-9602551bad52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:42:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8cb12b4d-a622-436b-88a9-be1f40a15d8a req-96141d36-79c6-4785-ae85-39eceaa14dcc service nova] Lock "97bafe22-36bf-4939-baf8-9602551bad52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:42:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8cb12b4d-a622-436b-88a9-be1f40a15d8a req-96141d36-79c6-4785-ae85-39eceaa14dcc service nova] Lock "97bafe22-36bf-4939-baf8-9602551bad52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:42:58 user nova-compute[71557]: DEBUG nova.compute.manager [req-8cb12b4d-a622-436b-88a9-be1f40a15d8a req-96141d36-79c6-4785-ae85-39eceaa14dcc service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] No waiting events found dispatching network-vif-plugged-580ed46e-ff10-494f-b864-42eda726a7ff {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:42:58 user nova-compute[71557]: WARNING nova.compute.manager [req-8cb12b4d-a622-436b-88a9-be1f40a15d8a req-96141d36-79c6-4785-ae85-39eceaa14dcc service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Received unexpected event network-vif-plugged-580ed46e-ff10-494f-b864-42eda726a7ff for instance with vm_state building and task_state spawning.
Apr 12 10:42:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:42:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-7ce4a7c4-8a00-4270-a598-3872249d7de3 req-9dca20c2-eb1f-43af-8492-2aecc1494eb6 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received event network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7ce4a7c4-8a00-4270-a598-3872249d7de3 req-9dca20c2-eb1f-43af-8492-2aecc1494eb6 service nova] Acquiring lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7ce4a7c4-8a00-4270-a598-3872249d7de3 req-9dca20c2-eb1f-43af-8492-2aecc1494eb6 service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7ce4a7c4-8a00-4270-a598-3872249d7de3 req-9dca20c2-eb1f-43af-8492-2aecc1494eb6 service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-7ce4a7c4-8a00-4270-a598-3872249d7de3 req-9dca20c2-eb1f-43af-8492-2aecc1494eb6 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] No waiting events found dispatching network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:43:00 user nova-compute[71557]: WARNING nova.compute.manager [req-7ce4a7c4-8a00-4270-a598-3872249d7de3 req-9dca20c2-eb1f-43af-8492-2aecc1494eb6 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received unexpected event network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf for instance with vm_state building and task_state spawning.
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-4b63c288-285e-4281-9580-aecf3e748fcf req-3985ae9b-ca49-41b1-a8d0-63a6ec62ffe1 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Received event network-vif-plugged-580ed46e-ff10-494f-b864-42eda726a7ff {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4b63c288-285e-4281-9580-aecf3e748fcf req-3985ae9b-ca49-41b1-a8d0-63a6ec62ffe1 service nova] Acquiring lock "97bafe22-36bf-4939-baf8-9602551bad52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4b63c288-285e-4281-9580-aecf3e748fcf req-3985ae9b-ca49-41b1-a8d0-63a6ec62ffe1 service nova] Lock "97bafe22-36bf-4939-baf8-9602551bad52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4b63c288-285e-4281-9580-aecf3e748fcf req-3985ae9b-ca49-41b1-a8d0-63a6ec62ffe1 service nova] Lock "97bafe22-36bf-4939-baf8-9602551bad52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-4b63c288-285e-4281-9580-aecf3e748fcf req-3985ae9b-ca49-41b1-a8d0-63a6ec62ffe1 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] No waiting events found dispatching network-vif-plugged-580ed46e-ff10-494f-b864-42eda726a7ff {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:43:00 user nova-compute[71557]: WARNING nova.compute.manager [req-4b63c288-285e-4281-9580-aecf3e748fcf req-3985ae9b-ca49-41b1-a8d0-63a6ec62ffe1 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Received unexpected event network-vif-plugged-580ed46e-ff10-494f-b864-42eda726a7ff for instance with vm_state building and task_state spawning.
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296180.7114444, 97bafe22-36bf-4939-baf8-9602551bad52 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:43:00 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] VM Resumed (Lifecycle Event)
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.compute.manager [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.compute.manager [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:43:00 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Instance spawned successfully.
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:43:00 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Instance spawned successfully.
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:43:00 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296180.7127676, 97bafe22-36bf-4939-baf8-9602551bad52 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:43:00 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] VM Started (Lifecycle Event)
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:43:00 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296180.7165043, be3f67e5-420d-42a2-b68a-7cadff22fa48 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:43:00 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] VM Resumed (Lifecycle Event)
Apr 12 10:43:00 user nova-compute[71557]: INFO nova.compute.manager [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Took 7.39 seconds to spawn the instance on the hypervisor.
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.compute.manager [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:43:00 user nova-compute[71557]: INFO nova.compute.manager [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Took 8.25 seconds to spawn the instance on the hypervisor.
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.compute.manager [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:43:00 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296180.7173798, be3f67e5-420d-42a2-b68a-7cadff22fa48 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:43:00 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] VM Started (Lifecycle Event)
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:43:00 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:43:00 user nova-compute[71557]: INFO nova.compute.manager [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Took 8.43 seconds to build instance.
Apr 12 10:43:00 user nova-compute[71557]: INFO nova.compute.manager [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Took 9.15 seconds to build instance.
Apr 12 10:43:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-42bba3f4-2ef5-4a3f-b530-ca184a4394aa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "97bafe22-36bf-4939-baf8-9602551bad52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.546s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7e24d2b5-88f6-4953-9dfc-158c9ec59882 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.270s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:14 user nova-compute[71557]: INFO nova.compute.manager [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Terminating instance
Apr 12 10:43:14 user nova-compute[71557]: DEBUG nova.compute.manager [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:43:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-8ef1b684-2b85-4f20-9f1d-eee85fd1e84f req-d31e5be1-27ec-4406-8d67-6b3ad76e6e78 service nova] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Received event network-vif-unplugged-ad98480a-be93-49cd-8de6-0678546d7f68 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:43:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8ef1b684-2b85-4f20-9f1d-eee85fd1e84f req-d31e5be1-27ec-4406-8d67-6b3ad76e6e78 service nova] Acquiring lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8ef1b684-2b85-4f20-9f1d-eee85fd1e84f req-d31e5be1-27ec-4406-8d67-6b3ad76e6e78 service nova] Lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8ef1b684-2b85-4f20-9f1d-eee85fd1e84f req-d31e5be1-27ec-4406-8d67-6b3ad76e6e78 service nova] Lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-8ef1b684-2b85-4f20-9f1d-eee85fd1e84f req-d31e5be1-27ec-4406-8d67-6b3ad76e6e78 service nova] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] No waiting events found dispatching network-vif-unplugged-ad98480a-be93-49cd-8de6-0678546d7f68 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:43:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-8ef1b684-2b85-4f20-9f1d-eee85fd1e84f req-d31e5be1-27ec-4406-8d67-6b3ad76e6e78 service nova] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Received event network-vif-unplugged-ad98480a-be93-49cd-8de6-0678546d7f68 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:43:15 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Instance destroyed successfully.
Apr 12 10:43:15 user nova-compute[71557]: DEBUG nova.objects.instance [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lazy-loading 'resources' on Instance uuid aec86031-be71-4a8f-a8ad-cf04c506fdb4 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:43:15 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1994532850',display_name='tempest-VolumesActionsTest-instance-1994532850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1994532850',id=18,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:41:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71bb70c871154a14947ea3421553a229',ramdisk_id='',reservation_id='r-d5l9rl26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-715093810',owner_user_name='tempest-VolumesActionsTest-715093810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:41:34Z,user_data=None,user_id='bccad0e37147441cb68130a22197a5d4',uuid=aec86031-be71-4a8f-a8ad-cf04c506fdb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad98480a-be93-49cd-8de6-0678546d7f68", "address": "fa:16:3e:b1:43:2e", "network": {"id": "1b1e97a6-2805-47eb-b62a-777fed79a136", "bridge": "br-int", "label": "tempest-VolumesActionsTest-625847221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "71bb70c871154a14947ea3421553a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad98480a-be", "ovs_interfaceid": "ad98480a-be93-49cd-8de6-0678546d7f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:43:15 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Converting VIF {"id": "ad98480a-be93-49cd-8de6-0678546d7f68", "address": "fa:16:3e:b1:43:2e", "network": {"id": "1b1e97a6-2805-47eb-b62a-777fed79a136", "bridge": "br-int", "label": "tempest-VolumesActionsTest-625847221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "71bb70c871154a14947ea3421553a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad98480a-be", "ovs_interfaceid": "ad98480a-be93-49cd-8de6-0678546d7f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:43:15 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:43:2e,bridge_name='br-int',has_traffic_filtering=True,id=ad98480a-be93-49cd-8de6-0678546d7f68,network=Network(1b1e97a6-2805-47eb-b62a-777fed79a136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad98480a-be') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:43:15 user nova-compute[71557]: DEBUG os_vif [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:43:2e,bridge_name='br-int',has_traffic_filtering=True,id=ad98480a-be93-49cd-8de6-0678546d7f68,network=Network(1b1e97a6-2805-47eb-b62a-777fed79a136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad98480a-be') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:43:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad98480a-be, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:43:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:15 user nova-compute[71557]: INFO os_vif [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:43:2e,bridge_name='br-int',has_traffic_filtering=True,id=ad98480a-be93-49cd-8de6-0678546d7f68,network=Network(1b1e97a6-2805-47eb-b62a-777fed79a136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad98480a-be')
Apr 12 10:43:15 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Deleting instance files /opt/stack/data/nova/instances/aec86031-be71-4a8f-a8ad-cf04c506fdb4_del
Apr 12 10:43:15 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Deletion of /opt/stack/data/nova/instances/aec86031-be71-4a8f-a8ad-cf04c506fdb4_del complete
Apr 12 10:43:15 user nova-compute[71557]: INFO nova.compute.manager [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Took 0.72 seconds to destroy the instance on the hypervisor.
Apr 12 10:43:15 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:43:15 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:43:15 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:43:15 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:43:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-d526a87d-4889-49fc-9470-01a9f62e31aa req-cb0b1bde-0b07-445b-b98e-f541002d5246 service nova] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Received event network-vif-deleted-ad98480a-be93-49cd-8de6-0678546d7f68 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:43:15 user nova-compute[71557]: INFO nova.compute.manager [req-d526a87d-4889-49fc-9470-01a9f62e31aa req-cb0b1bde-0b07-445b-b98e-f541002d5246 service nova] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Neutron deleted interface ad98480a-be93-49cd-8de6-0678546d7f68; detaching it from the instance and deleting it from the info cache
Apr 12 10:43:15 user nova-compute[71557]: DEBUG nova.network.neutron [req-d526a87d-4889-49fc-9470-01a9f62e31aa req-cb0b1bde-0b07-445b-b98e-f541002d5246 service nova] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:43:15 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Took 0.48 seconds to deallocate network for instance.
Apr 12 10:43:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-d526a87d-4889-49fc-9470-01a9f62e31aa req-cb0b1bde-0b07-445b-b98e-f541002d5246 service nova] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Detach interface failed, port_id=ad98480a-be93-49cd-8de6-0678546d7f68, reason: Instance aec86031-be71-4a8f-a8ad-cf04c506fdb4 could not be found. {{(pid=71557) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 10:43:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:16 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:43:16 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:43:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:16 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Deleted allocations for instance aec86031-be71-4a8f-a8ad-cf04c506fdb4
Apr 12 10:43:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-66f9d518-b864-4123-8ff8-38f15f80af0c tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.819s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-950433bc-f892-4514-9ddb-a9c082b7cd35 req-c1a42f15-5611-4072-89d0-fcb55090be3d service nova] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Received event network-vif-plugged-ad98480a-be93-49cd-8de6-0678546d7f68 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:43:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-950433bc-f892-4514-9ddb-a9c082b7cd35 req-c1a42f15-5611-4072-89d0-fcb55090be3d service nova] Acquiring lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-950433bc-f892-4514-9ddb-a9c082b7cd35 req-c1a42f15-5611-4072-89d0-fcb55090be3d service nova] Lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-950433bc-f892-4514-9ddb-a9c082b7cd35 req-c1a42f15-5611-4072-89d0-fcb55090be3d service nova] Lock "aec86031-be71-4a8f-a8ad-cf04c506fdb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-950433bc-f892-4514-9ddb-a9c082b7cd35 req-c1a42f15-5611-4072-89d0-fcb55090be3d service nova] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] No waiting events found dispatching network-vif-plugged-ad98480a-be93-49cd-8de6-0678546d7f68 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:43:16 user nova-compute[71557]: WARNING nova.compute.manager [req-950433bc-f892-4514-9ddb-a9c082b7cd35 req-c1a42f15-5611-4072-89d0-fcb55090be3d service nova] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Received unexpected event network-vif-plugged-ad98480a-be93-49cd-8de6-0678546d7f68 for instance with vm_state deleted and task_state None.
Apr 12 10:43:18 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "7f834736-e836-49d3-b931-83ad82bef8f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "7f834736-e836-49d3-b931-83ad82bef8f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG nova.objects.instance [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lazy-loading 'flavor' on Instance uuid 7f834736-e836-49d3-b931-83ad82bef8f3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:43:19 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Ignoring supplied device name: /dev/vdb
Apr 12 10:43:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "7f834736-e836-49d3-b931-83ad82bef8f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "7f834736-e836-49d3-b931-83ad82bef8f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "7f834736-e836-49d3-b931-83ad82bef8f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:19 user nova-compute[71557]: INFO nova.compute.manager [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Attaching volume 5a60dc03-9e48-4969-bd52-c5702fc098c7 to /dev/vdb
Apr 12 10:43:19 user nova-compute[71557]: DEBUG os_brick.utils [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e68d434-f246-4596-9753-78c014337c8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95bc75a-265b-49ff-b7e7-0ff03b9fad13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3272ac-26e4-4485-b0da-41837499cab6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58ddef7-6046-4758-a6c5-511241ea72ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:43:19 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:43:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5324eb8b-2a2f-4fc0-99bd-ee3d35c76047]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG os_brick.utils [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:43:19 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Updating existing volume attachment record: d36ade51-08de-4c19-9edf-c910f1a0c74a {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:43:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:20 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:43:20 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:43:20 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Rebuilding the list of instances to heal {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 10:43:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-0f55cab4-8530-4be0-a91d-65671f0dccd9" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:43:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-0f55cab4-8530-4be0-a91d-65671f0dccd9" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:43:20 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:43:20 user nova-compute[71557]: DEBUG nova.objects.instance [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lazy-loading 'info_cache' on Instance uuid 0f55cab4-8530-4be0-a91d-65671f0dccd9 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:43:21 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Updating instance_info_cache with network_info: [{"id": "e1506948-cd44-4d78-a019-853199016229", "address": "fa:16:3e:a5:75:17", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1506948-cd", "ovs_interfaceid": "e1506948-cd44-4d78-a019-853199016229", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:43:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-0f55cab4-8530-4be0-a91d-65671f0dccd9" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:43:21 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:43:21 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:43:21 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:43:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:21 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:43:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:43:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:43:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f834736-e836-49d3-b931-83ad82bef8f3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f834736-e836-49d3-b931-83ad82bef8f3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f834736-e836-49d3-b931-83ad82bef8f3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f834736-e836-49d3-b931-83ad82bef8f3/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlVhWKpH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:43:23 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:43:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:43:23 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:43:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:43:23 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55ca192-3d59-41a4-a62b-80d17dc96334]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:43:23 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7952e2-d768-4fc8-89a5-014a5e39ccfc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7] added
Apr 12 10:43:23 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c295b785-309e-4d6c-a6c4-8cd08b606dbe]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ae2c58-0766-4a49-8427-4420bb83f70a]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:43:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dlVhWKpH {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dlVhWKpH" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[044d3a93-571e-4e7d-821e-22cf27c9c058]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dlVhWKpH'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:24 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:43:24 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:43:24 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=7555MB free_disk=26.309551239013672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff589a3e-5013-4df1-923d-ff36bfb7b5e4]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9727e78e-f0e2-4d1f-970d-82978a7f6e99]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:43:24 user nova-compute[71557]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:43:24 user nova-compute[71557]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)
Apr 12 10:43:24 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:43:24 user nova-compute[71557]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:43:24 user nova-compute[71557]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)
Apr 12 10:43:24 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[797b63d0-1b3f-4878-9ab1-cd8ba4c5739c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7, portal: 172.16.0.220,3260]
Apr 12 10:43:24 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7, portal: 172.16.0.220,3260] successful.
Apr 12 10:43:24 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e234255d-6009-4ea9-8a7e-3447e98d49e8]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance dc6eb5d4-d415-4459-a95b-5a470ec66586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 7f834736-e836-49d3-b931-83ad82bef8f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 68b29390-867e-4bf3-bc93-b401f32b130e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0bfafa79-ce40-42f1-9992-10e50734f7fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 97bafe22-36bf-4939-baf8-9602551bad52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c0ad9b-089b-42a8-91a3-7db90799c4c0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:43:24 user nova-compute[71557]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:43:24 user nova-compute[71557]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)
Apr 12 10:43:24 user nova-compute[71557]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 (non-flash)
Apr 12 10:43:24 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:43:24 user nova-compute[71557]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:43:24 user nova-compute[71557]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)
Apr 12 10:43:24 user nova-compute[71557]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 (non-flash)
Apr 12 10:43:24 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.712s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10588fa-5e1c-433e-88ae-012522bed545]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlVhWKpH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:43:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.575s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:25 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.750s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:43:25 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] <== connect_volume: return (1752ms) {'type': 'block', 'scsi_wwn': '23665326437663431', 'path': '/dev/sdd'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:43:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665326437663431', 'path': '/dev/sdd'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:43:25 user nova-compute[71557]: DEBUG nova.objects.instance [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lazy-loading 'flavor' on Instance uuid 7f834736-e836-49d3-b931-83ad82bef8f3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:43:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 10:43:25 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:43:25 user nova-compute[71557]:   <source dev="/dev/sdd"/>
Apr 12 10:43:25 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:43:25 user nova-compute[71557]:   <serial>5a60dc03-9e48-4969-bd52-c5702fc098c7</serial>
Apr 12 10:43:25 user nova-compute[71557]: </disk>
Apr 12 10:43:25 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 10:43:25 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:43:25 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:43:25 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:43:25 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:43:25 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:43:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:43:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:43:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:43:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] No VIF found with MAC fa:16:3e:9e:5b:89, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:43:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-cc21da97-41dc-4aab-abc5-8f55ac295afc tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "7f834736-e836-49d3-b931-83ad82bef8f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.904s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:26 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:43:26 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:43:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:30 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296194.9990547, aec86031-be71-4a8f-a8ad-cf04c506fdb4 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:43:30 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] VM Stopped (Lifecycle Event)
Apr 12 10:43:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-509772f3-db5e-403f-b95c-7b5a9fdf7a82 None None] [instance: aec86031-be71-4a8f-a8ad-cf04c506fdb4] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:43:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:32 user nova-compute[71557]: DEBUG nova.compute.manager [req-a4e15034-70ab-4899-b2e4-7ed77eea29df req-328bfbd0-4be4-482b-bfdd-3ff5e224ac85 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Received event network-changed-78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:43:32 user nova-compute[71557]: DEBUG nova.compute.manager [req-a4e15034-70ab-4899-b2e4-7ed77eea29df req-328bfbd0-4be4-482b-bfdd-3ff5e224ac85 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Refreshing instance network info cache due to event network-changed-78a8426a-653a-44cb-80b7-8a8b14d78cf4. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:43:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a4e15034-70ab-4899-b2e4-7ed77eea29df req-328bfbd0-4be4-482b-bfdd-3ff5e224ac85 service nova] Acquiring lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:43:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a4e15034-70ab-4899-b2e4-7ed77eea29df req-328bfbd0-4be4-482b-bfdd-3ff5e224ac85 service nova] Acquired lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:43:32 user nova-compute[71557]: DEBUG nova.network.neutron [req-a4e15034-70ab-4899-b2e4-7ed77eea29df req-328bfbd0-4be4-482b-bfdd-3ff5e224ac85 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Refreshing network info cache for port 78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:43:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "68b29390-867e-4bf3-bc93-b401f32b130e" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "68b29390-867e-4bf3-bc93-b401f32b130e" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:32 user nova-compute[71557]: INFO nova.compute.manager [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Shelve offloading
Apr 12 10:43:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:32 user nova-compute[71557]: DEBUG nova.compute.manager [req-a6dc9ea9-7e0e-41f9-b689-49149f5a6309 req-48e16da0-6d74-499b-aefd-28381b271046 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Received event network-vif-unplugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:43:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a6dc9ea9-7e0e-41f9-b689-49149f5a6309 req-48e16da0-6d74-499b-aefd-28381b271046 service nova] Acquiring lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a6dc9ea9-7e0e-41f9-b689-49149f5a6309 req-48e16da0-6d74-499b-aefd-28381b271046 service nova] Lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a6dc9ea9-7e0e-41f9-b689-49149f5a6309 req-48e16da0-6d74-499b-aefd-28381b271046 service nova] Lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:32 user nova-compute[71557]: DEBUG nova.compute.manager [req-a6dc9ea9-7e0e-41f9-b689-49149f5a6309 req-48e16da0-6d74-499b-aefd-28381b271046 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] No waiting events found dispatching network-vif-unplugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:43:32 user nova-compute[71557]: WARNING nova.compute.manager [req-a6dc9ea9-7e0e-41f9-b689-49149f5a6309 req-48e16da0-6d74-499b-aefd-28381b271046 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Received unexpected event network-vif-unplugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 for instance with vm_state active and task_state shelving.
Apr 12 10:43:33 user nova-compute[71557]: DEBUG nova.network.neutron [req-a4e15034-70ab-4899-b2e4-7ed77eea29df req-328bfbd0-4be4-482b-bfdd-3ff5e224ac85 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Updated VIF entry in instance network info cache for port 78a8426a-653a-44cb-80b7-8a8b14d78cf4. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:43:33 user nova-compute[71557]: DEBUG nova.network.neutron [req-a4e15034-70ab-4899-b2e4-7ed77eea29df req-328bfbd0-4be4-482b-bfdd-3ff5e224ac85 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Updating instance_info_cache with network_info: [{"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:43:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a4e15034-70ab-4899-b2e4-7ed77eea29df req-328bfbd0-4be4-482b-bfdd-3ff5e224ac85 service nova] Releasing lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:43:33 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Instance destroyed successfully.
Apr 12 10:43:33 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:43:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:43:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquired lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:43:33 user nova-compute[71557]: DEBUG nova.network.neutron [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:43:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG nova.network.neutron [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Updating instance_info_cache with network_info: [{"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Releasing lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG nova.compute.manager [req-bd34793c-1eef-4df8-aaba-bad0d47a8a46 req-e932759d-90b8-4dbc-b745-6f6fb478474a service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Received event network-vif-plugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bd34793c-1eef-4df8-aaba-bad0d47a8a46 req-e932759d-90b8-4dbc-b745-6f6fb478474a service nova] Acquiring lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bd34793c-1eef-4df8-aaba-bad0d47a8a46 req-e932759d-90b8-4dbc-b745-6f6fb478474a service nova] Lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bd34793c-1eef-4df8-aaba-bad0d47a8a46 req-e932759d-90b8-4dbc-b745-6f6fb478474a service nova] Lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG nova.compute.manager [req-bd34793c-1eef-4df8-aaba-bad0d47a8a46 req-e932759d-90b8-4dbc-b745-6f6fb478474a service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] No waiting events found dispatching network-vif-plugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:43:34 user nova-compute[71557]: WARNING nova.compute.manager [req-bd34793c-1eef-4df8-aaba-bad0d47a8a46 req-e932759d-90b8-4dbc-b745-6f6fb478474a service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Received unexpected event network-vif-plugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 for instance with vm_state active and task_state shelving.
Apr 12 10:43:34 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Instance destroyed successfully.
Apr 12 10:43:34 user nova-compute[71557]: DEBUG nova.objects.instance [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lazy-loading 'resources' on Instance uuid 68b29390-867e-4bf3-bc93-b401f32b130e {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:41:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1222922378',display_name='tempest-TestShelveInstance-server-1222922378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1222922378',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOk2UPAom5CjZdHfplY6HjUNzNcB4NEAH+k/X71Ve1S4CsmjYhLiu/vz+zIBK/KpJ2uQiNOTfsgNS8zhPMGpKrvMmQM5PVNKr7l+PqrgS24giNXUhI2aB8tdrnYrhcS2EQ==',key_name='tempest-TestShelveInstance-577615131',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90ef7aa45de34b01a97b6bc5e0acece5',ramdisk_id='',reservation_id='r-yukf9uzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1176962424',owner_user_name='tempest-TestShelveInstance-1176962424-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:41:51Z,user_data=None,user_id='574af27cae41457c9be3d5d50d347b27',uuid=68b29390-867e-4bf3-bc93-b401f32b130e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Converting VIF {"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d2:fe,bridge_name='br-int',has_traffic_filtering=True,id=78a8426a-653a-44cb-80b7-8a8b14d78cf4,network=Network(f87563f2-62e3-4d56-b03a-0a830493f69b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a8426a-65') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG os_vif [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d2:fe,bridge_name='br-int',has_traffic_filtering=True,id=78a8426a-653a-44cb-80b7-8a8b14d78cf4,network=Network(f87563f2-62e3-4d56-b03a-0a830493f69b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a8426a-65') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78a8426a-65, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:43:34 user nova-compute[71557]: INFO os_vif [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d2:fe,bridge_name='br-int',has_traffic_filtering=True,id=78a8426a-653a-44cb-80b7-8a8b14d78cf4,network=Network(f87563f2-62e3-4d56-b03a-0a830493f69b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a8426a-65')
Apr 12 10:43:34 user nova-compute[71557]: DEBUG nova.compute.manager [req-f7d0e612-5903-4029-8e37-9978adab1dcf req-f9202644-c5a4-4f3b-aea2-afd03cba196d service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Received event network-changed-78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG nova.compute.manager [req-f7d0e612-5903-4029-8e37-9978adab1dcf req-f9202644-c5a4-4f3b-aea2-afd03cba196d service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Refreshing instance network info cache due to event network-changed-78a8426a-653a-44cb-80b7-8a8b14d78cf4. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f7d0e612-5903-4029-8e37-9978adab1dcf req-f9202644-c5a4-4f3b-aea2-afd03cba196d service nova] Acquiring lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f7d0e612-5903-4029-8e37-9978adab1dcf req-f9202644-c5a4-4f3b-aea2-afd03cba196d service nova] Acquired lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG nova.network.neutron [req-f7d0e612-5903-4029-8e37-9978adab1dcf req-f9202644-c5a4-4f3b-aea2-afd03cba196d service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Refreshing network info cache for port 78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AuHwQTaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:43:34 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:43:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:43:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bfda2f-1e6b-4d94-9370-7506969fa0a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:43:35 user nova-compute[71557]: No targets found.
Apr 12 10:43:35 user nova-compute[71557]: iSNS:
Apr 12 10:43:35 user nova-compute[71557]: No targets found.
Apr 12 10:43:35 user nova-compute[71557]: STATIC:
Apr 12 10:43:35 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:43:35 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:43:35 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:43:35 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b
Apr 12 10:43:35 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:43:35 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:43:35 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc
Apr 12 10:43:35 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:43:35 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:43:35 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7
Apr 12 10:43:35 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:43:35 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:43:35 user nova-compute[71557]: FIRMWARE:
Apr 12 10:43:35 user nova-compute[71557]: No targets found.
Apr 12 10:43:35 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:43:35 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:43:35 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cd7b24-0359-4f97-9921-5fe6c402bd74]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffce063-6436-46f6-80d7-e8463649452f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:43:35 user nova-compute[71557]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:43:35 user nova-compute[71557]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)
Apr 12 10:43:35 user nova-compute[71557]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 (non-flash)
Apr 12 10:43:35 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:43:35 user nova-compute[71557]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:43:35 user nova-compute[71557]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)
Apr 12 10:43:35 user nova-compute[71557]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 (non-flash)
Apr 12 10:43:35 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fc42edab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b'): ({'sde'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Removing single pathed devices sde {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[17154115-ca39-4fe4-975b-cd97b91925f6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef03ea07-b405-42f5-b8e4-30499bea7f29]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Flushing IO for device /dev/sde {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5aa4fb-f3f2-4336-90ac-0045f86300c0]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d00182-2e6b-4ce0-93fc-9ce6be5ad260]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] SCSI volumes sde have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a6e206-1c43-4865-b9a6-63dbe68b0394]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c756abf6-a20e-4eb0-854c-2b0ee87458fe]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b, portal: 172.16.0.220,3260]
Apr 12 10:43:35 user nova-compute[71557]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b, portal: 172.16.0.220,3260] successful.
Apr 12 10:43:35 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9ccd3f-b0f0-43d7-8211-cdf57b91007c]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] <== disconnect_volume: return (327ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:43:35 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Deleting instance files /opt/stack/data/nova/instances/68b29390-867e-4bf3-bc93-b401f32b130e_del
Apr 12 10:43:35 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Deletion of /opt/stack/data/nova/instances/68b29390-867e-4bf3-bc93-b401f32b130e_del complete
Apr 12 10:43:35 user nova-compute[71557]: DEBUG nova.network.neutron [req-f7d0e612-5903-4029-8e37-9978adab1dcf req-f9202644-c5a4-4f3b-aea2-afd03cba196d service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Updated VIF entry in instance network info cache for port 78a8426a-653a-44cb-80b7-8a8b14d78cf4. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG nova.network.neutron [req-f7d0e612-5903-4029-8e37-9978adab1dcf req-f9202644-c5a4-4f3b-aea2-afd03cba196d service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Updating instance_info_cache with network_info: [{"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": null, "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap78a8426a-65", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:43:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f7d0e612-5903-4029-8e37-9978adab1dcf req-f9202644-c5a4-4f3b-aea2-afd03cba196d service nova] Releasing lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:43:36 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Deleted allocations for instance 68b29390-867e-4bf3-bc93-b401f32b130e
Apr 12 10:43:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:36 user nova-compute[71557]: DEBUG nova.objects.instance [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lazy-loading 'numa_topology' on Instance uuid 68b29390-867e-4bf3-bc93-b401f32b130e {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:43:36 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:43:36 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:43:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e5e18aa-2b8e-4840-a365-873a9f6975be tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "68b29390-867e-4bf3-bc93-b401f32b130e" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.282s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "7f834736-e836-49d3-b931-83ad82bef8f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "7f834736-e836-49d3-b931-83ad82bef8f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:37 user nova-compute[71557]: INFO nova.compute.manager [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Detaching volume 5a60dc03-9e48-4969-bd52-c5702fc098c7
Apr 12 10:43:38 user nova-compute[71557]: INFO nova.virt.block_device [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Attempting to driver detach volume 5a60dc03-9e48-4969-bd52-c5702fc098c7 from mountpoint /dev/vdb
Apr 12 10:43:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Attempting to detach device vdb from instance 7f834736-e836-49d3-b931-83ad82bef8f3 from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:43:38 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:43:38 user nova-compute[71557]:   <source dev="/dev/sdd"/>
Apr 12 10:43:38 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:43:38 user nova-compute[71557]:   <serial>5a60dc03-9e48-4969-bd52-c5702fc098c7</serial>
Apr 12 10:43:38 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:43:38 user nova-compute[71557]: </disk>
Apr 12 10:43:38 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "7f834736-e836-49d3-b931-83ad82bef8f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:38 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Successfully detached device vdb from instance 7f834736-e836-49d3-b931-83ad82bef8f3 from the persistent domain config.
Apr 12 10:43:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7f834736-e836-49d3-b931-83ad82bef8f3 from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:43:38 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:43:38 user nova-compute[71557]:   <source dev="/dev/sdd"/>
Apr 12 10:43:38 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:43:38 user nova-compute[71557]:   <serial>5a60dc03-9e48-4969-bd52-c5702fc098c7</serial>
Apr 12 10:43:38 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:43:38 user nova-compute[71557]: </disk>
Apr 12 10:43:38 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681296218.5496986, 7f834736-e836-49d3-b931-83ad82bef8f3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7f834736-e836-49d3-b931-83ad82bef8f3 {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 10:43:38 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Successfully detached device vdb from instance 7f834736-e836-49d3-b931-83ad82bef8f3 from the live domain config.
Apr 12 10:43:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlVhWKpH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:43:38 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:43:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1695c7-c3f3-44c3-bc27-0b9d952f93aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:43:38 user nova-compute[71557]: No targets found.
Apr 12 10:43:38 user nova-compute[71557]: iSNS:
Apr 12 10:43:38 user nova-compute[71557]: No targets found.
Apr 12 10:43:38 user nova-compute[71557]: STATIC:
Apr 12 10:43:38 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:43:38 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:43:38 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:43:38 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc
Apr 12 10:43:38 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:43:38 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:43:38 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7
Apr 12 10:43:38 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:43:38 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:43:38 user nova-compute[71557]: FIRMWARE:
Apr 12 10:43:38 user nova-compute[71557]: No targets found.
Apr 12 10:43:38 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:43:38 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:43:38 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7cd645-da2a-47f1-91a6-fe257714667b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ad1c50-b4ce-4cd3-883e-aff4dca9efbe]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:43:38 user nova-compute[71557]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)
Apr 12 10:43:38 user nova-compute[71557]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 (non-flash)
Apr 12 10:43:38 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:43:38 user nova-compute[71557]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)
Apr 12 10:43:38 user nova-compute[71557]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 (non-flash)
Apr 12 10:43:38 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd40c7880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7'): ({'sdd'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Removing single pathed devices sdd {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3feaef-fefb-48ee-8d26-2928c5e61197]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[458c3ccc-dd84-41b0-92f9-37128276fe82]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Flushing IO for device /dev/sdd {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f40f2d-ead8-442e-ba92-c98af31b78b8]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5bc6a5-1db2-490a-aad6-ae4d64f6e3e5]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] SCSI volumes sdd have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd33a9f-7000-4b5f-ae30-7d20f5d7690a]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[88801cd5-3c7e-4ff5-8e48-c20e61abef30]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7, portal: 172.16.0.220,3260]
Apr 12 10:43:38 user nova-compute[71557]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7, portal: 172.16.0.220,3260] successful.
Apr 12 10:43:38 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[750cc8c1-3727-4bb4-a023-70690296537b]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] <== disconnect_volume: return (306ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:43:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:43:39 user nova-compute[71557]: DEBUG nova.objects.instance [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lazy-loading 'flavor' on Instance uuid 7f834736-e836-49d3-b931-83ad82bef8f3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:43:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1b92208c-2f34-401f-bcde-203063f260ee tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "7f834736-e836-49d3-b931-83ad82bef8f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.732s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "7f834736-e836-49d3-b931-83ad82bef8f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.622s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "7f834736-e836-49d3-b931-83ad82bef8f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "7f834736-e836-49d3-b931-83ad82bef8f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "7f834736-e836-49d3-b931-83ad82bef8f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:39 user nova-compute[71557]: INFO nova.compute.manager [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Terminating instance
Apr 12 10:43:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:43:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-2223ad87-2bca-4ff1-95ce-3ae5aa60492d req-3a1d56c3-5c02-4f1c-bca1-b57c1ea7929a service nova] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Received event network-vif-unplugged-28905d4a-0e25-4d67-bab4-ee310dd9eea8 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:43:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2223ad87-2bca-4ff1-95ce-3ae5aa60492d req-3a1d56c3-5c02-4f1c-bca1-b57c1ea7929a service nova] Acquiring lock "7f834736-e836-49d3-b931-83ad82bef8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2223ad87-2bca-4ff1-95ce-3ae5aa60492d req-3a1d56c3-5c02-4f1c-bca1-b57c1ea7929a service nova] Lock "7f834736-e836-49d3-b931-83ad82bef8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2223ad87-2bca-4ff1-95ce-3ae5aa60492d req-3a1d56c3-5c02-4f1c-bca1-b57c1ea7929a service nova] Lock "7f834736-e836-49d3-b931-83ad82bef8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-2223ad87-2bca-4ff1-95ce-3ae5aa60492d req-3a1d56c3-5c02-4f1c-bca1-b57c1ea7929a service nova] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] No waiting events found dispatching network-vif-unplugged-28905d4a-0e25-4d67-bab4-ee310dd9eea8 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:43:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-2223ad87-2bca-4ff1-95ce-3ae5aa60492d req-3a1d56c3-5c02-4f1c-bca1-b57c1ea7929a service nova] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Received event network-vif-unplugged-28905d4a-0e25-4d67-bab4-ee310dd9eea8 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:43:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:40 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Instance destroyed successfully.
Apr 12 10:43:40 user nova-compute[71557]: DEBUG nova.objects.instance [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lazy-loading 'resources' on Instance uuid 7f834736-e836-49d3-b931-83ad82bef8f3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:41:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1856542060',display_name='tempest-VolumesSnapshotTestJSON-instance-1856542060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1856542060',id=19,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:41:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16de154a6d344b18a939c6a1b1a679f5',ramdisk_id='',reservation_id='r-zk7z1bow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-858479648',owner_user_name='tempest-VolumesSnapshotTestJSON-858479648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:41:38Z,user_data=None,user_id='2c97c57a3e7142d088e1cf315f5d8d72',uuid=7f834736-e836-49d3-b931-83ad82bef8f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28905d4a-0e25-4d67-bab4-ee310dd9eea8", "address": "fa:16:3e:9e:5b:89", "network": {"id": "a5611852-639c-4e1f-8dbc-cc88bc5651d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1575956045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "16de154a6d344b18a939c6a1b1a679f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28905d4a-0e", "ovs_interfaceid": "28905d4a-0e25-4d67-bab4-ee310dd9eea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Converting VIF {"id": "28905d4a-0e25-4d67-bab4-ee310dd9eea8", "address": "fa:16:3e:9e:5b:89", "network": {"id": "a5611852-639c-4e1f-8dbc-cc88bc5651d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1575956045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "16de154a6d344b18a939c6a1b1a679f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28905d4a-0e", "ovs_interfaceid": "28905d4a-0e25-4d67-bab4-ee310dd9eea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5b:89,bridge_name='br-int',has_traffic_filtering=True,id=28905d4a-0e25-4d67-bab4-ee310dd9eea8,network=Network(a5611852-639c-4e1f-8dbc-cc88bc5651d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28905d4a-0e') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG os_vif [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5b:89,bridge_name='br-int',has_traffic_filtering=True,id=28905d4a-0e25-4d67-bab4-ee310dd9eea8,network=Network(a5611852-639c-4e1f-8dbc-cc88bc5651d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28905d4a-0e') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28905d4a-0e, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:43:40 user nova-compute[71557]: INFO os_vif [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5b:89,bridge_name='br-int',has_traffic_filtering=True,id=28905d4a-0e25-4d67-bab4-ee310dd9eea8,network=Network(a5611852-639c-4e1f-8dbc-cc88bc5651d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28905d4a-0e')
Apr 12 10:43:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlVhWKpH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:43:40 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:43:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d911f6-0b24-4a7f-8fd8-20045c52ed25]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:43:40 user nova-compute[71557]: No targets found.
Apr 12 10:43:40 user nova-compute[71557]: iSNS:
Apr 12 10:43:40 user nova-compute[71557]: No targets found.
Apr 12 10:43:40 user nova-compute[71557]: STATIC:
Apr 12 10:43:40 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:43:40 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:43:40 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:43:40 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc
Apr 12 10:43:40 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:43:40 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:43:40 user nova-compute[71557]: FIRMWARE:
Apr 12 10:43:40 user nova-compute[71557]: No targets found.
Apr 12 10:43:40 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:43:40 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:43:40 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a60dc03-9e48-4969-bd52-c5702fc098c7', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47414b3-0c9d-49ab-b63c-c6ea52454777]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb947525-2cf3-49d8-95e4-5699e376a03b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:43:40 user nova-compute[71557]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)
Apr 12 10:43:40 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:43:40 user nova-compute[71557]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)
Apr 12 10:43:40 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd40bd000>, {}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Disconnecting from: [] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.074s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] <== disconnect_volume: return (77ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:43:40 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Deleting instance files /opt/stack/data/nova/instances/7f834736-e836-49d3-b931-83ad82bef8f3_del
Apr 12 10:43:40 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Deletion of /opt/stack/data/nova/instances/7f834736-e836-49d3-b931-83ad82bef8f3_del complete
Apr 12 10:43:40 user nova-compute[71557]: INFO nova.compute.manager [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Took 1.05 seconds to destroy the instance on the hypervisor.
Apr 12 10:43:40 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:43:40 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:43:41 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:43:41 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Took 0.43 seconds to deallocate network for instance.
Apr 12 10:43:41 user nova-compute[71557]: WARNING nova.volume.cinder [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Attachment d36ade51-08de-4c19-9edf-c910f1a0c74a does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d36ade51-08de-4c19-9edf-c910f1a0c74a. (HTTP 404) (Request-ID: req-689f39f4-a768-4eca-9d02-d1f74890644a)
Apr 12 10:43:41 user nova-compute[71557]: INFO nova.compute.manager [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Took 0.02 seconds to detach 1 volumes for instance.
Apr 12 10:43:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:41 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:43:41 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:43:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:41 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Deleted allocations for instance 7f834736-e836-49d3-b931-83ad82bef8f3
Apr 12 10:43:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9616e5be-8fd5-4552-9e2d-9239ffd9299a tempest-VolumesSnapshotTestJSON-858479648 tempest-VolumesSnapshotTestJSON-858479648-project-member] Lock "7f834736-e836-49d3-b931-83ad82bef8f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.985s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:42 user nova-compute[71557]: DEBUG nova.compute.manager [req-0451c7b4-d797-440d-ab6a-97ff01288eac req-1d1c9da8-1d37-425a-94df-8570f68395ff service nova] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Received event network-vif-plugged-28905d4a-0e25-4d67-bab4-ee310dd9eea8 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:43:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0451c7b4-d797-440d-ab6a-97ff01288eac req-1d1c9da8-1d37-425a-94df-8570f68395ff service nova] Acquiring lock "7f834736-e836-49d3-b931-83ad82bef8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0451c7b4-d797-440d-ab6a-97ff01288eac req-1d1c9da8-1d37-425a-94df-8570f68395ff service nova] Lock "7f834736-e836-49d3-b931-83ad82bef8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0451c7b4-d797-440d-ab6a-97ff01288eac req-1d1c9da8-1d37-425a-94df-8570f68395ff service nova] Lock "7f834736-e836-49d3-b931-83ad82bef8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:42 user nova-compute[71557]: DEBUG nova.compute.manager [req-0451c7b4-d797-440d-ab6a-97ff01288eac req-1d1c9da8-1d37-425a-94df-8570f68395ff service nova] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] No waiting events found dispatching network-vif-plugged-28905d4a-0e25-4d67-bab4-ee310dd9eea8 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:43:42 user nova-compute[71557]: WARNING nova.compute.manager [req-0451c7b4-d797-440d-ab6a-97ff01288eac req-1d1c9da8-1d37-425a-94df-8570f68395ff service nova] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Received unexpected event network-vif-plugged-28905d4a-0e25-4d67-bab4-ee310dd9eea8 for instance with vm_state deleted and task_state None.
Apr 12 10:43:42 user nova-compute[71557]: DEBUG nova.compute.manager [req-0451c7b4-d797-440d-ab6a-97ff01288eac req-1d1c9da8-1d37-425a-94df-8570f68395ff service nova] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Received event network-vif-deleted-28905d4a-0e25-4d67-bab4-ee310dd9eea8 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:43:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:48 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296213.3329453, 68b29390-867e-4bf3-bc93-b401f32b130e => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:43:48 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] VM Stopped (Lifecycle Event)
Apr 12 10:43:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-507a4e19-88b9-483f-a90d-49eda7c5721b None None] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:43:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:55 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296220.4599023, 7f834736-e836-49d3-b931-83ad82bef8f3 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:43:55 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] VM Stopped (Lifecycle Event)
Apr 12 10:43:55 user nova-compute[71557]: DEBUG nova.compute.manager [None req-60b88491-1f45-4e79-8286-bea89f0d3f4e None None] [instance: 7f834736-e836-49d3-b931-83ad82bef8f3] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:43:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:43:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 10:43:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:43:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:43:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:56 user nova-compute[71557]: DEBUG nova.compute.manager [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:43:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:56 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:43:56 user nova-compute[71557]: INFO nova.compute.claims [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Claim successful on node user
Apr 12 10:43:57 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG nova.compute.manager [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG nova.compute.manager [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG nova.network.neutron [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:43:57 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:43:57 user nova-compute[71557]: DEBUG nova.compute.manager [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG nova.policy [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG nova.compute.manager [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:43:57 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Creating image(s)
Apr 12 10:43:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "/opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "/opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "/opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk 1073741824" returned: 0 in 0.061s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:43:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:43:58 user nova-compute[71557]: DEBUG nova.network.neutron [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Successfully created port: ce57bd29-c20b-4373-8e1c-724a3cf51fb0 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:43:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:43:58 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Cannot resize image /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:43:58 user nova-compute[71557]: DEBUG nova.objects.instance [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'migration_context' on Instance uuid dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:43:58 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:43:58 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Ensure instance console log exists: /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:43:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:43:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:43:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:43:58 user nova-compute[71557]: DEBUG nova.network.neutron [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Successfully updated port: ce57bd29-c20b-4373-8e1c-724a3cf51fb0 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:43:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "refresh_cache-dda9c8d0-6b6e-468f-a129-0675aa2cc2d6" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:43:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquired lock "refresh_cache-dda9c8d0-6b6e-468f-a129-0675aa2cc2d6" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:43:58 user nova-compute[71557]: DEBUG nova.network.neutron [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:43:58 user nova-compute[71557]: DEBUG nova.compute.manager [req-b5fb0f7c-afa4-4a68-a86b-cf3a62b5c523 req-06cedd06-3033-4a01-b5e3-9b0bce27a5cd service nova] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Received event network-changed-ce57bd29-c20b-4373-8e1c-724a3cf51fb0 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:43:58 user nova-compute[71557]: DEBUG nova.compute.manager [req-b5fb0f7c-afa4-4a68-a86b-cf3a62b5c523 req-06cedd06-3033-4a01-b5e3-9b0bce27a5cd service nova] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Refreshing instance network info cache due to event network-changed-ce57bd29-c20b-4373-8e1c-724a3cf51fb0. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:43:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b5fb0f7c-afa4-4a68-a86b-cf3a62b5c523 req-06cedd06-3033-4a01-b5e3-9b0bce27a5cd service nova] Acquiring lock "refresh_cache-dda9c8d0-6b6e-468f-a129-0675aa2cc2d6" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:43:58 user nova-compute[71557]: DEBUG nova.network.neutron [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.network.neutron [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Updating instance_info_cache with network_info: [{"id": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0", "address": "fa:16:3e:f5:e0:54", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce57bd29-c2", "ovs_interfaceid": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Releasing lock "refresh_cache-dda9c8d0-6b6e-468f-a129-0675aa2cc2d6" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.compute.manager [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Instance network_info: |[{"id": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0", "address": "fa:16:3e:f5:e0:54", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce57bd29-c2", "ovs_interfaceid": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b5fb0f7c-afa4-4a68-a86b-cf3a62b5c523 req-06cedd06-3033-4a01-b5e3-9b0bce27a5cd service nova] Acquired lock "refresh_cache-dda9c8d0-6b6e-468f-a129-0675aa2cc2d6" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.network.neutron [req-b5fb0f7c-afa4-4a68-a86b-cf3a62b5c523 req-06cedd06-3033-4a01-b5e3-9b0bce27a5cd service nova] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Refreshing network info cache for port ce57bd29-c20b-4373-8e1c-724a3cf51fb0 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Start _get_guest_xml network_info=[{"id": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0", "address": "fa:16:3e:f5:e0:54", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce57bd29-c2", "ovs_interfaceid": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:43:59 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:43:59 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1485644091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1485644091',id=24,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3789b59ccc704f86afac83af21fd84f9',ramdisk_id='',reservation_id='r-r3zcz1a4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:43:57Z,user_data=None,user_id='ba49b947c74e48f3b161b6f9fce8b1c5',uuid=dda9c8d0-6b6e-468f-a129-0675aa2cc2d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0", "address": "fa:16:3e:f5:e0:54", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce57bd29-c2", "ovs_interfaceid": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converting VIF {"id": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0", "address": "fa:16:3e:f5:e0:54", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce57bd29-c2", "ovs_interfaceid": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e0:54,bridge_name='br-int',has_traffic_filtering=True,id=ce57bd29-c20b-4373-8e1c-724a3cf51fb0,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce57bd29-c2') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.objects.instance [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'pci_devices' on Instance uuid dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:43:59 user nova-compute[71557]:   <uuid>dda9c8d0-6b6e-468f-a129-0675aa2cc2d6</uuid>
Apr 12 10:43:59 user nova-compute[71557]:   <name>instance-00000018</name>
Apr 12 10:43:59 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:43:59 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:43:59 user nova-compute[71557]:   <metadata>
Apr 12 10:43:59 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:43:59 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:43:59 user nova-compute[71557]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1485644091</nova:name>
Apr 12 10:43:59 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:43:59</nova:creationTime>
Apr 12 10:43:59 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:43:59 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:43:59 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:43:59 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:43:59 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:43:59 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:43:59 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:43:59 user nova-compute[71557]:       <nova:owner>
Apr 12 10:43:59 user nova-compute[71557]:         <nova:user uuid="ba49b947c74e48f3b161b6f9fce8b1c5">tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member</nova:user>
Apr 12 10:43:59 user nova-compute[71557]:         <nova:project uuid="3789b59ccc704f86afac83af21fd84f9">tempest-ServerBootFromVolumeStableRescueTest-1826285115</nova:project>
Apr 12 10:43:59 user nova-compute[71557]:       </nova:owner>
Apr 12 10:43:59 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:43:59 user nova-compute[71557]:       <nova:ports>
Apr 12 10:43:59 user nova-compute[71557]:         <nova:port uuid="ce57bd29-c20b-4373-8e1c-724a3cf51fb0">
Apr 12 10:43:59 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 10:43:59 user nova-compute[71557]:         </nova:port>
Apr 12 10:43:59 user nova-compute[71557]:       </nova:ports>
Apr 12 10:43:59 user nova-compute[71557]:     </nova:instance>
Apr 12 10:43:59 user nova-compute[71557]:   </metadata>
Apr 12 10:43:59 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:43:59 user nova-compute[71557]:     <system>
Apr 12 10:43:59 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:43:59 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:43:59 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:43:59 user nova-compute[71557]:       <entry name="serial">dda9c8d0-6b6e-468f-a129-0675aa2cc2d6</entry>
Apr 12 10:43:59 user nova-compute[71557]:       <entry name="uuid">dda9c8d0-6b6e-468f-a129-0675aa2cc2d6</entry>
Apr 12 10:43:59 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:43:59 user nova-compute[71557]:     </system>
Apr 12 10:43:59 user nova-compute[71557]:   </sysinfo>
Apr 12 10:43:59 user nova-compute[71557]:   <os>
Apr 12 10:43:59 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:43:59 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:43:59 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:43:59 user nova-compute[71557]:   </os>
Apr 12 10:43:59 user nova-compute[71557]:   <features>
Apr 12 10:43:59 user nova-compute[71557]:     <acpi/>
Apr 12 10:43:59 user nova-compute[71557]:     <apic/>
Apr 12 10:43:59 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:43:59 user nova-compute[71557]:   </features>
Apr 12 10:43:59 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:43:59 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:43:59 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:43:59 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:43:59 user nova-compute[71557]:   </clock>
Apr 12 10:43:59 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:43:59 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:43:59 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:43:59 user nova-compute[71557]:   </cpu>
Apr 12 10:43:59 user nova-compute[71557]:   <devices>
Apr 12 10:43:59 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:43:59 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:43:59 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk"/>
Apr 12 10:43:59 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:43:59 user nova-compute[71557]:     </disk>
Apr 12 10:43:59 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:43:59 user nova-compute[71557]:       <mac address="fa:16:3e:f5:e0:54"/>
Apr 12 10:43:59 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:43:59 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:43:59 user nova-compute[71557]:       <target dev="tapce57bd29-c2"/>
Apr 12 10:43:59 user nova-compute[71557]:     </interface>
Apr 12 10:43:59 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:43:59 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/console.log" append="off"/>
Apr 12 10:43:59 user nova-compute[71557]:     </serial>
Apr 12 10:43:59 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:43:59 user nova-compute[71557]:     <video>
Apr 12 10:43:59 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:43:59 user nova-compute[71557]:     </video>
Apr 12 10:43:59 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:43:59 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:43:59 user nova-compute[71557]:     </rng>
Apr 12 10:43:59 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:43:59 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:43:59 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:43:59 user nova-compute[71557]:     </memballoon>
Apr 12 10:43:59 user nova-compute[71557]:   </devices>
Apr 12 10:43:59 user nova-compute[71557]: </domain>
Apr 12 10:43:59 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1485644091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1485644091',id=24,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3789b59ccc704f86afac83af21fd84f9',ramdisk_id='',reservation_id='r-r3zcz1a4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:43:57Z,user_data=None,user_id='ba49b947c74e48f3b161b6f9fce8b1c5',uuid=dda9c8d0-6b6e-468f-a129-0675aa2cc2d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0", "address": "fa:16:3e:f5:e0:54", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce57bd29-c2", "ovs_interfaceid": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converting VIF {"id": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0", "address": "fa:16:3e:f5:e0:54", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce57bd29-c2", "ovs_interfaceid": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e0:54,bridge_name='br-int',has_traffic_filtering=True,id=ce57bd29-c20b-4373-8e1c-724a3cf51fb0,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce57bd29-c2') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG os_vif [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e0:54,bridge_name='br-int',has_traffic_filtering=True,id=ce57bd29-c20b-4373-8e1c-724a3cf51fb0,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce57bd29-c2') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce57bd29-c2, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce57bd29-c2, col_values=(('external_ids', {'iface-id': 'ce57bd29-c20b-4373-8e1c-724a3cf51fb0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:e0:54', 'vm-uuid': 'dda9c8d0-6b6e-468f-a129-0675aa2cc2d6'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:43:59 user nova-compute[71557]: INFO os_vif [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e0:54,bridge_name='br-int',has_traffic_filtering=True,id=ce57bd29-c20b-4373-8e1c-724a3cf51fb0,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce57bd29-c2')
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] No VIF found with MAC fa:16:3e:f5:e0:54, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.network.neutron [req-b5fb0f7c-afa4-4a68-a86b-cf3a62b5c523 req-06cedd06-3033-4a01-b5e3-9b0bce27a5cd service nova] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Updated VIF entry in instance network info cache for port ce57bd29-c20b-4373-8e1c-724a3cf51fb0. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG nova.network.neutron [req-b5fb0f7c-afa4-4a68-a86b-cf3a62b5c523 req-06cedd06-3033-4a01-b5e3-9b0bce27a5cd service nova] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Updating instance_info_cache with network_info: [{"id": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0", "address": "fa:16:3e:f5:e0:54", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce57bd29-c2", "ovs_interfaceid": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:43:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b5fb0f7c-afa4-4a68-a86b-cf3a62b5c523 req-06cedd06-3033-4a01-b5e3-9b0bce27a5cd service nova] Releasing lock "refresh_cache-dda9c8d0-6b6e-468f-a129-0675aa2cc2d6" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:44:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-a75f878a-ca06-4eee-9f62-b17ec5b3abd9 req-a3da756c-14c5-4f15-a754-dbe2e81090b2 service nova] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Received event network-vif-plugged-ce57bd29-c20b-4373-8e1c-724a3cf51fb0 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:44:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a75f878a-ca06-4eee-9f62-b17ec5b3abd9 req-a3da756c-14c5-4f15-a754-dbe2e81090b2 service nova] Acquiring lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a75f878a-ca06-4eee-9f62-b17ec5b3abd9 req-a3da756c-14c5-4f15-a754-dbe2e81090b2 service nova] Lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a75f878a-ca06-4eee-9f62-b17ec5b3abd9 req-a3da756c-14c5-4f15-a754-dbe2e81090b2 service nova] Lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-a75f878a-ca06-4eee-9f62-b17ec5b3abd9 req-a3da756c-14c5-4f15-a754-dbe2e81090b2 service nova] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] No waiting events found dispatching network-vif-plugged-ce57bd29-c20b-4373-8e1c-724a3cf51fb0 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:44:00 user nova-compute[71557]: WARNING nova.compute.manager [req-a75f878a-ca06-4eee-9f62-b17ec5b3abd9 req-a3da756c-14c5-4f15-a754-dbe2e81090b2 service nova] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Received unexpected event network-vif-plugged-ce57bd29-c20b-4373-8e1c-724a3cf51fb0 for instance with vm_state building and task_state spawning.
Apr 12 10:44:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:02 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296242.7730236, dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:44:02 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] VM Resumed (Lifecycle Event)
Apr 12 10:44:02 user nova-compute[71557]: DEBUG nova.compute.manager [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:44:02 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:44:02 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Instance spawned successfully.
Apr 12 10:44:02 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:44:02 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:44:02 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:44:02 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:44:02 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:44:02 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:44:02 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:44:02 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:44:02 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:44:02 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:44:02 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296242.7744675, dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:44:02 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] VM Started (Lifecycle Event)
Apr 12 10:44:02 user nova-compute[71557]: DEBUG nova.compute.manager [req-e6e52644-f094-4262-8f5a-e052ef4f7fd6 req-efb93410-c6fa-4977-88c4-6420b54e2a6d service nova] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Received event network-vif-plugged-ce57bd29-c20b-4373-8e1c-724a3cf51fb0 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:44:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e6e52644-f094-4262-8f5a-e052ef4f7fd6 req-efb93410-c6fa-4977-88c4-6420b54e2a6d service nova] Acquiring lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e6e52644-f094-4262-8f5a-e052ef4f7fd6 req-efb93410-c6fa-4977-88c4-6420b54e2a6d service nova] Lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e6e52644-f094-4262-8f5a-e052ef4f7fd6 req-efb93410-c6fa-4977-88c4-6420b54e2a6d service nova] Lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:02 user nova-compute[71557]: DEBUG nova.compute.manager [req-e6e52644-f094-4262-8f5a-e052ef4f7fd6 req-efb93410-c6fa-4977-88c4-6420b54e2a6d service nova] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] No waiting events found dispatching network-vif-plugged-ce57bd29-c20b-4373-8e1c-724a3cf51fb0 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:44:02 user nova-compute[71557]: WARNING nova.compute.manager [req-e6e52644-f094-4262-8f5a-e052ef4f7fd6 req-efb93410-c6fa-4977-88c4-6420b54e2a6d service nova] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Received unexpected event network-vif-plugged-ce57bd29-c20b-4373-8e1c-724a3cf51fb0 for instance with vm_state building and task_state spawning.
Apr 12 10:44:02 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:44:02 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:44:02 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:44:02 user nova-compute[71557]: INFO nova.compute.manager [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Took 5.43 seconds to spawn the instance on the hypervisor.
Apr 12 10:44:02 user nova-compute[71557]: DEBUG nova.compute.manager [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:44:03 user nova-compute[71557]: INFO nova.compute.manager [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Took 6.25 seconds to build instance.
Apr 12 10:44:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-93239b5b-dbc8-46e8-971a-f7bbbea59c45 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.358s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "6468f2a7-ce19-468d-8b8f-e6071cf437ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "6468f2a7-ce19-468d-8b8f-e6071cf437ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:05 user nova-compute[71557]: DEBUG nova.compute.manager [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:44:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:05 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:44:05 user nova-compute[71557]: INFO nova.compute.claims [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Claim successful on node user
Apr 12 10:44:06 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:44:06 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:44:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:06 user nova-compute[71557]: DEBUG nova.compute.manager [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:44:06 user nova-compute[71557]: DEBUG nova.compute.manager [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:44:06 user nova-compute[71557]: DEBUG nova.network.neutron [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:44:06 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:44:06 user nova-compute[71557]: DEBUG nova.compute.manager [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:44:06 user nova-compute[71557]: DEBUG nova.policy [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bccad0e37147441cb68130a22197a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bb70c871154a14947ea3421553a229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:44:06 user nova-compute[71557]: DEBUG nova.compute.manager [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:44:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:44:06 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Creating image(s)
Apr 12 10:44:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "/opt/stack/data/nova/instances/6468f2a7-ce19-468d-8b8f-e6071cf437ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "/opt/stack/data/nova/instances/6468f2a7-ce19-468d-8b8f-e6071cf437ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "/opt/stack/data/nova/instances/6468f2a7-ce19-468d-8b8f-e6071cf437ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.154s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.159s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/6468f2a7-ce19-468d-8b8f-e6071cf437ff/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/6468f2a7-ce19-468d-8b8f-e6071cf437ff/disk 1073741824" returned: 0 in 0.053s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:07 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6468f2a7-ce19-468d-8b8f-e6071cf437ff/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:44:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6468f2a7-ce19-468d-8b8f-e6071cf437ff/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6468f2a7-ce19-468d-8b8f-e6071cf437ff/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:07 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Cannot resize image /opt/stack/data/nova/instances/6468f2a7-ce19-468d-8b8f-e6071cf437ff/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:44:07 user nova-compute[71557]: DEBUG nova.objects.instance [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lazy-loading 'migration_context' on Instance uuid 6468f2a7-ce19-468d-8b8f-e6071cf437ff {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:44:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:44:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Ensure instance console log exists: /opt/stack/data/nova/instances/6468f2a7-ce19-468d-8b8f-e6071cf437ff/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:44:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:07 user nova-compute[71557]: DEBUG nova.network.neutron [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Successfully created port: 2970d881-0a68-41b7-a58c-1876abba1236 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.network.neutron [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Successfully updated port: 2970d881-0a68-41b7-a58c-1876abba1236 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "refresh_cache-6468f2a7-ce19-468d-8b8f-e6071cf437ff" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquired lock "refresh_cache-6468f2a7-ce19-468d-8b8f-e6071cf437ff" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.network.neutron [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.compute.manager [req-db8bd8d9-306c-42d0-9e7c-6bf4af8e767f req-9db0f9b0-0c3d-4d4d-8a51-9b7caacb3c4d service nova] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Received event network-changed-2970d881-0a68-41b7-a58c-1876abba1236 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.compute.manager [req-db8bd8d9-306c-42d0-9e7c-6bf4af8e767f req-9db0f9b0-0c3d-4d4d-8a51-9b7caacb3c4d service nova] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Refreshing instance network info cache due to event network-changed-2970d881-0a68-41b7-a58c-1876abba1236. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-db8bd8d9-306c-42d0-9e7c-6bf4af8e767f req-9db0f9b0-0c3d-4d4d-8a51-9b7caacb3c4d service nova] Acquiring lock "refresh_cache-6468f2a7-ce19-468d-8b8f-e6071cf437ff" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.network.neutron [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.network.neutron [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Updating instance_info_cache with network_info: [{"id": "2970d881-0a68-41b7-a58c-1876abba1236", "address": "fa:16:3e:7a:10:3f", "network": {"id": "1b1e97a6-2805-47eb-b62a-777fed79a136", "bridge": "br-int", "label": "tempest-VolumesActionsTest-625847221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "71bb70c871154a14947ea3421553a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2970d881-0a", "ovs_interfaceid": "2970d881-0a68-41b7-a58c-1876abba1236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Releasing lock "refresh_cache-6468f2a7-ce19-468d-8b8f-e6071cf437ff" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.compute.manager [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Instance network_info: |[{"id": "2970d881-0a68-41b7-a58c-1876abba1236", "address": "fa:16:3e:7a:10:3f", "network": {"id": "1b1e97a6-2805-47eb-b62a-777fed79a136", "bridge": "br-int", "label": "tempest-VolumesActionsTest-625847221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "71bb70c871154a14947ea3421553a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2970d881-0a", "ovs_interfaceid": "2970d881-0a68-41b7-a58c-1876abba1236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-db8bd8d9-306c-42d0-9e7c-6bf4af8e767f req-9db0f9b0-0c3d-4d4d-8a51-9b7caacb3c4d service nova] Acquired lock "refresh_cache-6468f2a7-ce19-468d-8b8f-e6071cf437ff" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.network.neutron [req-db8bd8d9-306c-42d0-9e7c-6bf4af8e767f req-9db0f9b0-0c3d-4d4d-8a51-9b7caacb3c4d service nova] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Refreshing network info cache for port 2970d881-0a68-41b7-a58c-1876abba1236 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Start _get_guest_xml network_info=[{"id": "2970d881-0a68-41b7-a58c-1876abba1236", "address": "fa:16:3e:7a:10:3f", "network": {"id": "1b1e97a6-2805-47eb-b62a-777fed79a136", "bridge": "br-int", "label": "tempest-VolumesActionsTest-625847221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "71bb70c871154a14947ea3421553a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2970d881-0a", "ovs_interfaceid": "2970d881-0a68-41b7-a58c-1876abba1236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:44:08 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:44:08 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1626749449',display_name='tempest-VolumesActionsTest-instance-1626749449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1626749449',id=25,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71bb70c871154a14947ea3421553a229',ramdisk_id='',reservation_id='r-0wpproza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-715093810',owner_user_name='tempest-VolumesActionsTest-715093810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:44:07Z,user_data=None,user_id='bccad0e37147441cb68130a22197a5d4',uuid=6468f2a7-ce19-468d-8b8f-e6071cf437ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2970d881-0a68-41b7-a58c-1876abba1236", "address": "fa:16:3e:7a:10:3f", "network": {"id": "1b1e97a6-2805-47eb-b62a-777fed79a136", "bridge": "br-int", "label": "tempest-VolumesActionsTest-625847221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "71bb70c871154a14947ea3421553a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2970d881-0a", "ovs_interfaceid": "2970d881-0a68-41b7-a58c-1876abba1236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Converting VIF {"id": "2970d881-0a68-41b7-a58c-1876abba1236", "address": "fa:16:3e:7a:10:3f", "network": {"id": "1b1e97a6-2805-47eb-b62a-777fed79a136", "bridge": "br-int", "label": "tempest-VolumesActionsTest-625847221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "71bb70c871154a14947ea3421553a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2970d881-0a", "ovs_interfaceid": "2970d881-0a68-41b7-a58c-1876abba1236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:3f,bridge_name='br-int',has_traffic_filtering=True,id=2970d881-0a68-41b7-a58c-1876abba1236,network=Network(1b1e97a6-2805-47eb-b62a-777fed79a136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2970d881-0a') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.objects.instance [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lazy-loading 'pci_devices' on Instance uuid 6468f2a7-ce19-468d-8b8f-e6071cf437ff {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:44:08 user nova-compute[71557]:   <uuid>6468f2a7-ce19-468d-8b8f-e6071cf437ff</uuid>
Apr 12 10:44:08 user nova-compute[71557]:   <name>instance-00000019</name>
Apr 12 10:44:08 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:44:08 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:44:08 user nova-compute[71557]:   <metadata>
Apr 12 10:44:08 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:44:08 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:44:08 user nova-compute[71557]:       <nova:name>tempest-VolumesActionsTest-instance-1626749449</nova:name>
Apr 12 10:44:08 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:44:08</nova:creationTime>
Apr 12 10:44:08 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:44:08 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:44:08 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:44:08 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:44:08 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:44:08 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:44:08 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:44:08 user nova-compute[71557]:       <nova:owner>
Apr 12 10:44:08 user nova-compute[71557]:         <nova:user uuid="bccad0e37147441cb68130a22197a5d4">tempest-VolumesActionsTest-715093810-project-member</nova:user>
Apr 12 10:44:08 user nova-compute[71557]:         <nova:project uuid="71bb70c871154a14947ea3421553a229">tempest-VolumesActionsTest-715093810</nova:project>
Apr 12 10:44:08 user nova-compute[71557]:       </nova:owner>
Apr 12 10:44:08 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:44:08 user nova-compute[71557]:       <nova:ports>
Apr 12 10:44:08 user nova-compute[71557]:         <nova:port uuid="2970d881-0a68-41b7-a58c-1876abba1236">
Apr 12 10:44:08 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 10:44:08 user nova-compute[71557]:         </nova:port>
Apr 12 10:44:08 user nova-compute[71557]:       </nova:ports>
Apr 12 10:44:08 user nova-compute[71557]:     </nova:instance>
Apr 12 10:44:08 user nova-compute[71557]:   </metadata>
Apr 12 10:44:08 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:44:08 user nova-compute[71557]:     <system>
Apr 12 10:44:08 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:44:08 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:44:08 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:44:08 user nova-compute[71557]:       <entry name="serial">6468f2a7-ce19-468d-8b8f-e6071cf437ff</entry>
Apr 12 10:44:08 user nova-compute[71557]:       <entry name="uuid">6468f2a7-ce19-468d-8b8f-e6071cf437ff</entry>
Apr 12 10:44:08 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:44:08 user nova-compute[71557]:     </system>
Apr 12 10:44:08 user nova-compute[71557]:   </sysinfo>
Apr 12 10:44:08 user nova-compute[71557]:   <os>
Apr 12 10:44:08 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:44:08 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:44:08 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:44:08 user nova-compute[71557]:   </os>
Apr 12 10:44:08 user nova-compute[71557]:   <features>
Apr 12 10:44:08 user nova-compute[71557]:     <acpi/>
Apr 12 10:44:08 user nova-compute[71557]:     <apic/>
Apr 12 10:44:08 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:44:08 user nova-compute[71557]:   </features>
Apr 12 10:44:08 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:44:08 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:44:08 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:44:08 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:44:08 user nova-compute[71557]:   </clock>
Apr 12 10:44:08 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:44:08 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:44:08 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:44:08 user nova-compute[71557]:   </cpu>
Apr 12 10:44:08 user nova-compute[71557]:   <devices>
Apr 12 10:44:08 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:44:08 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:44:08 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/6468f2a7-ce19-468d-8b8f-e6071cf437ff/disk"/>
Apr 12 10:44:08 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:44:08 user nova-compute[71557]:     </disk>
Apr 12 10:44:08 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:44:08 user nova-compute[71557]:       <mac address="fa:16:3e:7a:10:3f"/>
Apr 12 10:44:08 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:44:08 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:44:08 user nova-compute[71557]:       <target dev="tap2970d881-0a"/>
Apr 12 10:44:08 user nova-compute[71557]:     </interface>
Apr 12 10:44:08 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:44:08 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/6468f2a7-ce19-468d-8b8f-e6071cf437ff/console.log" append="off"/>
Apr 12 10:44:08 user nova-compute[71557]:     </serial>
Apr 12 10:44:08 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:44:08 user nova-compute[71557]:     <video>
Apr 12 10:44:08 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:44:08 user nova-compute[71557]:     </video>
Apr 12 10:44:08 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:44:08 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:44:08 user nova-compute[71557]:     </rng>
Apr 12 10:44:08 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:44:08 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:44:08 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:44:08 user nova-compute[71557]:     </memballoon>
Apr 12 10:44:08 user nova-compute[71557]:   </devices>
Apr 12 10:44:08 user nova-compute[71557]: </domain>
Apr 12 10:44:08 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1626749449',display_name='tempest-VolumesActionsTest-instance-1626749449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1626749449',id=25,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71bb70c871154a14947ea3421553a229',ramdisk_id='',reservation_id='r-0wpproza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-715093810',owner_user_name='tempest-VolumesActionsTest-715093810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:44:07Z,user_data=None,user_id='bccad0e37147441cb68130a22197a5d4',uuid=6468f2a7-ce19-468d-8b8f-e6071cf437ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2970d881-0a68-41b7-a58c-1876abba1236", "address": "fa:16:3e:7a:10:3f", "network": {"id": "1b1e97a6-2805-47eb-b62a-777fed79a136", "bridge": "br-int", "label": "tempest-VolumesActionsTest-625847221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "71bb70c871154a14947ea3421553a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2970d881-0a", "ovs_interfaceid": "2970d881-0a68-41b7-a58c-1876abba1236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Converting VIF {"id": "2970d881-0a68-41b7-a58c-1876abba1236", "address": "fa:16:3e:7a:10:3f", "network": {"id": "1b1e97a6-2805-47eb-b62a-777fed79a136", "bridge": "br-int", "label": "tempest-VolumesActionsTest-625847221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "71bb70c871154a14947ea3421553a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2970d881-0a", "ovs_interfaceid": "2970d881-0a68-41b7-a58c-1876abba1236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:3f,bridge_name='br-int',has_traffic_filtering=True,id=2970d881-0a68-41b7-a58c-1876abba1236,network=Network(1b1e97a6-2805-47eb-b62a-777fed79a136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2970d881-0a') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG os_vif [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:3f,bridge_name='br-int',has_traffic_filtering=True,id=2970d881-0a68-41b7-a58c-1876abba1236,network=Network(1b1e97a6-2805-47eb-b62a-777fed79a136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2970d881-0a') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2970d881-0a, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2970d881-0a, col_values=(('external_ids', {'iface-id': '2970d881-0a68-41b7-a58c-1876abba1236', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:10:3f', 'vm-uuid': '6468f2a7-ce19-468d-8b8f-e6071cf437ff'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:08 user nova-compute[71557]: INFO os_vif [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:3f,bridge_name='br-int',has_traffic_filtering=True,id=2970d881-0a68-41b7-a58c-1876abba1236,network=Network(1b1e97a6-2805-47eb-b62a-777fed79a136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2970d881-0a')
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:44:08 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] No VIF found with MAC fa:16:3e:7a:10:3f, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG nova.network.neutron [req-db8bd8d9-306c-42d0-9e7c-6bf4af8e767f req-9db0f9b0-0c3d-4d4d-8a51-9b7caacb3c4d service nova] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Updated VIF entry in instance network info cache for port 2970d881-0a68-41b7-a58c-1876abba1236. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG nova.network.neutron [req-db8bd8d9-306c-42d0-9e7c-6bf4af8e767f req-9db0f9b0-0c3d-4d4d-8a51-9b7caacb3c4d service nova] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Updating instance_info_cache with network_info: [{"id": "2970d881-0a68-41b7-a58c-1876abba1236", "address": "fa:16:3e:7a:10:3f", "network": {"id": "1b1e97a6-2805-47eb-b62a-777fed79a136", "bridge": "br-int", "label": "tempest-VolumesActionsTest-625847221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "71bb70c871154a14947ea3421553a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2970d881-0a", "ovs_interfaceid": "2970d881-0a68-41b7-a58c-1876abba1236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-db8bd8d9-306c-42d0-9e7c-6bf4af8e767f req-9db0f9b0-0c3d-4d4d-8a51-9b7caacb3c4d service nova] Releasing lock "refresh_cache-6468f2a7-ce19-468d-8b8f-e6071cf437ff" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG nova.objects.instance [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'flavor' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:09 user nova-compute[71557]: INFO nova.compute.manager [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Attaching volume 84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 to /dev/vdb
Apr 12 10:44:09 user nova-compute[71557]: DEBUG os_brick.utils [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccd5f86-9acf-4b1c-bec1-64f8092fe1d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa189bf4-8b2c-48d4-a797-547a7b82e95b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6d025f-4946-4f72-b324-070b311d8f0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[811f9d7f-5545-4de4-8e75-9a955593d6ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:44:09 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:44:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8470830-8cb6-4e92-929c-622d091ac5fe]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG os_brick.utils [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:44:09 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Updating existing volume attachment record: 13dc6c74-b023-49ab-ab60-14d3daa6a48f {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:44:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:10 user nova-compute[71557]: DEBUG nova.compute.manager [req-cbdba9e1-c992-4153-8573-50b9faa7573e req-f9dae36e-0fe9-41c6-8b41-bd6d15455b26 service nova] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Received event network-vif-plugged-2970d881-0a68-41b7-a58c-1876abba1236 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:44:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cbdba9e1-c992-4153-8573-50b9faa7573e req-f9dae36e-0fe9-41c6-8b41-bd6d15455b26 service nova] Acquiring lock "6468f2a7-ce19-468d-8b8f-e6071cf437ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cbdba9e1-c992-4153-8573-50b9faa7573e req-f9dae36e-0fe9-41c6-8b41-bd6d15455b26 service nova] Lock "6468f2a7-ce19-468d-8b8f-e6071cf437ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cbdba9e1-c992-4153-8573-50b9faa7573e req-f9dae36e-0fe9-41c6-8b41-bd6d15455b26 service nova] Lock "6468f2a7-ce19-468d-8b8f-e6071cf437ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:10 user nova-compute[71557]: DEBUG nova.compute.manager [req-cbdba9e1-c992-4153-8573-50b9faa7573e req-f9dae36e-0fe9-41c6-8b41-bd6d15455b26 service nova] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] No waiting events found dispatching network-vif-plugged-2970d881-0a68-41b7-a58c-1876abba1236 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:44:10 user nova-compute[71557]: WARNING nova.compute.manager [req-cbdba9e1-c992-4153-8573-50b9faa7573e req-f9dae36e-0fe9-41c6-8b41-bd6d15455b26 service nova] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Received unexpected event network-vif-plugged-2970d881-0a68-41b7-a58c-1876abba1236 for instance with vm_state building and task_state spawning.
Apr 12 10:44:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-3020f423-b639-4073-a9fb-b8f31452abde req-8cb137d7-42da-4335-b7b3-ba20e9aa3291 service nova] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Received event network-vif-plugged-2970d881-0a68-41b7-a58c-1876abba1236 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:44:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3020f423-b639-4073-a9fb-b8f31452abde req-8cb137d7-42da-4335-b7b3-ba20e9aa3291 service nova] Acquiring lock "6468f2a7-ce19-468d-8b8f-e6071cf437ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3020f423-b639-4073-a9fb-b8f31452abde req-8cb137d7-42da-4335-b7b3-ba20e9aa3291 service nova] Lock "6468f2a7-ce19-468d-8b8f-e6071cf437ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3020f423-b639-4073-a9fb-b8f31452abde req-8cb137d7-42da-4335-b7b3-ba20e9aa3291 service nova] Lock "6468f2a7-ce19-468d-8b8f-e6071cf437ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-3020f423-b639-4073-a9fb-b8f31452abde req-8cb137d7-42da-4335-b7b3-ba20e9aa3291 service nova] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] No waiting events found dispatching network-vif-plugged-2970d881-0a68-41b7-a58c-1876abba1236 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:44:12 user nova-compute[71557]: WARNING nova.compute.manager [req-3020f423-b639-4073-a9fb-b8f31452abde req-8cb137d7-42da-4335-b7b3-ba20e9aa3291 service nova] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Received unexpected event network-vif-plugged-2970d881-0a68-41b7-a58c-1876abba1236 for instance with vm_state building and task_state spawning.
Apr 12 10:44:12 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296252.6144867, 6468f2a7-ce19-468d-8b8f-e6071cf437ff => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:44:12 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] VM Resumed (Lifecycle Event)
Apr 12 10:44:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:44:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:44:12 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Instance spawned successfully.
Apr 12 10:44:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:44:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:44:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:44:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:44:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:44:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:44:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:44:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:44:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:44:12 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:44:12 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296252.6194372, 6468f2a7-ce19-468d-8b8f-e6071cf437ff => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:44:12 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] VM Started (Lifecycle Event)
Apr 12 10:44:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:44:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:44:12 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:44:12 user nova-compute[71557]: INFO nova.compute.manager [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Took 6.13 seconds to spawn the instance on the hypervisor.
Apr 12 10:44:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:44:12 user nova-compute[71557]: INFO nova.compute.manager [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Took 6.95 seconds to build instance.
Apr 12 10:44:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d5a3836d-b942-4115-babe-df0caa3d41ae tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "6468f2a7-ce19-468d-8b8f-e6071cf437ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.060s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "dc6eb5d4-d415-4459-a95b-5a470ec66586" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "dc6eb5d4-d415-4459-a95b-5a470ec66586" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "dc6eb5d4-d415-4459-a95b-5a470ec66586-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "dc6eb5d4-d415-4459-a95b-5a470ec66586-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "dc6eb5d4-d415-4459-a95b-5a470ec66586-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:14 user nova-compute[71557]: INFO nova.compute.manager [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Terminating instance
Apr 12 10:44:14 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNTjbEai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:44:14 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:44:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:44:14 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:44:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:44:14 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcb01c6-67a2-41aa-adbb-63c6ba7d0783]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:44:14 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.049s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fe05de-a703-49b4-ae50-31612e31c23e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61] added
Apr 12 10:44:14 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5c9d3a-a298-40b7-8773-d27d8f42c2a5]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[730c155e-a6e1-45e3-ac90-c5e965098f49]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNTjbEai {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNTjbEai" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7771662c-6351-4b3b-ac57-a6776115bc69]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rNTjbEai'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7c1b6a-5f39-4893-873e-6b86a5ef7142]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de7a740-b7e7-46b6-a2f6-51704d4bce67]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:44:14 user nova-compute[71557]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)
Apr 12 10:44:14 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:44:14 user nova-compute[71557]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)
Apr 12 10:44:14 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-04e80ced-5fc1-4547-845a-d5f10b605c9a req-d1a108ee-04d6-47d5-b69d-779072b41e1b service nova] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Received event network-vif-unplugged-54a35da3-7130-4116-a695-1d7da8f0afc8 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-04e80ced-5fc1-4547-845a-d5f10b605c9a req-d1a108ee-04d6-47d5-b69d-779072b41e1b service nova] Acquiring lock "dc6eb5d4-d415-4459-a95b-5a470ec66586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-04e80ced-5fc1-4547-845a-d5f10b605c9a req-d1a108ee-04d6-47d5-b69d-779072b41e1b service nova] Lock "dc6eb5d4-d415-4459-a95b-5a470ec66586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-04e80ced-5fc1-4547-845a-d5f10b605c9a req-d1a108ee-04d6-47d5-b69d-779072b41e1b service nova] Lock "dc6eb5d4-d415-4459-a95b-5a470ec66586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-04e80ced-5fc1-4547-845a-d5f10b605c9a req-d1a108ee-04d6-47d5-b69d-779072b41e1b service nova] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] No waiting events found dispatching network-vif-unplugged-54a35da3-7130-4116-a695-1d7da8f0afc8 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-04e80ced-5fc1-4547-845a-d5f10b605c9a req-d1a108ee-04d6-47d5-b69d-779072b41e1b service nova] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Received event network-vif-unplugged-54a35da3-7130-4116-a695-1d7da8f0afc8 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c723ce53-1c50-4a07-8856-f70087902ba8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260]
Apr 12 10:44:14 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260] successful.
Apr 12 10:44:14 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[02090b6e-888a-4b73-b6d0-3b337fd37e9b]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a6a628-8bcd-4901-aeeb-cac32b54bce8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:44:14 user nova-compute[71557]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)
Apr 12 10:44:14 user nova-compute[71557]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:44:14 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:44:14 user nova-compute[71557]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)
Apr 12 10:44:14 user nova-compute[71557]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:44:14 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:44:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.032s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c2f1c1-f9c5-49a9-9011-0490186b2564]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:15 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:44:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNTjbEai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:44:15 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Instance destroyed successfully.
Apr 12 10:44:15 user nova-compute[71557]: DEBUG nova.objects.instance [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lazy-loading 'resources' on Instance uuid dc6eb5d4-d415-4459-a95b-5a470ec66586 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:44:15 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-620034952',display_name='tempest-ServersNegativeTestJSON-server-620034952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-620034952',id=5,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:35:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='024682bfda5548b8b9b404c85dd55b34',ramdisk_id='',reservation_id='r-nyhjshj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-563292074',owner_user_name='tempest-ServersNegativeTestJSON-563292074-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:35:47Z,user_data=None,user_id='33d19bfc4894401cb664521438338b9a',uuid=dc6eb5d4-d415-4459-a95b-5a470ec66586,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54a35da3-7130-4116-a695-1d7da8f0afc8", "address": "fa:16:3e:0a:f4:49", "network": {"id": "092e35b9-633d-403b-a777-df3e8c018327", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667523639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "024682bfda5548b8b9b404c85dd55b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a35da3-71", "ovs_interfaceid": "54a35da3-7130-4116-a695-1d7da8f0afc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:44:15 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Converting VIF {"id": "54a35da3-7130-4116-a695-1d7da8f0afc8", "address": "fa:16:3e:0a:f4:49", "network": {"id": "092e35b9-633d-403b-a777-df3e8c018327", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667523639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "024682bfda5548b8b9b404c85dd55b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a35da3-71", "ovs_interfaceid": "54a35da3-7130-4116-a695-1d7da8f0afc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:44:15 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:f4:49,bridge_name='br-int',has_traffic_filtering=True,id=54a35da3-7130-4116-a695-1d7da8f0afc8,network=Network(092e35b9-633d-403b-a777-df3e8c018327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a35da3-71') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:44:15 user nova-compute[71557]: DEBUG os_vif [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:f4:49,bridge_name='br-int',has_traffic_filtering=True,id=54a35da3-7130-4116-a695-1d7da8f0afc8,network=Network(092e35b9-633d-403b-a777-df3e8c018327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a35da3-71') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:44:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54a35da3-71, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:44:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:44:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:15 user nova-compute[71557]: INFO os_vif [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:f4:49,bridge_name='br-int',has_traffic_filtering=True,id=54a35da3-7130-4116-a695-1d7da8f0afc8,network=Network(092e35b9-633d-403b-a777-df3e8c018327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a35da3-71')
Apr 12 10:44:15 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Deleting instance files /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586_del
Apr 12 10:44:15 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Deletion of /opt/stack/data/nova/instances/dc6eb5d4-d415-4459-a95b-5a470ec66586_del complete
Apr 12 10:44:15 user nova-compute[71557]: INFO nova.compute.manager [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Took 1.14 seconds to destroy the instance on the hypervisor.
Apr 12 10:44:15 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:44:15 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:44:15 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:44:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:44:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '26331306233373636', 'path': '/dev/sdd'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:44:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331306233373636', 'path': '/dev/sdd'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:44:16 user nova-compute[71557]: DEBUG nova.objects.instance [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'flavor' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:44:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 10:44:16 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:44:16 user nova-compute[71557]:   <source dev="/dev/sdd"/>
Apr 12 10:44:16 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:44:16 user nova-compute[71557]:   <serial>84e79e7d-5eb0-4960-b9ba-ff1afd54aa61</serial>
Apr 12 10:44:16 user nova-compute[71557]: </disk>
Apr 12 10:44:16 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 10:44:16 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:44:16 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Took 0.59 seconds to deallocate network for instance.
Apr 12 10:44:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-08dc208b-2a30-40c3-b29c-3b60b0af1f59 req-de689d68-d301-4188-b487-824252a6a8c8 service nova] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Received event network-vif-deleted-54a35da3-7130-4116-a695-1d7da8f0afc8 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:44:16 user nova-compute[71557]: INFO nova.compute.manager [req-08dc208b-2a30-40c3-b29c-3b60b0af1f59 req-de689d68-d301-4188-b487-824252a6a8c8 service nova] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Neutron deleted interface 54a35da3-7130-4116-a695-1d7da8f0afc8; detaching it from the instance and deleting it from the info cache
Apr 12 10:44:16 user nova-compute[71557]: DEBUG nova.network.neutron [req-08dc208b-2a30-40c3-b29c-3b60b0af1f59 req-de689d68-d301-4188-b487-824252a6a8c8 service nova] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:44:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-08dc208b-2a30-40c3-b29c-3b60b0af1f59 req-de689d68-d301-4188-b487-824252a6a8c8 service nova] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Detach interface failed, port_id=54a35da3-7130-4116-a695-1d7da8f0afc8, reason: Instance dc6eb5d4-d415-4459-a95b-5a470ec66586 could not be found. {{(pid=71557) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 10:44:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:44:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:44:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] No VIF found with MAC fa:16:3e:fe:65:45, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:44:16 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:44:16 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:44:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:16 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Deleted allocations for instance dc6eb5d4-d415-4459-a95b-5a470ec66586
Apr 12 10:44:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-34f536a8-2bc2-4b14-a3cb-56b719381d61 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.399s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f1caeeab-efa4-4894-a3a4-bec6fc31b984 tempest-ServersNegativeTestJSON-563292074 tempest-ServersNegativeTestJSON-563292074-project-member] Lock "dc6eb5d4-d415-4459-a95b-5a470ec66586" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.287s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-ee9a42b9-3c35-4399-9fd3-d863b245e0a1 req-29263133-1d0e-41a8-89af-2259d2aac19b service nova] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Received event network-vif-plugged-54a35da3-7130-4116-a695-1d7da8f0afc8 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:44:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ee9a42b9-3c35-4399-9fd3-d863b245e0a1 req-29263133-1d0e-41a8-89af-2259d2aac19b service nova] Acquiring lock "dc6eb5d4-d415-4459-a95b-5a470ec66586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ee9a42b9-3c35-4399-9fd3-d863b245e0a1 req-29263133-1d0e-41a8-89af-2259d2aac19b service nova] Lock "dc6eb5d4-d415-4459-a95b-5a470ec66586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ee9a42b9-3c35-4399-9fd3-d863b245e0a1 req-29263133-1d0e-41a8-89af-2259d2aac19b service nova] Lock "dc6eb5d4-d415-4459-a95b-5a470ec66586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-ee9a42b9-3c35-4399-9fd3-d863b245e0a1 req-29263133-1d0e-41a8-89af-2259d2aac19b service nova] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] No waiting events found dispatching network-vif-plugged-54a35da3-7130-4116-a695-1d7da8f0afc8 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:44:16 user nova-compute[71557]: WARNING nova.compute.manager [req-ee9a42b9-3c35-4399-9fd3-d863b245e0a1 req-29263133-1d0e-41a8-89af-2259d2aac19b service nova] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Received unexpected event network-vif-plugged-54a35da3-7130-4116-a695-1d7da8f0afc8 for instance with vm_state deleted and task_state None.
Apr 12 10:44:18 user nova-compute[71557]: DEBUG nova.compute.manager [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Stashing vm_state: active {{(pid=71557) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 12 10:44:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:18 user nova-compute[71557]: DEBUG nova.objects.instance [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'pci_requests' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:44:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:44:18 user nova-compute[71557]: INFO nova.compute.claims [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Claim successful on node user
Apr 12 10:44:18 user nova-compute[71557]: DEBUG nova.objects.instance [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'resources' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:44:18 user nova-compute[71557]: DEBUG nova.objects.instance [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'pci_devices' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:44:18 user nova-compute[71557]: INFO nova.compute.resource_tracker [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Updating resource usage from migration 709e0919-ecda-4e48-84b6-f1c05de9938b
Apr 12 10:44:18 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:18 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:44:18 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:44:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "0bfafa79-ce40-42f1-9992-10e50734f7fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:18 user nova-compute[71557]: INFO nova.compute.manager [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Detaching volume ae5450fe-d7d1-435d-bf24-e15cfd92e3fc
Apr 12 10:44:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.543s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:18 user nova-compute[71557]: INFO nova.compute.manager [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Migrating
Apr 12 10:44:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:44:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:44:18 user nova-compute[71557]: INFO nova.compute.rpcapi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 12 10:44:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:44:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:44:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquired lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:44:18 user nova-compute[71557]: DEBUG nova.network.neutron [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:44:18 user nova-compute[71557]: INFO nova.virt.block_device [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Attempting to driver detach volume ae5450fe-d7d1-435d-bf24-e15cfd92e3fc from mountpoint /dev/vdc
Apr 12 10:44:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Attempting to detach device vdc from instance 0bfafa79-ce40-42f1-9992-10e50734f7fa from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 10:44:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:44:18 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:44:18 user nova-compute[71557]:   <source dev="/dev/sdc"/>
Apr 12 10:44:18 user nova-compute[71557]:   <target dev="vdc" bus="virtio"/>
Apr 12 10:44:18 user nova-compute[71557]:   <serial>ae5450fe-d7d1-435d-bf24-e15cfd92e3fc</serial>
Apr 12 10:44:18 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 10:44:18 user nova-compute[71557]: </disk>
Apr 12 10:44:18 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:44:18 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Successfully detached device vdc from instance 0bfafa79-ce40-42f1-9992-10e50734f7fa from the persistent domain config.
Apr 12 10:44:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0bfafa79-ce40-42f1-9992-10e50734f7fa from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 10:44:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:44:18 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:44:18 user nova-compute[71557]:   <source dev="/dev/sdc"/>
Apr 12 10:44:18 user nova-compute[71557]:   <target dev="vdc" bus="virtio"/>
Apr 12 10:44:18 user nova-compute[71557]:   <serial>ae5450fe-d7d1-435d-bf24-e15cfd92e3fc</serial>
Apr 12 10:44:18 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 10:44:18 user nova-compute[71557]: </disk>
Apr 12 10:44:18 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG nova.network.neutron [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Updating instance_info_cache with network_info: [{"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Releasing lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681296259.4721205, 0bfafa79-ce40-42f1-9992-10e50734f7fa => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0bfafa79-ce40-42f1-9992-10e50734f7fa {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 10:44:19 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Successfully detached device vdc from instance 0bfafa79-ce40-42f1-9992-10e50734f7fa from the live domain config.
Apr 12 10:44:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TPfrgkzF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:44:19 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:44:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0949e362-f328-4033-8b9a-aae5d888523d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:44:19 user nova-compute[71557]: No targets found.
Apr 12 10:44:19 user nova-compute[71557]: iSNS:
Apr 12 10:44:19 user nova-compute[71557]: No targets found.
Apr 12 10:44:19 user nova-compute[71557]: STATIC:
Apr 12 10:44:19 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:44:19 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:44:19 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:44:19 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61
Apr 12 10:44:19 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:44:19 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:44:19 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc
Apr 12 10:44:19 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:44:19 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:44:19 user nova-compute[71557]: FIRMWARE:
Apr 12 10:44:19 user nova-compute[71557]: No targets found.
Apr 12 10:44:19 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:44:19 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:44:19 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[854babd3-a7e9-4e4b-b41b-10973f61ba5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db3508e-8e23-4e77-b0cf-7917f854ba55]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:44:19 user nova-compute[71557]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)
Apr 12 10:44:19 user nova-compute[71557]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:44:19 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:44:19 user nova-compute[71557]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc (non-flash)
Apr 12 10:44:19 user nova-compute[71557]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:44:19 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd4247520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc'): ({'sdc'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Removing single pathed devices sdc {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Starting migrate_disk_and_power_off {{(pid=71557) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c67ed7-16c6-4fda-bb9c-551f08845426]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a24774a-687a-455a-8a04-59b1be88d44f]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Flushing IO for device /dev/sdc {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[051e5878-368c-4e43-ba1c-dfdbfeba9dbb]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b71dce-fb73-4475-9b92-ca201c46abf2]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] SCSI volumes sdc have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11db18f-5e5d-4332-8544-6f58257c1a34]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d5c8f5-276e-4462-aab6-4e8c6a191057]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc, portal: 172.16.0.220,3260]
Apr 12 10:44:19 user nova-compute[71557]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc, portal: 172.16.0.220,3260] successful.
Apr 12 10:44:19 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae5450fe-d7d1-435d-bf24-e15cfd92e3fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ded16c-8854-438b-9b4a-c9f197491e45]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] <== disconnect_volume: return (383ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG nova.compute.manager [req-9c026c11-2983-4c18-b20f-e62330cfcf3c req-d572edd8-1b51-4c91-8d1f-0eb89b13680c service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-vif-unplugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9c026c11-2983-4c18-b20f-e62330cfcf3c req-d572edd8-1b51-4c91-8d1f-0eb89b13680c service nova] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9c026c11-2983-4c18-b20f-e62330cfcf3c req-d572edd8-1b51-4c91-8d1f-0eb89b13680c service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9c026c11-2983-4c18-b20f-e62330cfcf3c req-d572edd8-1b51-4c91-8d1f-0eb89b13680c service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:19 user nova-compute[71557]: DEBUG nova.compute.manager [req-9c026c11-2983-4c18-b20f-e62330cfcf3c req-d572edd8-1b51-4c91-8d1f-0eb89b13680c service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] No waiting events found dispatching network-vif-unplugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:44:19 user nova-compute[71557]: WARNING nova.compute.manager [req-9c026c11-2983-4c18-b20f-e62330cfcf3c req-d572edd8-1b51-4c91-8d1f-0eb89b13680c service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received unexpected event network-vif-unplugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance with vm_state active and task_state resize_migrating.
Apr 12 10:44:20 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Instance destroyed successfully.
Apr 12 10:44:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T10:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1895953867',display_name='tempest-ServerActionsTestJSON-server-1970085629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1895953867',id=4,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSPzZAK4K6WfKgZv6ul+nJ2Lzppw5IMfK0+f9KuGByC6XjA59WQJmgMTCh01/yWlwW8qMjnx6gjYen9tQKzYmdVo3Z1KGqS/wGYHKKDRVeNNONzm9HfPYp2EDH6xyugDA==',key_name='tempest-keypair-1241183546',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:39:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32235c67d269474b879a58269c1bfb28',ramdisk_id='',reservation_id='r-m0f2y2eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2042231427',owner_user_name='tempest-ServerActionsTestJSON-2042231427-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:44:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0059d31539304ffcb5214b408751cd4f',uuid=bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-707748820-network", "vif_mac": "fa:16:3e:fe:65:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converting VIF {"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-707748820-network", "vif_mac": "fa:16:3e:fe:65:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG os_vif [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa1878d2-9c, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:44:20 user nova-compute[71557]: INFO os_vif [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c')
Apr 12 10:44:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNTjbEai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:44:20 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:44:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a1eed2-56a8-4852-a26e-ccb341809826]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:44:20 user nova-compute[71557]: No targets found.
Apr 12 10:44:20 user nova-compute[71557]: iSNS:
Apr 12 10:44:20 user nova-compute[71557]: No targets found.
Apr 12 10:44:20 user nova-compute[71557]: STATIC:
Apr 12 10:44:20 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:44:20 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:44:20 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:44:20 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61
Apr 12 10:44:20 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:44:20 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:44:20 user nova-compute[71557]: FIRMWARE:
Apr 12 10:44:20 user nova-compute[71557]: No targets found.
Apr 12 10:44:20 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:44:20 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:44:20 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[561a3bd5-9271-4587-ab8f-8d09dbe27a81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0432aca8-ac25-43fe-a8ba-218e156b443e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:44:20 user nova-compute[71557]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:44:20 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:44:20 user nova-compute[71557]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:44:20 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd4654310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61'): ({'sdd'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Removing single pathed devices sdd {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[977d137c-7b36-4117-a457-caa286ad0710]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[011e759c-645a-4fbe-b928-970775dadd96]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flushing IO for device /dev/sdd {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[10da55cf-bb26-4330-8d8a-411e57a623ba]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5faeca-6ac7-4093-9c7b-3b5f69275be3]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] SCSI volumes sdd have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb5670a-b5fa-46c1-a906-19a52be378d6]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcee4c5b-5c16-4c5b-b66e-d906d7a5ace7]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260]
Apr 12 10:44:20 user nova-compute[71557]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260] successful.
Apr 12 10:44:20 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG nova.objects.instance [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'flavor' on Instance uuid 0bfafa79-ce40-42f1-9992-10e50734f7fa {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcbd61c-8272-43ec-bbdf-d08f81918cfc]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] <== disconnect_volume: return (296ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6fae0c8b-183f-42a9-8366-677245128b76 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.972s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:44:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b_resize/disk /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CMD "cp -r /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b_resize/disk /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk" returned: 0 in 0.248s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b_resize/disk.info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk.info {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CMD "cp -r /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b_resize/disk.info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk.info" returned: 0 in 0.040s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG nova.compute.manager [req-ebe484c6-ee07-427c-9aa4-94ca616898c9 req-74bf1469-3887-4545-8f03-c531fa8e51e7 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ebe484c6-ee07-427c-9aa4-94ca616898c9 req-74bf1469-3887-4545-8f03-c531fa8e51e7 service nova] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ebe484c6-ee07-427c-9aa4-94ca616898c9 req-74bf1469-3887-4545-8f03-c531fa8e51e7 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ebe484c6-ee07-427c-9aa4-94ca616898c9 req-74bf1469-3887-4545-8f03-c531fa8e51e7 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG nova.compute.manager [req-ebe484c6-ee07-427c-9aa4-94ca616898c9 req-74bf1469-3887-4545-8f03-c531fa8e51e7 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] No waiting events found dispatching network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:44:22 user nova-compute[71557]: WARNING nova.compute.manager [req-ebe484c6-ee07-427c-9aa4-94ca616898c9 req-74bf1469-3887-4545-8f03-c531fa8e51e7 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received unexpected event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance with vm_state active and task_state resize_migrating.
Apr 12 10:44:22 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG nova.network.neutron [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Port fa1878d2-9c1a-4fda-bdbf-b226839d56c4 binding to destination host user is already ACTIVE {{(pid=71557) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Updating instance_info_cache with network_info: [{"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquired lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG nova.network.neutron [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:22 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6468f2a7-ce19-468d-8b8f-e6071cf437ff/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6468f2a7-ce19-468d-8b8f-e6071cf437ff/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6468f2a7-ce19-468d-8b8f-e6071cf437ff/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6468f2a7-ce19-468d-8b8f-e6071cf437ff/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG nova.network.neutron [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Updating instance_info_cache with network_info: [{"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Releasing lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG os_brick.utils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a241638-b957-4fa6-9340-e2f1c3f86049]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d504a47-218a-48dc-a97b-fedd5d276aa0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e8716c-06c5-4368-9c93-63dba6b5bae3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7c8fe6-bb3c-446a-8dae-0fd44e07cf96]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:44:23 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a22de6-775c-4de5-8511-223e283f0ec6]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG os_brick.utils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:44:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:44:26 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:44:26 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:44:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=7799MB free_disk=26.29324722290039GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:44:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Applying migration context for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b as it has an incoming, in-progress migration 709e0919-ecda-4e48-84b6-f1c05de9938b. Migration status is post-migrating {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 10:44:26 user nova-compute[71557]: INFO nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Updating resource usage from migration 709e0919-ecda-4e48-84b6-f1c05de9938b
Apr 12 10:44:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:44:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:44:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0bfafa79-ce40-42f1-9992-10e50734f7fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:44:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:44:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:44:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 97bafe22-36bf-4939-baf8-9602551bad52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:44:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:44:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 6468f2a7-ce19-468d-8b8f-e6071cf437ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:44:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Migration 709e0919-ecda-4e48-84b6-f1c05de9938b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 10:44:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:44:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:44:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1856MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:44:26 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:44:26 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:44:27 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:44:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.648s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Starting finish_migration {{(pid=71557) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Instance directory exists: not creating {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 10:44:28 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Creating image(s)
Apr 12 10:44:28 user nova-compute[71557]: DEBUG nova.objects.instance [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'trusted_certs' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.146s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Cannot resize image /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Did not create local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Ensure instance console log exists: /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Start _get_guest_xml network_info=[{"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-707748820-network", "vif_mac": "fa:16:3e:fe:65:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'attachment_id': 'eec7b95a-1c9c-455e-8026-195573611586', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNTjbEai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b', 'attached_at': '2023-04-12T10:44:28.000000', 'detached_at': '', 'volume_id': '84e79e7d-5eb0-4960-b9ba-ff1afd54aa61', 'serial': '84e79e7d-5eb0-4960-b9ba-ff1afd54aa61'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:44:28 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:44:28 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:44:28 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG nova.objects.instance [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'vcpu_model' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNTjbEai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:44:28 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:44:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:44:28 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:44:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:44:28 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a4f8e5-1865-44a4-b702-9a2989f346ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:44:28 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d6449b-054b-4f1a-8770-2c22f8b3f3f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61] added
Apr 12 10:44:28 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f61c4e8-bc59-48ee-9123-93255d2aa528]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37ee67d-58e8-493f-a984-52484a141604]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNTjbEai {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNTjbEai" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[887949cd-929a-45fc-9e56-fb6b73cd8522]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rNTjbEai'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f671f808-b212-45ee-b360-0eeca6a353a5]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[941736a2-95f3-4c77-bd33-83a611073eff]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:44:28 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:44:28 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:44:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0474ce4c-5b6b-47ae-8a6f-2b0d8e128d3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260]
Apr 12 10:44:29 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260] successful.
Apr 12 10:44:29 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c087e4a-906a-4e53-b2b8-0e95f293b882]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa6fa55-d09f-45f2-9857-5f8a25821f32]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:44:29 user nova-compute[71557]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:44:29 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:44:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:44:29 user nova-compute[71557]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:44:29 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:44:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:44:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:44:29 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:44:29 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:44:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8036b96c-c23c-4433-8154-70f17f3e659b]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:29 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: None {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNTjbEai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26331306233373636', 'path': '/dev/sdc'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331306233373636', 'path': '/dev/sdc'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T10:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1895953867',display_name='tempest-ServerActionsTestJSON-server-1970085629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1895953867',id=4,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSPzZAK4K6WfKgZv6ul+nJ2Lzppw5IMfK0+f9KuGByC6XjA59WQJmgMTCh01/yWlwW8qMjnx6gjYen9tQKzYmdVo3Z1KGqS/wGYHKKDRVeNNONzm9HfPYp2EDH6xyugDA==',key_name='tempest-keypair-1241183546',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:39:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32235c67d269474b879a58269c1bfb28',ramdisk_id='',reservation_id='r-m0f2y2eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2042231427',owner_user_name='tempest-ServerActionsTestJSON-2042231427-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:44:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0059d31539304ffcb5214b408751cd4f',uuid=bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-707748820-network", "vif_mac": "fa:16:3e:fe:65:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converting VIF {"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-707748820-network", "vif_mac": "fa:16:3e:fe:65:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:44:30 user nova-compute[71557]:   <uuid>bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b</uuid>
Apr 12 10:44:30 user nova-compute[71557]:   <name>instance-00000004</name>
Apr 12 10:44:30 user nova-compute[71557]:   <memory>196608</memory>
Apr 12 10:44:30 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:44:30 user nova-compute[71557]:   <metadata>
Apr 12 10:44:30 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:44:30 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:44:30 user nova-compute[71557]:       <nova:name>tempest-ServerActionsTestJSON-server-1970085629</nova:name>
Apr 12 10:44:30 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:44:28</nova:creationTime>
Apr 12 10:44:30 user nova-compute[71557]:       <nova:flavor name="m1.micro">
Apr 12 10:44:30 user nova-compute[71557]:         <nova:memory>192</nova:memory>
Apr 12 10:44:30 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:44:30 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:44:30 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:44:30 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:44:30 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:44:30 user nova-compute[71557]:       <nova:owner>
Apr 12 10:44:30 user nova-compute[71557]:         <nova:user uuid="0059d31539304ffcb5214b408751cd4f">tempest-ServerActionsTestJSON-2042231427-project-member</nova:user>
Apr 12 10:44:30 user nova-compute[71557]:         <nova:project uuid="32235c67d269474b879a58269c1bfb28">tempest-ServerActionsTestJSON-2042231427</nova:project>
Apr 12 10:44:30 user nova-compute[71557]:       </nova:owner>
Apr 12 10:44:30 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:44:30 user nova-compute[71557]:       <nova:ports>
Apr 12 10:44:30 user nova-compute[71557]:         <nova:port uuid="fa1878d2-9c1a-4fda-bdbf-b226839d56c4">
Apr 12 10:44:30 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 10:44:30 user nova-compute[71557]:         </nova:port>
Apr 12 10:44:30 user nova-compute[71557]:       </nova:ports>
Apr 12 10:44:30 user nova-compute[71557]:     </nova:instance>
Apr 12 10:44:30 user nova-compute[71557]:   </metadata>
Apr 12 10:44:30 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:44:30 user nova-compute[71557]:     <system>
Apr 12 10:44:30 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:44:30 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:44:30 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:44:30 user nova-compute[71557]:       <entry name="serial">bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b</entry>
Apr 12 10:44:30 user nova-compute[71557]:       <entry name="uuid">bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b</entry>
Apr 12 10:44:30 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:44:30 user nova-compute[71557]:     </system>
Apr 12 10:44:30 user nova-compute[71557]:   </sysinfo>
Apr 12 10:44:30 user nova-compute[71557]:   <os>
Apr 12 10:44:30 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:44:30 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:44:30 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:44:30 user nova-compute[71557]:   </os>
Apr 12 10:44:30 user nova-compute[71557]:   <features>
Apr 12 10:44:30 user nova-compute[71557]:     <acpi/>
Apr 12 10:44:30 user nova-compute[71557]:     <apic/>
Apr 12 10:44:30 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:44:30 user nova-compute[71557]:   </features>
Apr 12 10:44:30 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:44:30 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:44:30 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:44:30 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:44:30 user nova-compute[71557]:   </clock>
Apr 12 10:44:30 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:44:30 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:44:30 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:44:30 user nova-compute[71557]:   </cpu>
Apr 12 10:44:30 user nova-compute[71557]:   <devices>
Apr 12 10:44:30 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:44:30 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:44:30 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk"/>
Apr 12 10:44:30 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:44:30 user nova-compute[71557]:     </disk>
Apr 12 10:44:30 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:44:30 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:44:30 user nova-compute[71557]:       <source dev="/dev/sdc"/>
Apr 12 10:44:30 user nova-compute[71557]:       <target dev="vdb" bus="virtio"/>
Apr 12 10:44:30 user nova-compute[71557]:       <serial>84e79e7d-5eb0-4960-b9ba-ff1afd54aa61</serial>
Apr 12 10:44:30 user nova-compute[71557]:     </disk>
Apr 12 10:44:30 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:44:30 user nova-compute[71557]:       <mac address="fa:16:3e:fe:65:45"/>
Apr 12 10:44:30 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:44:30 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:44:30 user nova-compute[71557]:       <target dev="tapfa1878d2-9c"/>
Apr 12 10:44:30 user nova-compute[71557]:     </interface>
Apr 12 10:44:30 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:44:30 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/console.log" append="off"/>
Apr 12 10:44:30 user nova-compute[71557]:     </serial>
Apr 12 10:44:30 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:44:30 user nova-compute[71557]:     <video>
Apr 12 10:44:30 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:44:30 user nova-compute[71557]:     </video>
Apr 12 10:44:30 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:44:30 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:44:30 user nova-compute[71557]:     </rng>
Apr 12 10:44:30 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:44:30 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:44:30 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:44:30 user nova-compute[71557]:     </memballoon>
Apr 12 10:44:30 user nova-compute[71557]:   </devices>
Apr 12 10:44:30 user nova-compute[71557]: </domain>
Apr 12 10:44:30 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T10:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1895953867',display_name='tempest-ServerActionsTestJSON-server-1970085629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1895953867',id=4,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSPzZAK4K6WfKgZv6ul+nJ2Lzppw5IMfK0+f9KuGByC6XjA59WQJmgMTCh01/yWlwW8qMjnx6gjYen9tQKzYmdVo3Z1KGqS/wGYHKKDRVeNNONzm9HfPYp2EDH6xyugDA==',key_name='tempest-keypair-1241183546',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:39:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32235c67d269474b879a58269c1bfb28',ramdisk_id='',reservation_id='r-m0f2y2eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2042231427',owner_user_name='tempest-ServerActionsTestJSON-2042231427-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:44:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0059d31539304ffcb5214b408751cd4f',uuid=bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-707748820-network", "vif_mac": "fa:16:3e:fe:65:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converting VIF {"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-707748820-network", "vif_mac": "fa:16:3e:fe:65:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG os_vif [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa1878d2-9c, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfa1878d2-9c, col_values=(('external_ids', {'iface-id': 'fa1878d2-9c1a-4fda-bdbf-b226839d56c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:65:45', 'vm-uuid': 'bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:30 user nova-compute[71557]: INFO os_vif [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c')
Apr 12 10:44:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] No VIF found with MAC fa:16:3e:fe:65:45, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:44:30 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296255.5085258, dc6eb5d4-d415-4459-a95b-5a470ec66586 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:44:30 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] VM Stopped (Lifecycle Event)
Apr 12 10:44:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-e36019a5-01b8-47fc-b69d-4e30dec2e0f9 None None] [instance: dc6eb5d4-d415-4459-a95b-5a470ec66586] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:44:31 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:31 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:31 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:31 user nova-compute[71557]: DEBUG nova.compute.manager [req-c4c85074-baa0-4b8c-8290-24987759e474 req-4994e0c4-d548-4da8-9006-3b1cd8c9e10f service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:44:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c4c85074-baa0-4b8c-8290-24987759e474 req-4994e0c4-d548-4da8-9006-3b1cd8c9e10f service nova] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c4c85074-baa0-4b8c-8290-24987759e474 req-4994e0c4-d548-4da8-9006-3b1cd8c9e10f service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c4c85074-baa0-4b8c-8290-24987759e474 req-4994e0c4-d548-4da8-9006-3b1cd8c9e10f service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:31 user nova-compute[71557]: DEBUG nova.compute.manager [req-c4c85074-baa0-4b8c-8290-24987759e474 req-4994e0c4-d548-4da8-9006-3b1cd8c9e10f service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] No waiting events found dispatching network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:44:31 user nova-compute[71557]: WARNING nova.compute.manager [req-c4c85074-baa0-4b8c-8290-24987759e474 req-4994e0c4-d548-4da8-9006-3b1cd8c9e10f service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received unexpected event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance with vm_state active and task_state resize_finish.
Apr 12 10:44:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:33 user nova-compute[71557]: DEBUG nova.compute.manager [req-3968ac24-fb34-42db-a3a3-f2c50ee157c0 req-627c58cc-0c6e-4b1e-b3ba-bdd6fb872932 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:44:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3968ac24-fb34-42db-a3a3-f2c50ee157c0 req-627c58cc-0c6e-4b1e-b3ba-bdd6fb872932 service nova] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3968ac24-fb34-42db-a3a3-f2c50ee157c0 req-627c58cc-0c6e-4b1e-b3ba-bdd6fb872932 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3968ac24-fb34-42db-a3a3-f2c50ee157c0 req-627c58cc-0c6e-4b1e-b3ba-bdd6fb872932 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:33 user nova-compute[71557]: DEBUG nova.compute.manager [req-3968ac24-fb34-42db-a3a3-f2c50ee157c0 req-627c58cc-0c6e-4b1e-b3ba-bdd6fb872932 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] No waiting events found dispatching network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:44:33 user nova-compute[71557]: WARNING nova.compute.manager [req-3968ac24-fb34-42db-a3a3-f2c50ee157c0 req-627c58cc-0c6e-4b1e-b3ba-bdd6fb872932 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received unexpected event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance with vm_state active and task_state resize_finish.
Apr 12 10:44:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Removed pending event for bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b due to event {{(pid=71557) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 10:44:33 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296273.869347, bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:44:33 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] VM Resumed (Lifecycle Event)
Apr 12 10:44:33 user nova-compute[71557]: DEBUG nova.compute.manager [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:44:33 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Instance running successfully.
Apr 12 10:44:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Failed to set time: agent not configured {{(pid=71557) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 12 10:44:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-01698759-0cac-4daa-89a1-60e77e43ff55 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] finish_migration finished successfully. {{(pid=71557) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 12 10:44:33 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:44:33 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:44:33 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 10:44:33 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296273.8697429, bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:44:33 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] VM Started (Lifecycle Event)
Apr 12 10:44:33 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:44:33 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:44:33 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 10:44:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:38 user nova-compute[71557]: DEBUG nova.compute.manager [req-7084632f-839e-494e-9f0f-ca5ae7b3972d req-313f5a1a-7861-4533-a202-84fbc9aa85fe service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Received event network-changed-ac9512bb-5122-4a70-b970-f82605ed0606 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:44:38 user nova-compute[71557]: DEBUG nova.compute.manager [req-7084632f-839e-494e-9f0f-ca5ae7b3972d req-313f5a1a-7861-4533-a202-84fbc9aa85fe service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Refreshing instance network info cache due to event network-changed-ac9512bb-5122-4a70-b970-f82605ed0606. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:44:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7084632f-839e-494e-9f0f-ca5ae7b3972d req-313f5a1a-7861-4533-a202-84fbc9aa85fe service nova] Acquiring lock "refresh_cache-4b79f4d7-f34e-4971-8a6f-171c2d71d683" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:44:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7084632f-839e-494e-9f0f-ca5ae7b3972d req-313f5a1a-7861-4533-a202-84fbc9aa85fe service nova] Acquired lock "refresh_cache-4b79f4d7-f34e-4971-8a6f-171c2d71d683" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:44:38 user nova-compute[71557]: DEBUG nova.network.neutron [req-7084632f-839e-494e-9f0f-ca5ae7b3972d req-313f5a1a-7861-4533-a202-84fbc9aa85fe service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Refreshing network info cache for port ac9512bb-5122-4a70-b970-f82605ed0606 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:44:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:39 user nova-compute[71557]: DEBUG nova.network.neutron [req-7084632f-839e-494e-9f0f-ca5ae7b3972d req-313f5a1a-7861-4533-a202-84fbc9aa85fe service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Updated VIF entry in instance network info cache for port ac9512bb-5122-4a70-b970-f82605ed0606. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:44:39 user nova-compute[71557]: DEBUG nova.network.neutron [req-7084632f-839e-494e-9f0f-ca5ae7b3972d req-313f5a1a-7861-4533-a202-84fbc9aa85fe service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Updating instance_info_cache with network_info: [{"id": "ac9512bb-5122-4a70-b970-f82605ed0606", "address": "fa:16:3e:74:3e:82", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9512bb-51", "ovs_interfaceid": "ac9512bb-5122-4a70-b970-f82605ed0606", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:44:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7084632f-839e-494e-9f0f-ca5ae7b3972d req-313f5a1a-7861-4533-a202-84fbc9aa85fe service nova] Releasing lock "refresh_cache-4b79f4d7-f34e-4971-8a6f-171c2d71d683" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG nova.objects.instance [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'flavor' on Instance uuid 4b79f4d7-f34e-4971-8a6f-171c2d71d683 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:40 user nova-compute[71557]: INFO nova.compute.manager [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Attaching volume 520ed03a-e80e-4bc4-afed-57601fa90711 to /dev/vdb
Apr 12 10:44:40 user nova-compute[71557]: DEBUG os_brick.utils [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8253c55c-a40b-4e97-b868-cb62713a7c39]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3383564d-1d06-488f-94ec-f7d6b34050fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[43339f83-0cdb-4a89-b8ff-b689d0b760b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e01371e-b009-4b42-90c4-2d716d194553]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:44:40 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:44:40 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b61fd4-31d5-40b9-bbcc-9114803fee28]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG os_brick.utils [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:44:40 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Updating existing volume attachment record: f0409389-67fa-4f7b-9aec-c7a91209718e {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:44:42 user nova-compute[71557]: INFO nova.compute.manager [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Rescuing
Apr 12 10:44:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "refresh_cache-97bafe22-36bf-4939-baf8-9602551bad52" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:44:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquired lock "refresh_cache-97bafe22-36bf-4939-baf8-9602551bad52" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:44:42 user nova-compute[71557]: DEBUG nova.network.neutron [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:44:43 user nova-compute[71557]: DEBUG nova.network.neutron [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Updating instance_info_cache with network_info: [{"id": "580ed46e-ff10-494f-b864-42eda726a7ff", "address": "fa:16:3e:a7:62:8b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580ed46e-ff", "ovs_interfaceid": "580ed46e-ff10-494f-b864-42eda726a7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:44:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Releasing lock "refresh_cache-97bafe22-36bf-4939-baf8-9602551bad52" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:44:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-90893e8f-eaa7-44cf-baa9-f0c8f11a8252 req-56ce45cc-c6ef-41b3-a435-e6e1fef356c8 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Received event network-vif-unplugged-580ed46e-ff10-494f-b864-42eda726a7ff {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:44:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-90893e8f-eaa7-44cf-baa9-f0c8f11a8252 req-56ce45cc-c6ef-41b3-a435-e6e1fef356c8 service nova] Acquiring lock "97bafe22-36bf-4939-baf8-9602551bad52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-90893e8f-eaa7-44cf-baa9-f0c8f11a8252 req-56ce45cc-c6ef-41b3-a435-e6e1fef356c8 service nova] Lock "97bafe22-36bf-4939-baf8-9602551bad52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-90893e8f-eaa7-44cf-baa9-f0c8f11a8252 req-56ce45cc-c6ef-41b3-a435-e6e1fef356c8 service nova] Lock "97bafe22-36bf-4939-baf8-9602551bad52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-90893e8f-eaa7-44cf-baa9-f0c8f11a8252 req-56ce45cc-c6ef-41b3-a435-e6e1fef356c8 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] No waiting events found dispatching network-vif-unplugged-580ed46e-ff10-494f-b864-42eda726a7ff {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:44:43 user nova-compute[71557]: WARNING nova.compute.manager [req-90893e8f-eaa7-44cf-baa9-f0c8f11a8252 req-56ce45cc-c6ef-41b3-a435-e6e1fef356c8 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Received unexpected event network-vif-unplugged-580ed46e-ff10-494f-b864-42eda726a7ff for instance with vm_state active and task_state rescuing.
Apr 12 10:44:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:44 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Instance destroyed successfully.
Apr 12 10:44:44 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Attempting rescue
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71557) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Instance directory exists: not creating {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 10:44:44 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Creating image(s)
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "/opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "/opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "/opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.objects.instance [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'trusted_certs' on Instance uuid 97bafe22-36bf-4939-baf8-9602551bad52 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue" returned: 0 in 0.055s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.objects.instance [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'migration_context' on Instance uuid 97bafe22-36bf-4939-baf8-9602551bad52 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Start _get_guest_xml network_info=[{"id": "580ed46e-ff10-494f-b864-42eda726a7ff", "address": "fa:16:3e:a7:62:8b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "vif_mac": "fa:16:3e:a7:62:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580ed46e-ff", "ovs_interfaceid": "580ed46e-ff10-494f-b864-42eda726a7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.objects.instance [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'resources' on Instance uuid 97bafe22-36bf-4939-baf8-9602551bad52 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.objects.instance [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'numa_topology' on Instance uuid 97bafe22-36bf-4939-baf8-9602551bad52 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:44:44 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:44:44 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.objects.instance [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'vcpu_model' on Instance uuid 97bafe22-36bf-4939-baf8-9602551bad52 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-755364809',display_name='tempest-ServerRescueNegativeTestJSON-server-755364809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-755364809',id=23,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:43:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b39cd8e55b54a86a7784f2934273e20',ramdisk_id='',reservation_id='r-8rwff9ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1632398833',owner_user_name='tempest-ServerRescueNegativeTestJSON-1632398833-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:43:01Z,user_data=None,user_id='abdf772f2c7341c29159b6f1f2ce7ccb',uuid=97bafe22-36bf-4939-baf8-9602551bad52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "580ed46e-ff10-494f-b864-42eda726a7ff", "address": "fa:16:3e:a7:62:8b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "vif_mac": "fa:16:3e:a7:62:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580ed46e-ff", "ovs_interfaceid": "580ed46e-ff10-494f-b864-42eda726a7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converting VIF {"id": "580ed46e-ff10-494f-b864-42eda726a7ff", "address": "fa:16:3e:a7:62:8b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "vif_mac": "fa:16:3e:a7:62:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580ed46e-ff", "ovs_interfaceid": "580ed46e-ff10-494f-b864-42eda726a7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:62:8b,bridge_name='br-int',has_traffic_filtering=True,id=580ed46e-ff10-494f-b864-42eda726a7ff,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580ed46e-ff') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.objects.instance [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'pci_devices' on Instance uuid 97bafe22-36bf-4939-baf8-9602551bad52 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:44:44 user nova-compute[71557]:   <uuid>97bafe22-36bf-4939-baf8-9602551bad52</uuid>
Apr 12 10:44:44 user nova-compute[71557]:   <name>instance-00000017</name>
Apr 12 10:44:44 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:44:44 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:44:44 user nova-compute[71557]:   <metadata>
Apr 12 10:44:44 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:44:44 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:44:44 user nova-compute[71557]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-755364809</nova:name>
Apr 12 10:44:44 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:44:44</nova:creationTime>
Apr 12 10:44:44 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:44:44 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:44:44 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:44:44 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:44:44 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:44:44 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:44:44 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:44:44 user nova-compute[71557]:       <nova:owner>
Apr 12 10:44:44 user nova-compute[71557]:         <nova:user uuid="abdf772f2c7341c29159b6f1f2ce7ccb">tempest-ServerRescueNegativeTestJSON-1632398833-project-member</nova:user>
Apr 12 10:44:44 user nova-compute[71557]:         <nova:project uuid="2b39cd8e55b54a86a7784f2934273e20">tempest-ServerRescueNegativeTestJSON-1632398833</nova:project>
Apr 12 10:44:44 user nova-compute[71557]:       </nova:owner>
Apr 12 10:44:44 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:44:44 user nova-compute[71557]:       <nova:ports>
Apr 12 10:44:44 user nova-compute[71557]:         <nova:port uuid="580ed46e-ff10-494f-b864-42eda726a7ff">
Apr 12 10:44:44 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 10:44:44 user nova-compute[71557]:         </nova:port>
Apr 12 10:44:44 user nova-compute[71557]:       </nova:ports>
Apr 12 10:44:44 user nova-compute[71557]:     </nova:instance>
Apr 12 10:44:44 user nova-compute[71557]:   </metadata>
Apr 12 10:44:44 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:44:44 user nova-compute[71557]:     <system>
Apr 12 10:44:44 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:44:44 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:44:44 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:44:44 user nova-compute[71557]:       <entry name="serial">97bafe22-36bf-4939-baf8-9602551bad52</entry>
Apr 12 10:44:44 user nova-compute[71557]:       <entry name="uuid">97bafe22-36bf-4939-baf8-9602551bad52</entry>
Apr 12 10:44:44 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:44:44 user nova-compute[71557]:     </system>
Apr 12 10:44:44 user nova-compute[71557]:   </sysinfo>
Apr 12 10:44:44 user nova-compute[71557]:   <os>
Apr 12 10:44:44 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:44:44 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:44:44 user nova-compute[71557]:   </os>
Apr 12 10:44:44 user nova-compute[71557]:   <features>
Apr 12 10:44:44 user nova-compute[71557]:     <acpi/>
Apr 12 10:44:44 user nova-compute[71557]:     <apic/>
Apr 12 10:44:44 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:44:44 user nova-compute[71557]:   </features>
Apr 12 10:44:44 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:44:44 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:44:44 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:44:44 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:44:44 user nova-compute[71557]:   </clock>
Apr 12 10:44:44 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:44:44 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:44:44 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:44:44 user nova-compute[71557]:   </cpu>
Apr 12 10:44:44 user nova-compute[71557]:   <devices>
Apr 12 10:44:44 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:44:44 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:44:44 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue"/>
Apr 12 10:44:44 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:44:44 user nova-compute[71557]:     </disk>
Apr 12 10:44:44 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:44:44 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:44:44 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk"/>
Apr 12 10:44:44 user nova-compute[71557]:       <target dev="vdb" bus="virtio"/>
Apr 12 10:44:44 user nova-compute[71557]:     </disk>
Apr 12 10:44:44 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:44:44 user nova-compute[71557]:       <mac address="fa:16:3e:a7:62:8b"/>
Apr 12 10:44:44 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:44:44 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:44:44 user nova-compute[71557]:       <target dev="tap580ed46e-ff"/>
Apr 12 10:44:44 user nova-compute[71557]:     </interface>
Apr 12 10:44:44 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:44:44 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/console.log" append="off"/>
Apr 12 10:44:44 user nova-compute[71557]:     </serial>
Apr 12 10:44:44 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:44:44 user nova-compute[71557]:     <video>
Apr 12 10:44:44 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:44:44 user nova-compute[71557]:     </video>
Apr 12 10:44:44 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:44:44 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:44:44 user nova-compute[71557]:     </rng>
Apr 12 10:44:44 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:44:44 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:44:44 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:44:44 user nova-compute[71557]:     </memballoon>
Apr 12 10:44:44 user nova-compute[71557]:   </devices>
Apr 12 10:44:44 user nova-compute[71557]: </domain>
Apr 12 10:44:44 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:44:44 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Instance destroyed successfully.
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] No VIF found with MAC fa:16:3e:a7:62:8b, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AdEDnoQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:44:44 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:44:44 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:44:44 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:44:44 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:44:44 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1171c2-ed2b-46b8-a928-16eda61d68f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:44:44 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1deebb34-b01f-49c7-8dfa-3eb9ddbbb0f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711] added
Apr 12 10:44:44 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aaebb32-6c9c-4daa-9a54-b532762b5933]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[543080e2-3196-42ff-8c46-78423cedb16f]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AdEDnoQq {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AdEDnoQq" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee8374f-5cad-460c-b519-148fa851f8c7]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AdEDnoQq'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5f420b-a35e-4ca8-8889-eb31cce752e5]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[94045dac-973a-4547-91fb-8722590e56be]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:44:45 user nova-compute[71557]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:44:45 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:44:45 user nova-compute[71557]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:44:45 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4c5811-4d3b-47fc-a3dc-266e64fdb3d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711, portal: 172.16.0.220,3260]
Apr 12 10:44:45 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711, portal: 172.16.0.220,3260] successful.
Apr 12 10:44:45 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2655c8fc-d977-492c-8b35-530ee20f88a3]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[650a447b-db9c-40d6-9ba2-34eb7855a8b6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:44:45 user nova-compute[71557]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:44:45 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:44:45 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:44:45 user nova-compute[71557]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:44:45 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:44:45 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[733c1172-2a03-4c28-b460-2899231d0034]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AdEDnoQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG nova.compute.manager [req-7ea9fc9f-450a-4e70-b5a5-1473d90e990c req-d39ac2e7-c1f6-4deb-a924-f87c7753a04e service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Received event network-vif-plugged-580ed46e-ff10-494f-b864-42eda726a7ff {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7ea9fc9f-450a-4e70-b5a5-1473d90e990c req-d39ac2e7-c1f6-4deb-a924-f87c7753a04e service nova] Acquiring lock "97bafe22-36bf-4939-baf8-9602551bad52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7ea9fc9f-450a-4e70-b5a5-1473d90e990c req-d39ac2e7-c1f6-4deb-a924-f87c7753a04e service nova] Lock "97bafe22-36bf-4939-baf8-9602551bad52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7ea9fc9f-450a-4e70-b5a5-1473d90e990c req-d39ac2e7-c1f6-4deb-a924-f87c7753a04e service nova] Lock "97bafe22-36bf-4939-baf8-9602551bad52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG nova.compute.manager [req-7ea9fc9f-450a-4e70-b5a5-1473d90e990c req-d39ac2e7-c1f6-4deb-a924-f87c7753a04e service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] No waiting events found dispatching network-vif-plugged-580ed46e-ff10-494f-b864-42eda726a7ff {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:44:45 user nova-compute[71557]: WARNING nova.compute.manager [req-7ea9fc9f-450a-4e70-b5a5-1473d90e990c req-d39ac2e7-c1f6-4deb-a924-f87c7753a04e service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Received unexpected event network-vif-plugged-580ed46e-ff10-494f-b864-42eda726a7ff for instance with vm_state active and task_state rescuing.
Apr 12 10:44:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:44:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23933616136636331', 'path': '/dev/sdd'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:44:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933616136636331', 'path': '/dev/sdd'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:44:46 user nova-compute[71557]: DEBUG nova.objects.instance [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'flavor' on Instance uuid 4b79f4d7-f34e-4971-8a6f-171c2d71d683 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:44:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 10:44:46 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:44:46 user nova-compute[71557]:   <source dev="/dev/sdd"/>
Apr 12 10:44:46 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:44:46 user nova-compute[71557]:   <serial>520ed03a-e80e-4bc4-afed-57601fa90711</serial>
Apr 12 10:44:46 user nova-compute[71557]: </disk>
Apr 12 10:44:46 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 10:44:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:44:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:44:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] No VIF found with MAC fa:16:3e:74:3e:82, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:44:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5e380624-6759-4289-bcd6-0c96985f5e4e tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.650s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:47 user nova-compute[71557]: DEBUG nova.compute.manager [req-156df52c-8f0e-404c-ac1b-6a176556f901 req-502447a6-b5c7-4a87-854d-59f9f3d0cbd9 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Received event network-vif-plugged-580ed46e-ff10-494f-b864-42eda726a7ff {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:44:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-156df52c-8f0e-404c-ac1b-6a176556f901 req-502447a6-b5c7-4a87-854d-59f9f3d0cbd9 service nova] Acquiring lock "97bafe22-36bf-4939-baf8-9602551bad52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-156df52c-8f0e-404c-ac1b-6a176556f901 req-502447a6-b5c7-4a87-854d-59f9f3d0cbd9 service nova] Lock "97bafe22-36bf-4939-baf8-9602551bad52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-156df52c-8f0e-404c-ac1b-6a176556f901 req-502447a6-b5c7-4a87-854d-59f9f3d0cbd9 service nova] Lock "97bafe22-36bf-4939-baf8-9602551bad52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:47 user nova-compute[71557]: DEBUG nova.compute.manager [req-156df52c-8f0e-404c-ac1b-6a176556f901 req-502447a6-b5c7-4a87-854d-59f9f3d0cbd9 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] No waiting events found dispatching network-vif-plugged-580ed46e-ff10-494f-b864-42eda726a7ff {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:44:47 user nova-compute[71557]: WARNING nova.compute.manager [req-156df52c-8f0e-404c-ac1b-6a176556f901 req-502447a6-b5c7-4a87-854d-59f9f3d0cbd9 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Received unexpected event network-vif-plugged-580ed46e-ff10-494f-b864-42eda726a7ff for instance with vm_state active and task_state rescuing.
Apr 12 10:44:47 user nova-compute[71557]: DEBUG nova.compute.manager [req-156df52c-8f0e-404c-ac1b-6a176556f901 req-502447a6-b5c7-4a87-854d-59f9f3d0cbd9 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Received event network-vif-plugged-580ed46e-ff10-494f-b864-42eda726a7ff {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:44:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-156df52c-8f0e-404c-ac1b-6a176556f901 req-502447a6-b5c7-4a87-854d-59f9f3d0cbd9 service nova] Acquiring lock "97bafe22-36bf-4939-baf8-9602551bad52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-156df52c-8f0e-404c-ac1b-6a176556f901 req-502447a6-b5c7-4a87-854d-59f9f3d0cbd9 service nova] Lock "97bafe22-36bf-4939-baf8-9602551bad52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-156df52c-8f0e-404c-ac1b-6a176556f901 req-502447a6-b5c7-4a87-854d-59f9f3d0cbd9 service nova] Lock "97bafe22-36bf-4939-baf8-9602551bad52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:47 user nova-compute[71557]: DEBUG nova.compute.manager [req-156df52c-8f0e-404c-ac1b-6a176556f901 req-502447a6-b5c7-4a87-854d-59f9f3d0cbd9 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] No waiting events found dispatching network-vif-plugged-580ed46e-ff10-494f-b864-42eda726a7ff {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:44:47 user nova-compute[71557]: WARNING nova.compute.manager [req-156df52c-8f0e-404c-ac1b-6a176556f901 req-502447a6-b5c7-4a87-854d-59f9f3d0cbd9 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Received unexpected event network-vif-plugged-580ed46e-ff10-494f-b864-42eda726a7ff for instance with vm_state active and task_state rescuing.
Apr 12 10:44:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Removed pending event for 97bafe22-36bf-4939-baf8-9602551bad52 due to event {{(pid=71557) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 10:44:48 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296288.3882403, 97bafe22-36bf-4939-baf8-9602551bad52 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:44:48 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] VM Resumed (Lifecycle Event)
Apr 12 10:44:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-3d26dfac-1420-4017-b8db-69b2f32fada1 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:44:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:44:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:44:48 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 10:44:48 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296288.3912601, 97bafe22-36bf-4939-baf8-9602551bad52 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:44:48 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] VM Started (Lifecycle Event)
Apr 12 10:44:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:44:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:44:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "979fbc15-1dd0-46b8-a9c4-54be9d93da44" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "979fbc15-1dd0-46b8-a9c4-54be9d93da44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:50 user nova-compute[71557]: DEBUG nova.compute.manager [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:44:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:50 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:44:50 user nova-compute[71557]: INFO nova.compute.claims [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Claim successful on node user
Apr 12 10:44:51 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG nova.network.neutron [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:44:51 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:44:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG nova.policy [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ec47d3cdacb45e5a39509e76b546e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cecbfbfd5f42dbb663367f6fbdf3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:44:51 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Creating image(s)
Apr 12 10:44:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "/opt/stack/data/nova/instances/979fbc15-1dd0-46b8-a9c4-54be9d93da44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "/opt/stack/data/nova/instances/979fbc15-1dd0-46b8-a9c4-54be9d93da44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "/opt/stack/data/nova/instances/979fbc15-1dd0-46b8-a9c4-54be9d93da44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.156s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/979fbc15-1dd0-46b8-a9c4-54be9d93da44/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/979fbc15-1dd0-46b8-a9c4-54be9d93da44/disk 1073741824" returned: 0 in 0.047s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.139s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Checking if we can resize image /opt/stack/data/nova/instances/979fbc15-1dd0-46b8-a9c4-54be9d93da44/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:44:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/979fbc15-1dd0-46b8-a9c4-54be9d93da44/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:44:52 user nova-compute[71557]: DEBUG nova.network.neutron [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Successfully created port: 84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:44:52 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/979fbc15-1dd0-46b8-a9c4-54be9d93da44/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:44:52 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Cannot resize image /opt/stack/data/nova/instances/979fbc15-1dd0-46b8-a9c4-54be9d93da44/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:44:52 user nova-compute[71557]: DEBUG nova.objects.instance [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'migration_context' on Instance uuid 979fbc15-1dd0-46b8-a9c4-54be9d93da44 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:44:52 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:44:52 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Ensure instance console log exists: /opt/stack/data/nova/instances/979fbc15-1dd0-46b8-a9c4-54be9d93da44/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:44:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:52 user nova-compute[71557]: DEBUG nova.network.neutron [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Successfully updated port: 84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.compute.manager [req-489c3f25-8eab-400a-bd22-a84c6335b29b req-f6c4c50a-f98a-4135-b961-3aa9900d6d64 service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Received event network-changed-84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.compute.manager [req-489c3f25-8eab-400a-bd22-a84c6335b29b req-f6c4c50a-f98a-4135-b961-3aa9900d6d64 service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Refreshing instance network info cache due to event network-changed-84c5d9c8-683a-4733-86ba-4f9f2e89e5f0. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-489c3f25-8eab-400a-bd22-a84c6335b29b req-f6c4c50a-f98a-4135-b961-3aa9900d6d64 service nova] Acquiring lock "refresh_cache-979fbc15-1dd0-46b8-a9c4-54be9d93da44" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-489c3f25-8eab-400a-bd22-a84c6335b29b req-f6c4c50a-f98a-4135-b961-3aa9900d6d64 service nova] Acquired lock "refresh_cache-979fbc15-1dd0-46b8-a9c4-54be9d93da44" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.network.neutron [req-489c3f25-8eab-400a-bd22-a84c6335b29b req-f6c4c50a-f98a-4135-b961-3aa9900d6d64 service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Refreshing network info cache for port 84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.network.neutron [req-489c3f25-8eab-400a-bd22-a84c6335b29b req-f6c4c50a-f98a-4135-b961-3aa9900d6d64 service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "refresh_cache-979fbc15-1dd0-46b8-a9c4-54be9d93da44" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.network.neutron [req-489c3f25-8eab-400a-bd22-a84c6335b29b req-f6c4c50a-f98a-4135-b961-3aa9900d6d64 service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-489c3f25-8eab-400a-bd22-a84c6335b29b req-f6c4c50a-f98a-4135-b961-3aa9900d6d64 service nova] Releasing lock "refresh_cache-979fbc15-1dd0-46b8-a9c4-54be9d93da44" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquired lock "refresh_cache-979fbc15-1dd0-46b8-a9c4-54be9d93da44" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.network.neutron [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.network.neutron [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.network.neutron [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Updating instance_info_cache with network_info: [{"id": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0", "address": "fa:16:3e:a4:e0:cf", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c5d9c8-68", "ovs_interfaceid": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Releasing lock "refresh_cache-979fbc15-1dd0-46b8-a9c4-54be9d93da44" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.compute.manager [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Instance network_info: |[{"id": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0", "address": "fa:16:3e:a4:e0:cf", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c5d9c8-68", "ovs_interfaceid": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Start _get_guest_xml network_info=[{"id": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0", "address": "fa:16:3e:a4:e0:cf", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c5d9c8-68", "ovs_interfaceid": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:44:53 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:44:53 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1530539013',display_name='tempest-AttachVolumeNegativeTest-server-1530539013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1530539013',id=26,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVmlusjBbAhyfKjhgK8Wa0Pp75RNtE1Qsp17vW0I9s4GPmFdzLWN9G7QfMJm6jzPTGesB4vogBF69JOIb6I1a2Sp2CezrTO671jnBpw/4t36Yvu2usg+rqCY+LYMh5Aig==',key_name='tempest-keypair-615324409',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3cecbfbfd5f42dbb663367f6fbdf3b0',ramdisk_id='',reservation_id='r-zb10ciff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-249658876',owner_user_name='tempest-AttachVolumeNegativeTest-249658876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:44:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ec47d3cdacb45e5a39509e76b546e34',uuid=979fbc15-1dd0-46b8-a9c4-54be9d93da44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0", "address": "fa:16:3e:a4:e0:cf", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c5d9c8-68", "ovs_interfaceid": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converting VIF {"id": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0", "address": "fa:16:3e:a4:e0:cf", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c5d9c8-68", "ovs_interfaceid": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e0:cf,bridge_name='br-int',has_traffic_filtering=True,id=84c5d9c8-683a-4733-86ba-4f9f2e89e5f0,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c5d9c8-68') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.objects.instance [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'pci_devices' on Instance uuid 979fbc15-1dd0-46b8-a9c4-54be9d93da44 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:44:53 user nova-compute[71557]:   <uuid>979fbc15-1dd0-46b8-a9c4-54be9d93da44</uuid>
Apr 12 10:44:53 user nova-compute[71557]:   <name>instance-0000001a</name>
Apr 12 10:44:53 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:44:53 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:44:53 user nova-compute[71557]:   <metadata>
Apr 12 10:44:53 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:44:53 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:44:53 user nova-compute[71557]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1530539013</nova:name>
Apr 12 10:44:53 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:44:53</nova:creationTime>
Apr 12 10:44:53 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:44:53 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:44:53 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:44:53 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:44:53 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:44:53 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:44:53 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:44:53 user nova-compute[71557]:       <nova:owner>
Apr 12 10:44:53 user nova-compute[71557]:         <nova:user uuid="7ec47d3cdacb45e5a39509e76b546e34">tempest-AttachVolumeNegativeTest-249658876-project-member</nova:user>
Apr 12 10:44:53 user nova-compute[71557]:         <nova:project uuid="c3cecbfbfd5f42dbb663367f6fbdf3b0">tempest-AttachVolumeNegativeTest-249658876</nova:project>
Apr 12 10:44:53 user nova-compute[71557]:       </nova:owner>
Apr 12 10:44:53 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:44:53 user nova-compute[71557]:       <nova:ports>
Apr 12 10:44:53 user nova-compute[71557]:         <nova:port uuid="84c5d9c8-683a-4733-86ba-4f9f2e89e5f0">
Apr 12 10:44:53 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 10:44:53 user nova-compute[71557]:         </nova:port>
Apr 12 10:44:53 user nova-compute[71557]:       </nova:ports>
Apr 12 10:44:53 user nova-compute[71557]:     </nova:instance>
Apr 12 10:44:53 user nova-compute[71557]:   </metadata>
Apr 12 10:44:53 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:44:53 user nova-compute[71557]:     <system>
Apr 12 10:44:53 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:44:53 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:44:53 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:44:53 user nova-compute[71557]:       <entry name="serial">979fbc15-1dd0-46b8-a9c4-54be9d93da44</entry>
Apr 12 10:44:53 user nova-compute[71557]:       <entry name="uuid">979fbc15-1dd0-46b8-a9c4-54be9d93da44</entry>
Apr 12 10:44:53 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:44:53 user nova-compute[71557]:     </system>
Apr 12 10:44:53 user nova-compute[71557]:   </sysinfo>
Apr 12 10:44:53 user nova-compute[71557]:   <os>
Apr 12 10:44:53 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:44:53 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:44:53 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:44:53 user nova-compute[71557]:   </os>
Apr 12 10:44:53 user nova-compute[71557]:   <features>
Apr 12 10:44:53 user nova-compute[71557]:     <acpi/>
Apr 12 10:44:53 user nova-compute[71557]:     <apic/>
Apr 12 10:44:53 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:44:53 user nova-compute[71557]:   </features>
Apr 12 10:44:53 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:44:53 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:44:53 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:44:53 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:44:53 user nova-compute[71557]:   </clock>
Apr 12 10:44:53 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:44:53 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:44:53 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:44:53 user nova-compute[71557]:   </cpu>
Apr 12 10:44:53 user nova-compute[71557]:   <devices>
Apr 12 10:44:53 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:44:53 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:44:53 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/979fbc15-1dd0-46b8-a9c4-54be9d93da44/disk"/>
Apr 12 10:44:53 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:44:53 user nova-compute[71557]:     </disk>
Apr 12 10:44:53 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:44:53 user nova-compute[71557]:       <mac address="fa:16:3e:a4:e0:cf"/>
Apr 12 10:44:53 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:44:53 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:44:53 user nova-compute[71557]:       <target dev="tap84c5d9c8-68"/>
Apr 12 10:44:53 user nova-compute[71557]:     </interface>
Apr 12 10:44:53 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:44:53 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/979fbc15-1dd0-46b8-a9c4-54be9d93da44/console.log" append="off"/>
Apr 12 10:44:53 user nova-compute[71557]:     </serial>
Apr 12 10:44:53 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:44:53 user nova-compute[71557]:     <video>
Apr 12 10:44:53 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:44:53 user nova-compute[71557]:     </video>
Apr 12 10:44:53 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:44:53 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:44:53 user nova-compute[71557]:     </rng>
Apr 12 10:44:53 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:44:53 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:44:53 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:44:53 user nova-compute[71557]:     </memballoon>
Apr 12 10:44:53 user nova-compute[71557]:   </devices>
Apr 12 10:44:53 user nova-compute[71557]: </domain>
Apr 12 10:44:53 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1530539013',display_name='tempest-AttachVolumeNegativeTest-server-1530539013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1530539013',id=26,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVmlusjBbAhyfKjhgK8Wa0Pp75RNtE1Qsp17vW0I9s4GPmFdzLWN9G7QfMJm6jzPTGesB4vogBF69JOIb6I1a2Sp2CezrTO671jnBpw/4t36Yvu2usg+rqCY+LYMh5Aig==',key_name='tempest-keypair-615324409',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3cecbfbfd5f42dbb663367f6fbdf3b0',ramdisk_id='',reservation_id='r-zb10ciff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-249658876',owner_user_name='tempest-AttachVolumeNegativeTest-249658876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:44:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ec47d3cdacb45e5a39509e76b546e34',uuid=979fbc15-1dd0-46b8-a9c4-54be9d93da44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0", "address": "fa:16:3e:a4:e0:cf", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c5d9c8-68", "ovs_interfaceid": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converting VIF {"id": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0", "address": "fa:16:3e:a4:e0:cf", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c5d9c8-68", "ovs_interfaceid": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e0:cf,bridge_name='br-int',has_traffic_filtering=True,id=84c5d9c8-683a-4733-86ba-4f9f2e89e5f0,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c5d9c8-68') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG os_vif [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e0:cf,bridge_name='br-int',has_traffic_filtering=True,id=84c5d9c8-683a-4733-86ba-4f9f2e89e5f0,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c5d9c8-68') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84c5d9c8-68, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84c5d9c8-68, col_values=(('external_ids', {'iface-id': '84c5d9c8-683a-4733-86ba-4f9f2e89e5f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:e0:cf', 'vm-uuid': '979fbc15-1dd0-46b8-a9c4-54be9d93da44'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:53 user nova-compute[71557]: INFO os_vif [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e0:cf,bridge_name='br-int',has_traffic_filtering=True,id=84c5d9c8-683a-4733-86ba-4f9f2e89e5f0,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c5d9c8-68')
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:44:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] No VIF found with MAC fa:16:3e:a4:e0:cf, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:44:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:55 user nova-compute[71557]: DEBUG nova.compute.manager [req-7e1d6b1e-c498-481b-944a-b274ad75ab29 req-44a65836-dee6-4022-b2bd-e5581c36089c service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Received event network-vif-plugged-84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:44:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7e1d6b1e-c498-481b-944a-b274ad75ab29 req-44a65836-dee6-4022-b2bd-e5581c36089c service nova] Acquiring lock "979fbc15-1dd0-46b8-a9c4-54be9d93da44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7e1d6b1e-c498-481b-944a-b274ad75ab29 req-44a65836-dee6-4022-b2bd-e5581c36089c service nova] Lock "979fbc15-1dd0-46b8-a9c4-54be9d93da44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7e1d6b1e-c498-481b-944a-b274ad75ab29 req-44a65836-dee6-4022-b2bd-e5581c36089c service nova] Lock "979fbc15-1dd0-46b8-a9c4-54be9d93da44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:55 user nova-compute[71557]: DEBUG nova.compute.manager [req-7e1d6b1e-c498-481b-944a-b274ad75ab29 req-44a65836-dee6-4022-b2bd-e5581c36089c service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] No waiting events found dispatching network-vif-plugged-84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:44:55 user nova-compute[71557]: WARNING nova.compute.manager [req-7e1d6b1e-c498-481b-944a-b274ad75ab29 req-44a65836-dee6-4022-b2bd-e5581c36089c service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Received unexpected event network-vif-plugged-84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 for instance with vm_state building and task_state spawning.
Apr 12 10:44:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:57 user nova-compute[71557]: DEBUG nova.compute.manager [req-504499fa-c826-44b2-888d-646550f0051e req-8847f4da-bee9-4ed5-b224-2b51b0e6915f service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Received event network-vif-plugged-84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:44:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-504499fa-c826-44b2-888d-646550f0051e req-8847f4da-bee9-4ed5-b224-2b51b0e6915f service nova] Acquiring lock "979fbc15-1dd0-46b8-a9c4-54be9d93da44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:44:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-504499fa-c826-44b2-888d-646550f0051e req-8847f4da-bee9-4ed5-b224-2b51b0e6915f service nova] Lock "979fbc15-1dd0-46b8-a9c4-54be9d93da44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:44:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-504499fa-c826-44b2-888d-646550f0051e req-8847f4da-bee9-4ed5-b224-2b51b0e6915f service nova] Lock "979fbc15-1dd0-46b8-a9c4-54be9d93da44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:57 user nova-compute[71557]: DEBUG nova.compute.manager [req-504499fa-c826-44b2-888d-646550f0051e req-8847f4da-bee9-4ed5-b224-2b51b0e6915f service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] No waiting events found dispatching network-vif-plugged-84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:44:57 user nova-compute[71557]: WARNING nova.compute.manager [req-504499fa-c826-44b2-888d-646550f0051e req-8847f4da-bee9-4ed5-b224-2b51b0e6915f service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Received unexpected event network-vif-plugged-84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 for instance with vm_state building and task_state spawning.
Apr 12 10:44:57 user nova-compute[71557]: DEBUG nova.compute.manager [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:44:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:44:57 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296297.5792503, 979fbc15-1dd0-46b8-a9c4-54be9d93da44 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:44:57 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] VM Resumed (Lifecycle Event)
Apr 12 10:44:57 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Instance spawned successfully.
Apr 12 10:44:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:44:57 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:44:57 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:44:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:44:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:44:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:44:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:44:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:44:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:44:57 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:44:57 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296297.5806901, 979fbc15-1dd0-46b8-a9c4-54be9d93da44 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:44:57 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] VM Started (Lifecycle Event)
Apr 12 10:44:57 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:44:57 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:44:57 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:44:57 user nova-compute[71557]: INFO nova.compute.manager [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Took 6.29 seconds to spawn the instance on the hypervisor.
Apr 12 10:44:57 user nova-compute[71557]: DEBUG nova.compute.manager [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:44:57 user nova-compute[71557]: INFO nova.compute.manager [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Took 7.09 seconds to build instance.
Apr 12 10:44:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91c164e4-d83b-4e95-b3ce-4b1d66acb772 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "979fbc15-1dd0-46b8-a9c4-54be9d93da44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.181s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:44:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:44:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "0bfafa79-ce40-42f1-9992-10e50734f7fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:09 user nova-compute[71557]: INFO nova.compute.manager [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Terminating instance
Apr 12 10:45:09 user nova-compute[71557]: DEBUG nova.compute.manager [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:45:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:10 user nova-compute[71557]: DEBUG nova.compute.manager [req-9a20deec-6cdc-4eb3-9db1-d0909d0476fe req-73a36f53-6996-4ae9-88c2-b134ab592e44 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Received event network-vif-unplugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:45:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9a20deec-6cdc-4eb3-9db1-d0909d0476fe req-73a36f53-6996-4ae9-88c2-b134ab592e44 service nova] Acquiring lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9a20deec-6cdc-4eb3-9db1-d0909d0476fe req-73a36f53-6996-4ae9-88c2-b134ab592e44 service nova] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9a20deec-6cdc-4eb3-9db1-d0909d0476fe req-73a36f53-6996-4ae9-88c2-b134ab592e44 service nova] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:10 user nova-compute[71557]: DEBUG nova.compute.manager [req-9a20deec-6cdc-4eb3-9db1-d0909d0476fe req-73a36f53-6996-4ae9-88c2-b134ab592e44 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] No waiting events found dispatching network-vif-unplugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:45:10 user nova-compute[71557]: DEBUG nova.compute.manager [req-9a20deec-6cdc-4eb3-9db1-d0909d0476fe req-73a36f53-6996-4ae9-88c2-b134ab592e44 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Received event network-vif-unplugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:45:10 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Instance destroyed successfully.
Apr 12 10:45:10 user nova-compute[71557]: DEBUG nova.objects.instance [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'resources' on Instance uuid 0bfafa79-ce40-42f1-9992-10e50734f7fa {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:45:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T10:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1310544900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1310544900',id=15,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2Hsku+9Gq6PQ4eKPx2NZhPKKREpcJhVPgOkrPIzB0Og0vZ9OIo/sOZ0cMVzynU//y1O/biJFt/UdsDmp+9Toxz6/qyq8KmOhnHzR0d1UhA1wltYPUXYdlGdBHjOrPUqw==',key_name='tempest-keypair-1823760254',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:42:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af33ce0944194932b663c3b8aef9783d',ramdisk_id='',reservation_id='r-oeqsk990',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-603525697',owner_user_name='tempest-AttachVolumeShelveTestJSON-603525697-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:42:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d6279f1ce94008a2898ade6f730b40',uuid=0bfafa79-ce40-42f1-9992-10e50734f7fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "address": "fa:16:3e:6e:34:b4", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de5a799-c3", "ovs_interfaceid": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:45:10 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converting VIF {"id": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "address": "fa:16:3e:6e:34:b4", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4de5a799-c3", "ovs_interfaceid": "4de5a799-c343-4e41-88ef-ebaaa3adb14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:45:10 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:34:b4,bridge_name='br-int',has_traffic_filtering=True,id=4de5a799-c343-4e41-88ef-ebaaa3adb14c,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4de5a799-c3') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:45:10 user nova-compute[71557]: DEBUG os_vif [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:34:b4,bridge_name='br-int',has_traffic_filtering=True,id=4de5a799-c343-4e41-88ef-ebaaa3adb14c,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4de5a799-c3') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:45:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4de5a799-c3, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:45:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:45:10 user nova-compute[71557]: INFO os_vif [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:34:b4,bridge_name='br-int',has_traffic_filtering=True,id=4de5a799-c343-4e41-88ef-ebaaa3adb14c,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4de5a799-c3')
Apr 12 10:45:10 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Deleting instance files /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa_del
Apr 12 10:45:10 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Deletion of /opt/stack/data/nova/instances/0bfafa79-ce40-42f1-9992-10e50734f7fa_del complete
Apr 12 10:45:10 user nova-compute[71557]: INFO nova.compute.manager [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Took 0.96 seconds to destroy the instance on the hypervisor.
Apr 12 10:45:10 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:45:10 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:45:10 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:45:11 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:45:11 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Took 1.58 seconds to deallocate network for instance.
Apr 12 10:45:11 user nova-compute[71557]: DEBUG nova.compute.manager [req-f4477d62-87f4-4c6c-a947-8432a3ca77ed req-ca2e69fd-ba58-4dbf-b937-e49bd34f66b2 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Received event network-vif-deleted-4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:45:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-bc79ab05-3e29-4fbf-9267-34cbdd91c97a req-fb8f3a9d-53ac-424c-8837-e8e952cfb985 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Received event network-vif-plugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:45:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bc79ab05-3e29-4fbf-9267-34cbdd91c97a req-fb8f3a9d-53ac-424c-8837-e8e952cfb985 service nova] Acquiring lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bc79ab05-3e29-4fbf-9267-34cbdd91c97a req-fb8f3a9d-53ac-424c-8837-e8e952cfb985 service nova] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bc79ab05-3e29-4fbf-9267-34cbdd91c97a req-fb8f3a9d-53ac-424c-8837-e8e952cfb985 service nova] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-bc79ab05-3e29-4fbf-9267-34cbdd91c97a req-fb8f3a9d-53ac-424c-8837-e8e952cfb985 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] No waiting events found dispatching network-vif-plugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:45:12 user nova-compute[71557]: WARNING nova.compute.manager [req-bc79ab05-3e29-4fbf-9267-34cbdd91c97a req-fb8f3a9d-53ac-424c-8837-e8e952cfb985 service nova] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Received unexpected event network-vif-plugged-4de5a799-c343-4e41-88ef-ebaaa3adb14c for instance with vm_state deleted and task_state None.
Apr 12 10:45:12 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:45:12 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:45:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:12 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Deleted allocations for instance 0bfafa79-ce40-42f1-9992-10e50734f7fa
Apr 12 10:45:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6592c62d-b88f-4adc-9745-3c489872eb6e tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "0bfafa79-ce40-42f1-9992-10e50734f7fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.228s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "d687131b-6853-4d65-b8f7-ecef019ae9f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:16 user nova-compute[71557]: DEBUG nova.compute.manager [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:45:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:16 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:45:16 user nova-compute[71557]: INFO nova.compute.claims [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Claim successful on node user
Apr 12 10:45:17 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:45:17 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:45:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.583s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:17 user nova-compute[71557]: DEBUG nova.compute.manager [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:45:17 user nova-compute[71557]: DEBUG nova.compute.manager [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:45:17 user nova-compute[71557]: DEBUG nova.network.neutron [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:45:17 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:45:17 user nova-compute[71557]: DEBUG nova.compute.manager [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:45:17 user nova-compute[71557]: DEBUG nova.compute.manager [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:45:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:45:17 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Creating image(s)
Apr 12 10:45:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "/opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "/opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "/opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "a5c52322154532de0ef8c1e725423b0e091601d8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "a5c52322154532de0ef8c1e725423b0e091601d8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:17 user nova-compute[71557]: DEBUG nova.policy [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a633ec4046a9467683cbfd2ebe59600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:45:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5c52322154532de0ef8c1e725423b0e091601d8.part --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5c52322154532de0ef8c1e725423b0e091601d8.part --force-share --output=json" returned: 0 in 0.152s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:18 user nova-compute[71557]: DEBUG nova.virt.images [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 5bdef35f-97c6-4c63-9b32-a181693bd012 was qcow2, converting to raw {{(pid=71557) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 10:45:18 user nova-compute[71557]: DEBUG nova.privsep.utils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71557) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 10:45:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a5c52322154532de0ef8c1e725423b0e091601d8.part /opt/stack/data/nova/instances/_base/a5c52322154532de0ef8c1e725423b0e091601d8.converted {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:18 user nova-compute[71557]: DEBUG nova.network.neutron [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Successfully created port: 04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:45:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a5c52322154532de0ef8c1e725423b0e091601d8.part /opt/stack/data/nova/instances/_base/a5c52322154532de0ef8c1e725423b0e091601d8.converted" returned: 0 in 0.284s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5c52322154532de0ef8c1e725423b0e091601d8.converted --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5c52322154532de0ef8c1e725423b0e091601d8.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "a5c52322154532de0ef8c1e725423b0e091601d8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.012s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5c52322154532de0ef8c1e725423b0e091601d8 --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5c52322154532de0ef8c1e725423b0e091601d8 --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "a5c52322154532de0ef8c1e725423b0e091601d8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "a5c52322154532de0ef8c1e725423b0e091601d8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5c52322154532de0ef8c1e725423b0e091601d8 --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:18 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5c52322154532de0ef8c1e725423b0e091601d8 --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a5c52322154532de0ef8c1e725423b0e091601d8,backing_fmt=raw /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a5c52322154532de0ef8c1e725423b0e091601d8,backing_fmt=raw /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk 1073741824" returned: 0 in 0.045s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "a5c52322154532de0ef8c1e725423b0e091601d8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5c52322154532de0ef8c1e725423b0e091601d8 --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.network.neutron [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Successfully updated port: 04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "refresh_cache-d687131b-6853-4d65-b8f7-ecef019ae9f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquired lock "refresh_cache-d687131b-6853-4d65-b8f7-ecef019ae9f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.network.neutron [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5c52322154532de0ef8c1e725423b0e091601d8 --force-share --output=json" returned: 0 in 0.144s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.compute.manager [req-d25365cb-551c-4887-9978-d7cc2c7c248c req-2e3f0daa-1680-4551-815a-fd05bb1a801d service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Received event network-changed-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.compute.manager [req-d25365cb-551c-4887-9978-d7cc2c7c248c req-2e3f0daa-1680-4551-815a-fd05bb1a801d service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Refreshing instance network info cache due to event network-changed-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d25365cb-551c-4887-9978-d7cc2c7c248c req-2e3f0daa-1680-4551-815a-fd05bb1a801d service nova] Acquiring lock "refresh_cache-d687131b-6853-4d65-b8f7-ecef019ae9f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.network.neutron [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Cannot resize image /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.objects.instance [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lazy-loading 'migration_context' on Instance uuid d687131b-6853-4d65-b8f7-ecef019ae9f3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Ensure instance console log exists: /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.network.neutron [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Updating instance_info_cache with network_info: [{"id": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "address": "fa:16:3e:f4:d5:7d", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9fb9a-51", "ovs_interfaceid": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Releasing lock "refresh_cache-d687131b-6853-4d65-b8f7-ecef019ae9f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.compute.manager [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Instance network_info: |[{"id": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "address": "fa:16:3e:f4:d5:7d", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9fb9a-51", "ovs_interfaceid": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d25365cb-551c-4887-9978-d7cc2c7c248c req-2e3f0daa-1680-4551-815a-fd05bb1a801d service nova] Acquired lock "refresh_cache-d687131b-6853-4d65-b8f7-ecef019ae9f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.network.neutron [req-d25365cb-551c-4887-9978-d7cc2c7c248c req-2e3f0daa-1680-4551-815a-fd05bb1a801d service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Refreshing network info cache for port 04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Start _get_guest_xml network_info=[{"id": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "address": "fa:16:3e:f4:d5:7d", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9fb9a-51", "ovs_interfaceid": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:45:14Z,direct_url=<?>,disk_format='qcow2',id=5bdef35f-97c6-4c63-9b32-a181693bd012,min_disk=0,min_ram=0,name='tempest-scenario-img--1288578037',owner='b467fac451ee466fb93cec3d3aa3b408',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:45:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5bdef35f-97c6-4c63-9b32-a181693bd012'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:45:19 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:45:19 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:45:14Z,direct_url=<?>,disk_format='qcow2',id=5bdef35f-97c6-4c63-9b32-a181693bd012,min_disk=0,min_ram=0,name='tempest-scenario-img--1288578037',owner='b467fac451ee466fb93cec3d3aa3b408',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:45:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-158631664',display_name='tempest-TestMinimumBasicScenario-server-158631664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-158631664',id=27,image_ref='5bdef35f-97c6-4c63-9b32-a181693bd012',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2R09lY3z1ofkLd/mex8UHM7qHU7uJkgT1OJi5eN5mVbcu+cTMWeldTRYda5cvD2AEA6DLVvL+HztqfG6Bz3W8LigkJXzJuoHTW2uKsH+Ju0S6/fUn1Cb36RGt8Yf4qPQ==',key_name='tempest-TestMinimumBasicScenario-2015119923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b467fac451ee466fb93cec3d3aa3b408',ramdisk_id='',reservation_id='r-93l3f400',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5bdef35f-97c6-4c63-9b32-a181693bd012',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2095634766',owner_user_name='tempest-TestMinimumBasicScenario-2095634766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:45:17Z,user_data=None,user_id='a633ec4046a9467683cbfd2ebe59600f',uuid=d687131b-6853-4d65-b8f7-ecef019ae9f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "address": "fa:16:3e:f4:d5:7d", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9fb9a-51", "ovs_interfaceid": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Converting VIF {"id": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "address": "fa:16:3e:f4:d5:7d", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9fb9a-51", "ovs_interfaceid": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:d5:7d,bridge_name='br-int',has_traffic_filtering=True,id=04a9fb9a-518e-4c3c-bf70-d2a7cff04e43,network=Network(d284a588-7406-446d-af3c-874a119b7536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04a9fb9a-51') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.objects.instance [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lazy-loading 'pci_devices' on Instance uuid d687131b-6853-4d65-b8f7-ecef019ae9f3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:45:19 user nova-compute[71557]:   <uuid>d687131b-6853-4d65-b8f7-ecef019ae9f3</uuid>
Apr 12 10:45:19 user nova-compute[71557]:   <name>instance-0000001b</name>
Apr 12 10:45:19 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:45:19 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:45:19 user nova-compute[71557]:   <metadata>
Apr 12 10:45:19 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:45:19 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:45:19 user nova-compute[71557]:       <nova:name>tempest-TestMinimumBasicScenario-server-158631664</nova:name>
Apr 12 10:45:19 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:45:19</nova:creationTime>
Apr 12 10:45:19 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:45:19 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:45:19 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:45:19 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:45:19 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:45:19 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:45:19 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:45:19 user nova-compute[71557]:       <nova:owner>
Apr 12 10:45:19 user nova-compute[71557]:         <nova:user uuid="a633ec4046a9467683cbfd2ebe59600f">tempest-TestMinimumBasicScenario-2095634766-project-member</nova:user>
Apr 12 10:45:19 user nova-compute[71557]:         <nova:project uuid="b467fac451ee466fb93cec3d3aa3b408">tempest-TestMinimumBasicScenario-2095634766</nova:project>
Apr 12 10:45:19 user nova-compute[71557]:       </nova:owner>
Apr 12 10:45:19 user nova-compute[71557]:       <nova:root type="image" uuid="5bdef35f-97c6-4c63-9b32-a181693bd012"/>
Apr 12 10:45:19 user nova-compute[71557]:       <nova:ports>
Apr 12 10:45:19 user nova-compute[71557]:         <nova:port uuid="04a9fb9a-518e-4c3c-bf70-d2a7cff04e43">
Apr 12 10:45:19 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 10:45:19 user nova-compute[71557]:         </nova:port>
Apr 12 10:45:19 user nova-compute[71557]:       </nova:ports>
Apr 12 10:45:19 user nova-compute[71557]:     </nova:instance>
Apr 12 10:45:19 user nova-compute[71557]:   </metadata>
Apr 12 10:45:19 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:45:19 user nova-compute[71557]:     <system>
Apr 12 10:45:19 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:45:19 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:45:19 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:45:19 user nova-compute[71557]:       <entry name="serial">d687131b-6853-4d65-b8f7-ecef019ae9f3</entry>
Apr 12 10:45:19 user nova-compute[71557]:       <entry name="uuid">d687131b-6853-4d65-b8f7-ecef019ae9f3</entry>
Apr 12 10:45:19 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:45:19 user nova-compute[71557]:     </system>
Apr 12 10:45:19 user nova-compute[71557]:   </sysinfo>
Apr 12 10:45:19 user nova-compute[71557]:   <os>
Apr 12 10:45:19 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:45:19 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:45:19 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:45:19 user nova-compute[71557]:   </os>
Apr 12 10:45:19 user nova-compute[71557]:   <features>
Apr 12 10:45:19 user nova-compute[71557]:     <acpi/>
Apr 12 10:45:19 user nova-compute[71557]:     <apic/>
Apr 12 10:45:19 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:45:19 user nova-compute[71557]:   </features>
Apr 12 10:45:19 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:45:19 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:45:19 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:45:19 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:45:19 user nova-compute[71557]:   </clock>
Apr 12 10:45:19 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:45:19 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:45:19 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:45:19 user nova-compute[71557]:   </cpu>
Apr 12 10:45:19 user nova-compute[71557]:   <devices>
Apr 12 10:45:19 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:45:19 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:45:19 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk"/>
Apr 12 10:45:19 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:45:19 user nova-compute[71557]:     </disk>
Apr 12 10:45:19 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:45:19 user nova-compute[71557]:       <mac address="fa:16:3e:f4:d5:7d"/>
Apr 12 10:45:19 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:45:19 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:45:19 user nova-compute[71557]:       <target dev="tap04a9fb9a-51"/>
Apr 12 10:45:19 user nova-compute[71557]:     </interface>
Apr 12 10:45:19 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:45:19 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/console.log" append="off"/>
Apr 12 10:45:19 user nova-compute[71557]:     </serial>
Apr 12 10:45:19 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:45:19 user nova-compute[71557]:     <video>
Apr 12 10:45:19 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:45:19 user nova-compute[71557]:     </video>
Apr 12 10:45:19 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:45:19 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:45:19 user nova-compute[71557]:     </rng>
Apr 12 10:45:19 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:45:19 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:45:19 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:45:19 user nova-compute[71557]:     </memballoon>
Apr 12 10:45:19 user nova-compute[71557]:   </devices>
Apr 12 10:45:19 user nova-compute[71557]: </domain>
Apr 12 10:45:19 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-158631664',display_name='tempest-TestMinimumBasicScenario-server-158631664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-158631664',id=27,image_ref='5bdef35f-97c6-4c63-9b32-a181693bd012',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2R09lY3z1ofkLd/mex8UHM7qHU7uJkgT1OJi5eN5mVbcu+cTMWeldTRYda5cvD2AEA6DLVvL+HztqfG6Bz3W8LigkJXzJuoHTW2uKsH+Ju0S6/fUn1Cb36RGt8Yf4qPQ==',key_name='tempest-TestMinimumBasicScenario-2015119923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b467fac451ee466fb93cec3d3aa3b408',ramdisk_id='',reservation_id='r-93l3f400',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5bdef35f-97c6-4c63-9b32-a181693bd012',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2095634766',owner_user_name='tempest-TestMinimumBasicScenario-2095634766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:45:17Z,user_data=None,user_id='a633ec4046a9467683cbfd2ebe59600f',uuid=d687131b-6853-4d65-b8f7-ecef019ae9f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "address": "fa:16:3e:f4:d5:7d", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9fb9a-51", "ovs_interfaceid": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Converting VIF {"id": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "address": "fa:16:3e:f4:d5:7d", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9fb9a-51", "ovs_interfaceid": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:d5:7d,bridge_name='br-int',has_traffic_filtering=True,id=04a9fb9a-518e-4c3c-bf70-d2a7cff04e43,network=Network(d284a588-7406-446d-af3c-874a119b7536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04a9fb9a-51') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG os_vif [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:d5:7d,bridge_name='br-int',has_traffic_filtering=True,id=04a9fb9a-518e-4c3c-bf70-d2a7cff04e43,network=Network(d284a588-7406-446d-af3c-874a119b7536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04a9fb9a-51') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04a9fb9a-51, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap04a9fb9a-51, col_values=(('external_ids', {'iface-id': '04a9fb9a-518e-4c3c-bf70-d2a7cff04e43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:d5:7d', 'vm-uuid': 'd687131b-6853-4d65-b8f7-ecef019ae9f3'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:19 user nova-compute[71557]: INFO os_vif [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:d5:7d,bridge_name='br-int',has_traffic_filtering=True,id=04a9fb9a-518e-4c3c-bf70-d2a7cff04e43,network=Network(d284a588-7406-446d-af3c-874a119b7536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04a9fb9a-51')
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] No VIF found with MAC fa:16:3e:f4:d5:7d, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.network.neutron [req-d25365cb-551c-4887-9978-d7cc2c7c248c req-2e3f0daa-1680-4551-815a-fd05bb1a801d service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Updated VIF entry in instance network info cache for port 04a9fb9a-518e-4c3c-bf70-d2a7cff04e43. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG nova.network.neutron [req-d25365cb-551c-4887-9978-d7cc2c7c248c req-2e3f0daa-1680-4551-815a-fd05bb1a801d service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Updating instance_info_cache with network_info: [{"id": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "address": "fa:16:3e:f4:d5:7d", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9fb9a-51", "ovs_interfaceid": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:45:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d25365cb-551c-4887-9978-d7cc2c7c248c req-2e3f0daa-1680-4551-815a-fd05bb1a801d service nova] Releasing lock "refresh_cache-d687131b-6853-4d65-b8f7-ecef019ae9f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:45:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:21 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:45:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-291f0f83-1979-47a6-859c-0a29e8d0ab78 req-f6d48833-1a5b-4c72-b6af-5fa57bbd236b service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Received event network-vif-plugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:45:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-291f0f83-1979-47a6-859c-0a29e8d0ab78 req-f6d48833-1a5b-4c72-b6af-5fa57bbd236b service nova] Acquiring lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-291f0f83-1979-47a6-859c-0a29e8d0ab78 req-f6d48833-1a5b-4c72-b6af-5fa57bbd236b service nova] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-291f0f83-1979-47a6-859c-0a29e8d0ab78 req-f6d48833-1a5b-4c72-b6af-5fa57bbd236b service nova] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-291f0f83-1979-47a6-859c-0a29e8d0ab78 req-f6d48833-1a5b-4c72-b6af-5fa57bbd236b service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] No waiting events found dispatching network-vif-plugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:45:21 user nova-compute[71557]: WARNING nova.compute.manager [req-291f0f83-1979-47a6-859c-0a29e8d0ab78 req-f6d48833-1a5b-4c72-b6af-5fa57bbd236b service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Received unexpected event network-vif-plugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 for instance with vm_state building and task_state spawning.
Apr 12 10:45:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:22 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:45:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:45:22 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:45:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:22 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:45:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6468f2a7-ce19-468d-8b8f-e6071cf437ff/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6468f2a7-ce19-468d-8b8f-e6071cf437ff/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6468f2a7-ce19-468d-8b8f-e6071cf437ff/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6468f2a7-ce19-468d-8b8f-e6071cf437ff/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296323.1552508, d687131b-6853-4d65-b8f7-ecef019ae9f3 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:45:23 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] VM Resumed (Lifecycle Event)
Apr 12 10:45:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:45:23 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Instance spawned successfully.
Apr 12 10:45:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:45:23 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:45:23 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296323.1602526, d687131b-6853-4d65-b8f7-ecef019ae9f3 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:45:23 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] VM Started (Lifecycle Event)
Apr 12 10:45:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:45:23 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:45:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/979fbc15-1dd0-46b8-a9c4-54be9d93da44/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:23 user nova-compute[71557]: INFO nova.compute.manager [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Took 5.86 seconds to spawn the instance on the hypervisor.
Apr 12 10:45:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:45:23 user nova-compute[71557]: INFO nova.compute.manager [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Took 6.76 seconds to build instance.
Apr 12 10:45:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/979fbc15-1dd0-46b8-a9c4-54be9d93da44/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/979fbc15-1dd0-46b8-a9c4-54be9d93da44/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e5a4b722-735d-4091-8b02-58f7b8c1ca94 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.881s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/979fbc15-1dd0-46b8-a9c4-54be9d93da44/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-f599431a-5332-4802-8438-6bd6fb4294fb req-b5a7bed2-13cd-4f99-81eb-3968d1027437 service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Received event network-vif-plugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f599431a-5332-4802-8438-6bd6fb4294fb req-b5a7bed2-13cd-4f99-81eb-3968d1027437 service nova] Acquiring lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f599431a-5332-4802-8438-6bd6fb4294fb req-b5a7bed2-13cd-4f99-81eb-3968d1027437 service nova] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f599431a-5332-4802-8438-6bd6fb4294fb req-b5a7bed2-13cd-4f99-81eb-3968d1027437 service nova] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-f599431a-5332-4802-8438-6bd6fb4294fb req-b5a7bed2-13cd-4f99-81eb-3968d1027437 service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] No waiting events found dispatching network-vif-plugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:45:23 user nova-compute[71557]: WARNING nova.compute.manager [req-f599431a-5332-4802-8438-6bd6fb4294fb req-b5a7bed2-13cd-4f99-81eb-3968d1027437 service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Received unexpected event network-vif-plugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 for instance with vm_state active and task_state None.
Apr 12 10:45:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "68b29390-867e-4bf3-bc93-b401f32b130e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "68b29390-867e-4bf3-bc93-b401f32b130e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:23 user nova-compute[71557]: INFO nova.compute.manager [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Unshelving
Apr 12 10:45:23 user nova-compute[71557]: INFO nova.virt.block_device [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Booting with volume e6850f05-a7ca-4a81-ad02-a1e4d506702b at /dev/vda
Apr 12 10:45:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG os_brick.utils [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4402ce5d-ee6f-4a0c-ba68-2cf9960968d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11f5ba6-968a-46ac-b7e5-2c0c12485280]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cac5399-5e7d-4d41-9f94-0c45d3b0c31a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2fad3b-00e8-488f-bd2a-d64e86389a9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:45:24 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc6bd74-c7d4-414b-93c5-b41507bfa793]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG os_brick.utils [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Updating existing volume attachment record: bc7e894a-a5b1-43a0-88fe-f1c667f21d60 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:25 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296310.182313, 0bfafa79-ce40-42f1-9992-10e50734f7fa => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:45:25 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] VM Stopped (Lifecycle Event)
Apr 12 10:45:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-9dc2ce31-024b-4f6a-8f72-268a44aa45e7 None None] [instance: 0bfafa79-ce40-42f1-9992-10e50734f7fa] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:45:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:45:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:45:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:45:26 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:45:26 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:45:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=7634MB free_disk=26.19420623779297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:45:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Applying migration context for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b as it has an incoming, in-progress migration 709e0919-ecda-4e48-84b6-f1c05de9938b. Migration status is finished {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 10:45:26 user nova-compute[71557]: INFO nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Updating resource usage from migration 709e0919-ecda-4e48-84b6-f1c05de9938b
Apr 12 10:45:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:45:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:45:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:45:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:45:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 97bafe22-36bf-4939-baf8-9602551bad52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:45:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:45:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 6468f2a7-ce19-468d-8b8f-e6071cf437ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:45:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Migration 709e0919-ecda-4e48-84b6-f1c05de9938b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 10:45:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:45:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:45:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance d687131b-6853-4d65-b8f7-ecef019ae9f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:45:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 68b29390-867e-4bf3-bc93-b401f32b130e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 12 10:45:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:45:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1984MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:45:27 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:45:27 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:45:27 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:45:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.692s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:28 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:45:28 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:45:28 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:45:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:45:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:45:28 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:45:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:28 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Updating instance_info_cache with network_info: [{"id": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "address": "fa:16:3e:e8:3f:f9", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e23fbbf-0b", "ovs_interfaceid": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:45:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:45:28 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:45:28 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:45:28 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:45:28 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:45:28 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:45:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:29 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lazy-loading 'pci_requests' on Instance uuid 68b29390-867e-4bf3-bc93-b401f32b130e {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:45:29 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lazy-loading 'numa_topology' on Instance uuid 68b29390-867e-4bf3-bc93-b401f32b130e {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:45:29 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:45:29 user nova-compute[71557]: INFO nova.compute.claims [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Claim successful on node user
Apr 12 10:45:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:29 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:45:29 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:45:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:29 user nova-compute[71557]: INFO nova.network.neutron [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Updating port 78a8426a-653a-44cb-80b7-8a8b14d78cf4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquired lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.network.neutron [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.compute.manager [req-f85aaa38-1ab9-4dcb-b5d6-d22e459eba1a req-0780838b-60f1-4ad5-982f-57c2ea9fb0f9 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Received event network-changed-78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.compute.manager [req-f85aaa38-1ab9-4dcb-b5d6-d22e459eba1a req-0780838b-60f1-4ad5-982f-57c2ea9fb0f9 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Refreshing instance network info cache due to event network-changed-78a8426a-653a-44cb-80b7-8a8b14d78cf4. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f85aaa38-1ab9-4dcb-b5d6-d22e459eba1a req-0780838b-60f1-4ad5-982f-57c2ea9fb0f9 service nova] Acquiring lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.network.neutron [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Updating instance_info_cache with network_info: [{"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Releasing lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:45:30 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Creating image(s)
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Did not create local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Ensure instance console log exists: /opt/stack/data/nova/instances/68b29390-867e-4bf3-bc93-b401f32b130e/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Start _get_guest_xml network_info=[{"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'bc7e894a-a5b1-43a0-88fe-f1c667f21d60', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AuHwQTaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '68b29390-867e-4bf3-bc93-b401f32b130e', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6850f05-a7ca-4a81-ad02-a1e4d506702b', 'serial': 'e6850f05-a7ca-4a81-ad02-a1e4d506702b'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f85aaa38-1ab9-4dcb-b5d6-d22e459eba1a req-0780838b-60f1-4ad5-982f-57c2ea9fb0f9 service nova] Acquired lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.network.neutron [req-f85aaa38-1ab9-4dcb-b5d6-d22e459eba1a req-0780838b-60f1-4ad5-982f-57c2ea9fb0f9 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Refreshing network info cache for port 78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:45:30 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:45:30 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lazy-loading 'vcpu_model' on Instance uuid 68b29390-867e-4bf3-bc93-b401f32b130e {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AuHwQTaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:45:30 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:45:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:45:30 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:45:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:45:30 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:45:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da0e11e-1b12-4144-9025-549162738ddc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:45:30 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ffa63e-170e-4a88-a77b-ae04e479454b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b] added
Apr 12 10:45:30 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7021c66a-7b6a-4fa9-955a-696af2c40c63]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f55d66b-b5c8-4c23-a79d-4e6631723618]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:45:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AuHwQTaV {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AuHwQTaV" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cbbb7e-b6b6-4463-b96e-1535672effe3]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AuHwQTaV'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c7ff55-2654-45d5-a5b6-562a3819a99e]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2030c87c-e2fc-4188-bcf6-448b56002bcb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:45:31 user nova-compute[71557]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:45:31 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:45:31 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:45:31 user nova-compute[71557]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:45:31 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:45:31 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[571bbeb7-7ff8-49bb-bd6f-661e1a328c5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b, portal: 172.16.0.220,3260]
Apr 12 10:45:31 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b, portal: 172.16.0.220,3260] successful.
Apr 12 10:45:31 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e988def1-468f-4e13-a2a7-632b37642d2d]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[548ee967-abc8-4301-8be3-adfd88e49175]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:45:31 user nova-compute[71557]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:45:31 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:45:31 user nova-compute[71557]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:45:31 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:45:31 user nova-compute[71557]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:45:31 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:45:31 user nova-compute[71557]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:45:31 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[362667ce-098b-4b49-83c8-53003e41f0fa]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AuHwQTaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG nova.network.neutron [req-f85aaa38-1ab9-4dcb-b5d6-d22e459eba1a req-0780838b-60f1-4ad5-982f-57c2ea9fb0f9 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Updated VIF entry in instance network info cache for port 78a8426a-653a-44cb-80b7-8a8b14d78cf4. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG nova.network.neutron [req-f85aaa38-1ab9-4dcb-b5d6-d22e459eba1a req-0780838b-60f1-4ad5-982f-57c2ea9fb0f9 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Updating instance_info_cache with network_info: [{"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:45:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f85aaa38-1ab9-4dcb-b5d6-d22e459eba1a req-0780838b-60f1-4ad5-982f-57c2ea9fb0f9 service nova] Releasing lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:45:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:45:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23763313534396162', 'path': '/dev/sde'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:45:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763313534396162', 'path': '/dev/sde'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:45:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T10:41:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1222922378',display_name='tempest-TestShelveInstance-server-1222922378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1222922378',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-577615131',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='90ef7aa45de34b01a97b6bc5e0acece5',ramdisk_id='',reservation_id='r-yukf9uzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1176962424',owner_user_name='tempest-TestShelveInstance-1176962424-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:45:24Z,user_data=None,user_id='574af27cae41457c9be3d5d50d347b27',uuid=68b29390-867e-4bf3-bc93-b401f32b130e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:45:32 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Converting VIF {"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:45:32 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d2:fe,bridge_name='br-int',has_traffic_filtering=True,id=78a8426a-653a-44cb-80b7-8a8b14d78cf4,network=Network(f87563f2-62e3-4d56-b03a-0a830493f69b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a8426a-65') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:45:32 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lazy-loading 'pci_devices' on Instance uuid 68b29390-867e-4bf3-bc93-b401f32b130e {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:45:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:45:32 user nova-compute[71557]:   <uuid>68b29390-867e-4bf3-bc93-b401f32b130e</uuid>
Apr 12 10:45:32 user nova-compute[71557]:   <name>instance-00000014</name>
Apr 12 10:45:32 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:45:32 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:45:32 user nova-compute[71557]:   <metadata>
Apr 12 10:45:32 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:45:32 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:45:32 user nova-compute[71557]:       <nova:name>tempest-TestShelveInstance-server-1222922378</nova:name>
Apr 12 10:45:32 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:45:30</nova:creationTime>
Apr 12 10:45:32 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:45:32 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:45:32 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:45:32 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:45:32 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:45:32 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:45:32 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:45:32 user nova-compute[71557]:       <nova:owner>
Apr 12 10:45:32 user nova-compute[71557]:         <nova:user uuid="574af27cae41457c9be3d5d50d347b27">tempest-TestShelveInstance-1176962424-project-member</nova:user>
Apr 12 10:45:32 user nova-compute[71557]:         <nova:project uuid="90ef7aa45de34b01a97b6bc5e0acece5">tempest-TestShelveInstance-1176962424</nova:project>
Apr 12 10:45:32 user nova-compute[71557]:       </nova:owner>
Apr 12 10:45:32 user nova-compute[71557]:       <nova:ports>
Apr 12 10:45:32 user nova-compute[71557]:         <nova:port uuid="78a8426a-653a-44cb-80b7-8a8b14d78cf4">
Apr 12 10:45:32 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 10:45:32 user nova-compute[71557]:         </nova:port>
Apr 12 10:45:32 user nova-compute[71557]:       </nova:ports>
Apr 12 10:45:32 user nova-compute[71557]:     </nova:instance>
Apr 12 10:45:32 user nova-compute[71557]:   </metadata>
Apr 12 10:45:32 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:45:32 user nova-compute[71557]:     <system>
Apr 12 10:45:32 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:45:32 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:45:32 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:45:32 user nova-compute[71557]:       <entry name="serial">68b29390-867e-4bf3-bc93-b401f32b130e</entry>
Apr 12 10:45:32 user nova-compute[71557]:       <entry name="uuid">68b29390-867e-4bf3-bc93-b401f32b130e</entry>
Apr 12 10:45:32 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:45:32 user nova-compute[71557]:     </system>
Apr 12 10:45:32 user nova-compute[71557]:   </sysinfo>
Apr 12 10:45:32 user nova-compute[71557]:   <os>
Apr 12 10:45:32 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:45:32 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:45:32 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:45:32 user nova-compute[71557]:   </os>
Apr 12 10:45:32 user nova-compute[71557]:   <features>
Apr 12 10:45:32 user nova-compute[71557]:     <acpi/>
Apr 12 10:45:32 user nova-compute[71557]:     <apic/>
Apr 12 10:45:32 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:45:32 user nova-compute[71557]:   </features>
Apr 12 10:45:32 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:45:32 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:45:32 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:45:32 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:45:32 user nova-compute[71557]:   </clock>
Apr 12 10:45:32 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:45:32 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:45:32 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:45:32 user nova-compute[71557]:   </cpu>
Apr 12 10:45:32 user nova-compute[71557]:   <devices>
Apr 12 10:45:32 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:45:32 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:45:32 user nova-compute[71557]:       <source dev="/dev/sde"/>
Apr 12 10:45:32 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:45:32 user nova-compute[71557]:       <serial>e6850f05-a7ca-4a81-ad02-a1e4d506702b</serial>
Apr 12 10:45:32 user nova-compute[71557]:     </disk>
Apr 12 10:45:32 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:45:32 user nova-compute[71557]:       <mac address="fa:16:3e:6a:d2:fe"/>
Apr 12 10:45:32 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:45:32 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:45:32 user nova-compute[71557]:       <target dev="tap78a8426a-65"/>
Apr 12 10:45:32 user nova-compute[71557]:     </interface>
Apr 12 10:45:32 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:45:32 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/68b29390-867e-4bf3-bc93-b401f32b130e/console.log" append="off"/>
Apr 12 10:45:32 user nova-compute[71557]:     </serial>
Apr 12 10:45:32 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:45:32 user nova-compute[71557]:     <video>
Apr 12 10:45:32 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:45:32 user nova-compute[71557]:     </video>
Apr 12 10:45:32 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:45:32 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:45:32 user nova-compute[71557]:     </rng>
Apr 12 10:45:32 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:45:32 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:45:32 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:45:32 user nova-compute[71557]:     </memballoon>
Apr 12 10:45:32 user nova-compute[71557]:   </devices>
Apr 12 10:45:32 user nova-compute[71557]: </domain>
Apr 12 10:45:32 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:45:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T10:41:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1222922378',display_name='tempest-TestShelveInstance-server-1222922378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1222922378',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-577615131',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='90ef7aa45de34b01a97b6bc5e0acece5',ramdisk_id='',reservation_id='r-yukf9uzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1176962424',owner_user_name='tempest-TestShelveInstance-1176962424-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:45:24Z,user_data=None,user_id='574af27cae41457c9be3d5d50d347b27',uuid=68b29390-867e-4bf3-bc93-b401f32b130e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:45:32 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Converting VIF {"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:45:32 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d2:fe,bridge_name='br-int',has_traffic_filtering=True,id=78a8426a-653a-44cb-80b7-8a8b14d78cf4,network=Network(f87563f2-62e3-4d56-b03a-0a830493f69b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a8426a-65') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:45:32 user nova-compute[71557]: DEBUG os_vif [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d2:fe,bridge_name='br-int',has_traffic_filtering=True,id=78a8426a-653a-44cb-80b7-8a8b14d78cf4,network=Network(f87563f2-62e3-4d56-b03a-0a830493f69b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a8426a-65') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:45:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:45:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:45:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78a8426a-65, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:45:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap78a8426a-65, col_values=(('external_ids', {'iface-id': '78a8426a-653a-44cb-80b7-8a8b14d78cf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:d2:fe', 'vm-uuid': '68b29390-867e-4bf3-bc93-b401f32b130e'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:45:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:45:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:32 user nova-compute[71557]: INFO os_vif [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d2:fe,bridge_name='br-int',has_traffic_filtering=True,id=78a8426a-653a-44cb-80b7-8a8b14d78cf4,network=Network(f87563f2-62e3-4d56-b03a-0a830493f69b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a8426a-65')
Apr 12 10:45:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:45:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] No VIF found with MAC fa:16:3e:6a:d2:fe, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:45:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:34 user nova-compute[71557]: DEBUG nova.compute.manager [req-aa476313-d2a6-414a-b94f-7bc1cb894803 req-4cdd609c-7102-4a59-8d14-757a270d0925 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Received event network-vif-plugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:45:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-aa476313-d2a6-414a-b94f-7bc1cb894803 req-4cdd609c-7102-4a59-8d14-757a270d0925 service nova] Acquiring lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-aa476313-d2a6-414a-b94f-7bc1cb894803 req-4cdd609c-7102-4a59-8d14-757a270d0925 service nova] Lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-aa476313-d2a6-414a-b94f-7bc1cb894803 req-4cdd609c-7102-4a59-8d14-757a270d0925 service nova] Lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:34 user nova-compute[71557]: DEBUG nova.compute.manager [req-aa476313-d2a6-414a-b94f-7bc1cb894803 req-4cdd609c-7102-4a59-8d14-757a270d0925 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] No waiting events found dispatching network-vif-plugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:45:34 user nova-compute[71557]: WARNING nova.compute.manager [req-aa476313-d2a6-414a-b94f-7bc1cb894803 req-4cdd609c-7102-4a59-8d14-757a270d0925 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Received unexpected event network-vif-plugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 10:45:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:35 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296335.9782228, 68b29390-867e-4bf3-bc93-b401f32b130e => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:45:35 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] VM Resumed (Lifecycle Event)
Apr 12 10:45:35 user nova-compute[71557]: DEBUG nova.compute.manager [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:45:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:45:35 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Instance spawned successfully.
Apr 12 10:45:35 user nova-compute[71557]: DEBUG nova.compute.manager [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:45:36 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:45:36 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:45:36 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:45:36 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296335.9798174, 68b29390-867e-4bf3-bc93-b401f32b130e => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:45:36 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] VM Started (Lifecycle Event)
Apr 12 10:45:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a3e671c3-004f-4cf7-b54a-c5aff8256737 tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "68b29390-867e-4bf3-bc93-b401f32b130e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.317s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:36 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:45:36 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:45:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-f7b629aa-44cc-47e1-bb3a-08b4e41e553d req-0a2b75d4-e2dc-48f8-90b9-59156b0755d2 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Received event network-vif-plugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:45:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f7b629aa-44cc-47e1-bb3a-08b4e41e553d req-0a2b75d4-e2dc-48f8-90b9-59156b0755d2 service nova] Acquiring lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f7b629aa-44cc-47e1-bb3a-08b4e41e553d req-0a2b75d4-e2dc-48f8-90b9-59156b0755d2 service nova] Lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f7b629aa-44cc-47e1-bb3a-08b4e41e553d req-0a2b75d4-e2dc-48f8-90b9-59156b0755d2 service nova] Lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-f7b629aa-44cc-47e1-bb3a-08b4e41e553d req-0a2b75d4-e2dc-48f8-90b9-59156b0755d2 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] No waiting events found dispatching network-vif-plugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:45:36 user nova-compute[71557]: WARNING nova.compute.manager [req-f7b629aa-44cc-47e1-bb3a-08b4e41e553d req-0a2b75d4-e2dc-48f8-90b9-59156b0755d2 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Received unexpected event network-vif-plugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 for instance with vm_state active and task_state None.
Apr 12 10:45:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:47 user nova-compute[71557]: DEBUG nova.compute.manager [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:45:47 user nova-compute[71557]: INFO nova.compute.manager [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] instance snapshotting
Apr 12 10:45:47 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Beginning live snapshot process
Apr 12 10:45:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json -f qcow2 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json -f qcow2" returned: 0 in 0.152s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json -f qcow2 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.139s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjgmfj97w/00f3be16ff45442c8827f3794c67ddf4.delta 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjgmfj97w/00f3be16ff45442c8827f3794c67ddf4.delta 1073741824" returned: 0 in 0.054s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:48 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 10:45:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:49 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] COPY block job progress, current cursor: 65536 final cursor: 43778048 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:45:49 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 10:45:49 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 10:45:49 user nova-compute[71557]: DEBUG nova.privsep.utils [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71557) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 10:45:49 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjgmfj97w/00f3be16ff45442c8827f3794c67ddf4.delta /opt/stack/data/nova/instances/snapshots/tmpjgmfj97w/00f3be16ff45442c8827f3794c67ddf4 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:45:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjgmfj97w/00f3be16ff45442c8827f3794c67ddf4.delta /opt/stack/data/nova/instances/snapshots/tmpjgmfj97w/00f3be16ff45442c8827f3794c67ddf4" returned: 0 in 0.362s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:45:50 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Snapshot extracted, beginning image upload
Apr 12 10:45:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:52 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Snapshot image upload complete
Apr 12 10:45:52 user nova-compute[71557]: INFO nova.compute.manager [None req-87d9d54e-a49b-4c37-8302-633b3958630b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Took 4.74 seconds to snapshot the instance on the hypervisor.
Apr 12 10:45:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "6468f2a7-ce19-468d-8b8f-e6071cf437ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "6468f2a7-ce19-468d-8b8f-e6071cf437ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "6468f2a7-ce19-468d-8b8f-e6071cf437ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "6468f2a7-ce19-468d-8b8f-e6071cf437ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "6468f2a7-ce19-468d-8b8f-e6071cf437ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:56 user nova-compute[71557]: INFO nova.compute.manager [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Terminating instance
Apr 12 10:45:56 user nova-compute[71557]: DEBUG nova.compute.manager [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:45:56 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:56 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:56 user nova-compute[71557]: DEBUG nova.compute.manager [req-9e4eb256-93cd-4aa2-b77d-30c7d6401346 req-5a853ee8-495d-413a-82cc-11466feaa9a1 service nova] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Received event network-vif-unplugged-2970d881-0a68-41b7-a58c-1876abba1236 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:45:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9e4eb256-93cd-4aa2-b77d-30c7d6401346 req-5a853ee8-495d-413a-82cc-11466feaa9a1 service nova] Acquiring lock "6468f2a7-ce19-468d-8b8f-e6071cf437ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9e4eb256-93cd-4aa2-b77d-30c7d6401346 req-5a853ee8-495d-413a-82cc-11466feaa9a1 service nova] Lock "6468f2a7-ce19-468d-8b8f-e6071cf437ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9e4eb256-93cd-4aa2-b77d-30c7d6401346 req-5a853ee8-495d-413a-82cc-11466feaa9a1 service nova] Lock "6468f2a7-ce19-468d-8b8f-e6071cf437ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:56 user nova-compute[71557]: DEBUG nova.compute.manager [req-9e4eb256-93cd-4aa2-b77d-30c7d6401346 req-5a853ee8-495d-413a-82cc-11466feaa9a1 service nova] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] No waiting events found dispatching network-vif-unplugged-2970d881-0a68-41b7-a58c-1876abba1236 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:45:56 user nova-compute[71557]: DEBUG nova.compute.manager [req-9e4eb256-93cd-4aa2-b77d-30c7d6401346 req-5a853ee8-495d-413a-82cc-11466feaa9a1 service nova] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Received event network-vif-unplugged-2970d881-0a68-41b7-a58c-1876abba1236 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:45:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:57 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Instance destroyed successfully.
Apr 12 10:45:57 user nova-compute[71557]: DEBUG nova.objects.instance [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lazy-loading 'resources' on Instance uuid 6468f2a7-ce19-468d-8b8f-e6071cf437ff {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:45:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1626749449',display_name='tempest-VolumesActionsTest-instance-1626749449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1626749449',id=25,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:44:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71bb70c871154a14947ea3421553a229',ramdisk_id='',reservation_id='r-0wpproza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-715093810',owner_user_name='tempest-VolumesActionsTest-715093810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:44:13Z,user_data=None,user_id='bccad0e37147441cb68130a22197a5d4',uuid=6468f2a7-ce19-468d-8b8f-e6071cf437ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2970d881-0a68-41b7-a58c-1876abba1236", "address": "fa:16:3e:7a:10:3f", "network": {"id": "1b1e97a6-2805-47eb-b62a-777fed79a136", "bridge": "br-int", "label": "tempest-VolumesActionsTest-625847221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "71bb70c871154a14947ea3421553a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2970d881-0a", "ovs_interfaceid": "2970d881-0a68-41b7-a58c-1876abba1236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:45:57 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Converting VIF {"id": "2970d881-0a68-41b7-a58c-1876abba1236", "address": "fa:16:3e:7a:10:3f", "network": {"id": "1b1e97a6-2805-47eb-b62a-777fed79a136", "bridge": "br-int", "label": "tempest-VolumesActionsTest-625847221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "71bb70c871154a14947ea3421553a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2970d881-0a", "ovs_interfaceid": "2970d881-0a68-41b7-a58c-1876abba1236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:45:57 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:3f,bridge_name='br-int',has_traffic_filtering=True,id=2970d881-0a68-41b7-a58c-1876abba1236,network=Network(1b1e97a6-2805-47eb-b62a-777fed79a136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2970d881-0a') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:45:57 user nova-compute[71557]: DEBUG os_vif [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:3f,bridge_name='br-int',has_traffic_filtering=True,id=2970d881-0a68-41b7-a58c-1876abba1236,network=Network(1b1e97a6-2805-47eb-b62a-777fed79a136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2970d881-0a') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:45:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2970d881-0a, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:45:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:45:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:45:57 user nova-compute[71557]: INFO os_vif [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:3f,bridge_name='br-int',has_traffic_filtering=True,id=2970d881-0a68-41b7-a58c-1876abba1236,network=Network(1b1e97a6-2805-47eb-b62a-777fed79a136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2970d881-0a')
Apr 12 10:45:57 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Deleting instance files /opt/stack/data/nova/instances/6468f2a7-ce19-468d-8b8f-e6071cf437ff_del
Apr 12 10:45:57 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Deletion of /opt/stack/data/nova/instances/6468f2a7-ce19-468d-8b8f-e6071cf437ff_del complete
Apr 12 10:45:57 user nova-compute[71557]: INFO nova.compute.manager [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Took 0.97 seconds to destroy the instance on the hypervisor.
Apr 12 10:45:57 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:45:57 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:45:57 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:45:57 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:45:58 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Took 0.52 seconds to deallocate network for instance.
Apr 12 10:45:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:58 user nova-compute[71557]: DEBUG nova.compute.manager [req-e0859049-bb20-4beb-be94-9bfef941d4eb req-83f365f3-a503-403e-8430-5cb7303d28d9 service nova] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Received event network-vif-deleted-2970d881-0a68-41b7-a58c-1876abba1236 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:45:58 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:45:58 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:45:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:58 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Deleted allocations for instance 6468f2a7-ce19-468d-8b8f-e6071cf437ff
Apr 12 10:45:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-40e65fda-5211-4ec4-8113-d2091a466127 tempest-VolumesActionsTest-715093810 tempest-VolumesActionsTest-715093810-project-member] Lock "6468f2a7-ce19-468d-8b8f-e6071cf437ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.052s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:58 user nova-compute[71557]: DEBUG nova.compute.manager [req-40728744-2609-4f9a-a229-6fcaa7b05ed0 req-3903cadd-95d3-4228-8667-663a62bf4f4f service nova] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Received event network-vif-plugged-2970d881-0a68-41b7-a58c-1876abba1236 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:45:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-40728744-2609-4f9a-a229-6fcaa7b05ed0 req-3903cadd-95d3-4228-8667-663a62bf4f4f service nova] Acquiring lock "6468f2a7-ce19-468d-8b8f-e6071cf437ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:45:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-40728744-2609-4f9a-a229-6fcaa7b05ed0 req-3903cadd-95d3-4228-8667-663a62bf4f4f service nova] Lock "6468f2a7-ce19-468d-8b8f-e6071cf437ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:45:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-40728744-2609-4f9a-a229-6fcaa7b05ed0 req-3903cadd-95d3-4228-8667-663a62bf4f4f service nova] Lock "6468f2a7-ce19-468d-8b8f-e6071cf437ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:45:58 user nova-compute[71557]: DEBUG nova.compute.manager [req-40728744-2609-4f9a-a229-6fcaa7b05ed0 req-3903cadd-95d3-4228-8667-663a62bf4f4f service nova] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] No waiting events found dispatching network-vif-plugged-2970d881-0a68-41b7-a58c-1876abba1236 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:45:58 user nova-compute[71557]: WARNING nova.compute.manager [req-40728744-2609-4f9a-a229-6fcaa7b05ed0 req-3903cadd-95d3-4228-8667-663a62bf4f4f service nova] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Received unexpected event network-vif-plugged-2970d881-0a68-41b7-a58c-1876abba1236 for instance with vm_state deleted and task_state None.
Apr 12 10:46:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:03 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:46:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:03 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:46:03 user nova-compute[71557]: INFO nova.compute.claims [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Claim successful on node user
Apr 12 10:46:04 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:46:04 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:46:04 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG nova.policy [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47d6279f1ce94008a2898ade6f730b40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af33ce0944194932b663c3b8aef9783d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:46:04 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Creating image(s)
Apr 12 10:46:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "/opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "/opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "/opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.148s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.128s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk 1073741824" returned: 0 in 0.045s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.180s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:46:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:05 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:05 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Cannot resize image /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:46:05 user nova-compute[71557]: DEBUG nova.objects.instance [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'migration_context' on Instance uuid 76758da6-ef8f-433f-b4e8-8d72f01b6b34 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:46:05 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:46:05 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Ensure instance console log exists: /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:46:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:05 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Successfully created port: 65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:46:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:06 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Successfully updated port: 65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:46:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "refresh_cache-76758da6-ef8f-433f-b4e8-8d72f01b6b34" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:46:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquired lock "refresh_cache-76758da6-ef8f-433f-b4e8-8d72f01b6b34" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:46:06 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:46:06 user nova-compute[71557]: DEBUG nova.compute.manager [req-ba879151-2f51-46e8-af28-463a1a161165 req-7936cc2d-ad5f-4a78-b854-8b13e18f2c76 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Received event network-changed-65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:46:06 user nova-compute[71557]: DEBUG nova.compute.manager [req-ba879151-2f51-46e8-af28-463a1a161165 req-7936cc2d-ad5f-4a78-b854-8b13e18f2c76 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Refreshing instance network info cache due to event network-changed-65d96800-cdfa-49fe-a407-05d5b661f452. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:46:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ba879151-2f51-46e8-af28-463a1a161165 req-7936cc2d-ad5f-4a78-b854-8b13e18f2c76 service nova] Acquiring lock "refresh_cache-76758da6-ef8f-433f-b4e8-8d72f01b6b34" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:46:06 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Updating instance_info_cache with network_info: [{"id": "65d96800-cdfa-49fe-a407-05d5b661f452", "address": "fa:16:3e:29:b0:94", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d96800-cd", "ovs_interfaceid": "65d96800-cdfa-49fe-a407-05d5b661f452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Releasing lock "refresh_cache-76758da6-ef8f-433f-b4e8-8d72f01b6b34" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Instance network_info: |[{"id": "65d96800-cdfa-49fe-a407-05d5b661f452", "address": "fa:16:3e:29:b0:94", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d96800-cd", "ovs_interfaceid": "65d96800-cdfa-49fe-a407-05d5b661f452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ba879151-2f51-46e8-af28-463a1a161165 req-7936cc2d-ad5f-4a78-b854-8b13e18f2c76 service nova] Acquired lock "refresh_cache-76758da6-ef8f-433f-b4e8-8d72f01b6b34" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.network.neutron [req-ba879151-2f51-46e8-af28-463a1a161165 req-7936cc2d-ad5f-4a78-b854-8b13e18f2c76 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Refreshing network info cache for port 65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Start _get_guest_xml network_info=[{"id": "65d96800-cdfa-49fe-a407-05d5b661f452", "address": "fa:16:3e:29:b0:94", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d96800-cd", "ovs_interfaceid": "65d96800-cdfa-49fe-a407-05d5b661f452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:46:07 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:46:07 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-637881895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-637881895',id=28,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+kfG5JhTbXJvo4JchrKmOzn92ZUEmlrTD0glXq+axhyaimCqqgKU45MbV6YpEhNYXodiKBbWNpJwThQxwbW5Ag7tRarIRqtDBp4vnVNoqqjXoHeq8fGfxhehEge51e0Q==',key_name='tempest-keypair-538398767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af33ce0944194932b663c3b8aef9783d',ramdisk_id='',reservation_id='r-g610bp0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-603525697',owner_user_name='tempest-AttachVolumeShelveTestJSON-603525697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:46:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d6279f1ce94008a2898ade6f730b40',uuid=76758da6-ef8f-433f-b4e8-8d72f01b6b34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65d96800-cdfa-49fe-a407-05d5b661f452", "address": "fa:16:3e:29:b0:94", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d96800-cd", "ovs_interfaceid": "65d96800-cdfa-49fe-a407-05d5b661f452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converting VIF {"id": "65d96800-cdfa-49fe-a407-05d5b661f452", "address": "fa:16:3e:29:b0:94", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d96800-cd", "ovs_interfaceid": "65d96800-cdfa-49fe-a407-05d5b661f452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:b0:94,bridge_name='br-int',has_traffic_filtering=True,id=65d96800-cdfa-49fe-a407-05d5b661f452,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d96800-cd') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.objects.instance [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'pci_devices' on Instance uuid 76758da6-ef8f-433f-b4e8-8d72f01b6b34 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:46:07 user nova-compute[71557]:   <uuid>76758da6-ef8f-433f-b4e8-8d72f01b6b34</uuid>
Apr 12 10:46:07 user nova-compute[71557]:   <name>instance-0000001c</name>
Apr 12 10:46:07 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:46:07 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:46:07 user nova-compute[71557]:   <metadata>
Apr 12 10:46:07 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:46:07 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:46:07 user nova-compute[71557]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-637881895</nova:name>
Apr 12 10:46:07 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:46:07</nova:creationTime>
Apr 12 10:46:07 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:46:07 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:46:07 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:46:07 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:46:07 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:46:07 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:46:07 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:46:07 user nova-compute[71557]:       <nova:owner>
Apr 12 10:46:07 user nova-compute[71557]:         <nova:user uuid="47d6279f1ce94008a2898ade6f730b40">tempest-AttachVolumeShelveTestJSON-603525697-project-member</nova:user>
Apr 12 10:46:07 user nova-compute[71557]:         <nova:project uuid="af33ce0944194932b663c3b8aef9783d">tempest-AttachVolumeShelveTestJSON-603525697</nova:project>
Apr 12 10:46:07 user nova-compute[71557]:       </nova:owner>
Apr 12 10:46:07 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:46:07 user nova-compute[71557]:       <nova:ports>
Apr 12 10:46:07 user nova-compute[71557]:         <nova:port uuid="65d96800-cdfa-49fe-a407-05d5b661f452">
Apr 12 10:46:07 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 10:46:07 user nova-compute[71557]:         </nova:port>
Apr 12 10:46:07 user nova-compute[71557]:       </nova:ports>
Apr 12 10:46:07 user nova-compute[71557]:     </nova:instance>
Apr 12 10:46:07 user nova-compute[71557]:   </metadata>
Apr 12 10:46:07 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:46:07 user nova-compute[71557]:     <system>
Apr 12 10:46:07 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:46:07 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:46:07 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:46:07 user nova-compute[71557]:       <entry name="serial">76758da6-ef8f-433f-b4e8-8d72f01b6b34</entry>
Apr 12 10:46:07 user nova-compute[71557]:       <entry name="uuid">76758da6-ef8f-433f-b4e8-8d72f01b6b34</entry>
Apr 12 10:46:07 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:46:07 user nova-compute[71557]:     </system>
Apr 12 10:46:07 user nova-compute[71557]:   </sysinfo>
Apr 12 10:46:07 user nova-compute[71557]:   <os>
Apr 12 10:46:07 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:46:07 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:46:07 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:46:07 user nova-compute[71557]:   </os>
Apr 12 10:46:07 user nova-compute[71557]:   <features>
Apr 12 10:46:07 user nova-compute[71557]:     <acpi/>
Apr 12 10:46:07 user nova-compute[71557]:     <apic/>
Apr 12 10:46:07 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:46:07 user nova-compute[71557]:   </features>
Apr 12 10:46:07 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:46:07 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:46:07 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:46:07 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:46:07 user nova-compute[71557]:   </clock>
Apr 12 10:46:07 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:46:07 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:46:07 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:46:07 user nova-compute[71557]:   </cpu>
Apr 12 10:46:07 user nova-compute[71557]:   <devices>
Apr 12 10:46:07 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:46:07 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:46:07 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk"/>
Apr 12 10:46:07 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:46:07 user nova-compute[71557]:     </disk>
Apr 12 10:46:07 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:46:07 user nova-compute[71557]:       <mac address="fa:16:3e:29:b0:94"/>
Apr 12 10:46:07 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:46:07 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:46:07 user nova-compute[71557]:       <target dev="tap65d96800-cd"/>
Apr 12 10:46:07 user nova-compute[71557]:     </interface>
Apr 12 10:46:07 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:46:07 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/console.log" append="off"/>
Apr 12 10:46:07 user nova-compute[71557]:     </serial>
Apr 12 10:46:07 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:46:07 user nova-compute[71557]:     <video>
Apr 12 10:46:07 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:46:07 user nova-compute[71557]:     </video>
Apr 12 10:46:07 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:46:07 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:46:07 user nova-compute[71557]:     </rng>
Apr 12 10:46:07 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:46:07 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:46:07 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:46:07 user nova-compute[71557]:     </memballoon>
Apr 12 10:46:07 user nova-compute[71557]:   </devices>
Apr 12 10:46:07 user nova-compute[71557]: </domain>
Apr 12 10:46:07 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-637881895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-637881895',id=28,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+kfG5JhTbXJvo4JchrKmOzn92ZUEmlrTD0glXq+axhyaimCqqgKU45MbV6YpEhNYXodiKBbWNpJwThQxwbW5Ag7tRarIRqtDBp4vnVNoqqjXoHeq8fGfxhehEge51e0Q==',key_name='tempest-keypair-538398767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af33ce0944194932b663c3b8aef9783d',ramdisk_id='',reservation_id='r-g610bp0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-603525697',owner_user_name='tempest-AttachVolumeShelveTestJSON-603525697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:46:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d6279f1ce94008a2898ade6f730b40',uuid=76758da6-ef8f-433f-b4e8-8d72f01b6b34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65d96800-cdfa-49fe-a407-05d5b661f452", "address": "fa:16:3e:29:b0:94", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d96800-cd", "ovs_interfaceid": "65d96800-cdfa-49fe-a407-05d5b661f452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converting VIF {"id": "65d96800-cdfa-49fe-a407-05d5b661f452", "address": "fa:16:3e:29:b0:94", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d96800-cd", "ovs_interfaceid": "65d96800-cdfa-49fe-a407-05d5b661f452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:b0:94,bridge_name='br-int',has_traffic_filtering=True,id=65d96800-cdfa-49fe-a407-05d5b661f452,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d96800-cd') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG os_vif [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:b0:94,bridge_name='br-int',has_traffic_filtering=True,id=65d96800-cdfa-49fe-a407-05d5b661f452,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d96800-cd') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65d96800-cd, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap65d96800-cd, col_values=(('external_ids', {'iface-id': '65d96800-cdfa-49fe-a407-05d5b661f452', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:b0:94', 'vm-uuid': '76758da6-ef8f-433f-b4e8-8d72f01b6b34'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:07 user nova-compute[71557]: INFO os_vif [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:b0:94,bridge_name='br-int',has_traffic_filtering=True,id=65d96800-cdfa-49fe-a407-05d5b661f452,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d96800-cd')
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] No VIF found with MAC fa:16:3e:29:b0:94, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.network.neutron [req-ba879151-2f51-46e8-af28-463a1a161165 req-7936cc2d-ad5f-4a78-b854-8b13e18f2c76 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Updated VIF entry in instance network info cache for port 65d96800-cdfa-49fe-a407-05d5b661f452. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG nova.network.neutron [req-ba879151-2f51-46e8-af28-463a1a161165 req-7936cc2d-ad5f-4a78-b854-8b13e18f2c76 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Updating instance_info_cache with network_info: [{"id": "65d96800-cdfa-49fe-a407-05d5b661f452", "address": "fa:16:3e:29:b0:94", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d96800-cd", "ovs_interfaceid": "65d96800-cdfa-49fe-a407-05d5b661f452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:46:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ba879151-2f51-46e8-af28-463a1a161165 req-7936cc2d-ad5f-4a78-b854-8b13e18f2c76 service nova] Releasing lock "refresh_cache-76758da6-ef8f-433f-b4e8-8d72f01b6b34" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:46:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:08 user nova-compute[71557]: DEBUG nova.network.neutron [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Port fa1878d2-9c1a-4fda-bdbf-b226839d56c4 binding to destination host user is already ACTIVE {{(pid=71557) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 10:46:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:46:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquired lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:46:08 user nova-compute[71557]: DEBUG nova.network.neutron [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:46:09 user nova-compute[71557]: DEBUG nova.compute.manager [req-18199ad2-3893-4fb3-873e-24c213019208 req-86465369-d25d-4135-8811-d082ab4797e6 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Received event network-vif-plugged-65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:46:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-18199ad2-3893-4fb3-873e-24c213019208 req-86465369-d25d-4135-8811-d082ab4797e6 service nova] Acquiring lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-18199ad2-3893-4fb3-873e-24c213019208 req-86465369-d25d-4135-8811-d082ab4797e6 service nova] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-18199ad2-3893-4fb3-873e-24c213019208 req-86465369-d25d-4135-8811-d082ab4797e6 service nova] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:09 user nova-compute[71557]: DEBUG nova.compute.manager [req-18199ad2-3893-4fb3-873e-24c213019208 req-86465369-d25d-4135-8811-d082ab4797e6 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] No waiting events found dispatching network-vif-plugged-65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:46:09 user nova-compute[71557]: WARNING nova.compute.manager [req-18199ad2-3893-4fb3-873e-24c213019208 req-86465369-d25d-4135-8811-d082ab4797e6 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Received unexpected event network-vif-plugged-65d96800-cdfa-49fe-a407-05d5b661f452 for instance with vm_state building and task_state spawning.
Apr 12 10:46:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:09 user nova-compute[71557]: DEBUG nova.network.neutron [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Updating instance_info_cache with network_info: [{"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:46:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Releasing lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:46:09 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Creating tmpfile /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/tmpgpjku27s to verify with other compute node that the instance is on the same shared storage. {{(pid=71557) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 12 10:46:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:10 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Instance destroyed successfully.
Apr 12 10:46:10 user nova-compute[71557]: DEBUG nova.objects.instance [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'resources' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T10:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1895953867',display_name='tempest-ServerActionsTestJSON-server-1970085629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1895953867',id=4,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSPzZAK4K6WfKgZv6ul+nJ2Lzppw5IMfK0+f9KuGByC6XjA59WQJmgMTCh01/yWlwW8qMjnx6gjYen9tQKzYmdVo3Z1KGqS/wGYHKKDRVeNNONzm9HfPYp2EDH6xyugDA==',key_name='tempest-keypair-1241183546',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:44:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32235c67d269474b879a58269c1bfb28',ramdisk_id='',reservation_id='r-m0f2y2eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2042231427',owner_user_name='tempest-ServerActionsTestJSON-2042231427-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:44:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0059d31539304ffcb5214b408751cd4f',uuid=bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converting VIF {"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG os_vif [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa1878d2-9c, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:46:10 user nova-compute[71557]: INFO os_vif [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c')
Apr 12 10:46:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNTjbEai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:46:10 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:46:10 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb184b4-388b-458b-a811-b6c5cbd7bc74]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:46:10 user nova-compute[71557]: No targets found.
Apr 12 10:46:10 user nova-compute[71557]: iSNS:
Apr 12 10:46:10 user nova-compute[71557]: No targets found.
Apr 12 10:46:10 user nova-compute[71557]: STATIC:
Apr 12 10:46:10 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:46:10 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:46:10 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:46:10 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b
Apr 12 10:46:10 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:46:10 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:46:10 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61
Apr 12 10:46:10 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:46:10 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:46:10 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711
Apr 12 10:46:10 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:46:10 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:46:10 user nova-compute[71557]: FIRMWARE:
Apr 12 10:46:10 user nova-compute[71557]: No targets found.
Apr 12 10:46:10 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:46:10 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:46:10 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52e9b79-841f-47e1-9057-05a29e15d4f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[36573627-4880-4bc1-a1ed-64b10f330d10]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:46:10 user nova-compute[71557]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:46:10 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:46:10 user nova-compute[71557]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:46:10 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:46:10 user nova-compute[71557]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:46:10 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:46:10 user nova-compute[71557]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:46:10 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fc423ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61'): ({'sdc'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Removing single pathed devices sdc {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf43446b-4616-47ca-8f33-1c0cf0ca7fbe]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc472c8b-e707-44e6-89bc-9a00f9d3491e]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flushing IO for device /dev/sdc {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b60285-3ece-448d-9d82-5f7c1a2a7951]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e942a453-83e4-43ed-8677-7606bf0032c7]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] SCSI volumes sdc have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68d405d-e5e2-46d1-acc8-4654a3299b1c]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[427de776-ca99-4a95-ac33-b68d30880d23]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260]
Apr 12 10:46:10 user nova-compute[71557]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260] successful.
Apr 12 10:46:10 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffa87cd-69fc-4a1d-a667-2a0df7d57486]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] <== disconnect_volume: return (346ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296370.8429563, 76758da6-ef8f-433f-b4e8-8d72f01b6b34 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:46:10 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] VM Resumed (Lifecycle Event)
Apr 12 10:46:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:46:10 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Instance spawned successfully.
Apr 12 10:46:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:46:10 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:46:10 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296370.8441694, 76758da6-ef8f-433f-b4e8-8d72f01b6b34 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:46:10 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] VM Started (Lifecycle Event)
Apr 12 10:46:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:46:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:46:10 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:46:10 user nova-compute[71557]: INFO nova.compute.manager [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Took 6.51 seconds to spawn the instance on the hypervisor.
Apr 12 10:46:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:46:11 user nova-compute[71557]: INFO nova.compute.manager [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Took 7.25 seconds to build instance.
Apr 12 10:46:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5bdacd4e-a8e7-468d-9028-a7ca87674680 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.341s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:11 user nova-compute[71557]: DEBUG nova.compute.manager [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Received event network-vif-plugged-65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:46:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] Acquiring lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:11 user nova-compute[71557]: DEBUG nova.compute.manager [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] No waiting events found dispatching network-vif-plugged-65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:46:11 user nova-compute[71557]: WARNING nova.compute.manager [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Received unexpected event network-vif-plugged-65d96800-cdfa-49fe-a407-05d5b661f452 for instance with vm_state active and task_state None.
Apr 12 10:46:11 user nova-compute[71557]: DEBUG nova.compute.manager [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-vif-unplugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:46:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:11 user nova-compute[71557]: DEBUG nova.compute.manager [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] No waiting events found dispatching network-vif-unplugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:46:11 user nova-compute[71557]: WARNING nova.compute.manager [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received unexpected event network-vif-unplugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance with vm_state resized and task_state resize_reverting.
Apr 12 10:46:11 user nova-compute[71557]: DEBUG nova.compute.manager [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:46:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:11 user nova-compute[71557]: DEBUG nova.compute.manager [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] No waiting events found dispatching network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:46:11 user nova-compute[71557]: WARNING nova.compute.manager [req-f4cfd2ae-8c9c-4b2b-a7b4-b614fc22fec0 req-ce60efd4-1630-4543-bd7a-f74f4e97aa70 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received unexpected event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance with vm_state resized and task_state resize_reverting.
Apr 12 10:46:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:11 user nova-compute[71557]: DEBUG nova.objects.instance [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'migration_context' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:46:12 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:46:12 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296357.3400767, 6468f2a7-ce19-468d-8b8f-e6071cf437ff => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:46:12 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] VM Stopped (Lifecycle Event)
Apr 12 10:46:12 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:46:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-feffb1ba-28c7-4ca1-b8b5-9251d7d5fd40 None None] [instance: 6468f2a7-ce19-468d-8b8f-e6071cf437ff] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:46:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.481s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:12 user nova-compute[71557]: INFO nova.compute.manager [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Swapping old allocation on dict_keys(['24299bcb-a671-492d-9d13-df83697a8f87']) held by migration 709e0919-ecda-4e48-84b6-f1c05de9938b for instance
Apr 12 10:46:12 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Overwriting current allocation {'allocations': {'24299bcb-a671-492d-9d13-df83697a8f87': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 34}}, 'project_id': '32235c67d269474b879a58269c1bfb28', 'user_id': '0059d31539304ffcb5214b408751cd4f', 'consumer_generation': 1} on consumer bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 12 10:46:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:46:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquired lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:46:12 user nova-compute[71557]: DEBUG nova.network.neutron [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG nova.network.neutron [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Updating instance_info_cache with network_info: [{"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Releasing lock "refresh_cache-bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG os_brick.utils [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef305344-ad8f-4892-a719-7ce62dd84710]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f937ad0-b4d7-4da7-9ea2-aa05903b7ab3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4941e4dc-2cdd-419c-b81e-63ed8db61d9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e323c58-e90e-433e-8435-8e20924ba3d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:46:13 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:46:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0757345-3778-4fa0-ac80-eede0701e723]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG os_brick.utils [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:46:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Starting finish_revert_migration {{(pid=71557) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Start _get_guest_xml network_info=[{"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'attachment_id': '30697db1-1679-4d90-913f-004c6df2bc4d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNTjbEai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b', 'attached_at': '2023-04-12T10:46:18.000000', 'detached_at': '', 'volume_id': '84e79e7d-5eb0-4960-b9ba-ff1afd54aa61', 'serial': '84e79e7d-5eb0-4960-b9ba-ff1afd54aa61'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:46:18 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:46:18 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:46:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG nova.objects.instance [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'vcpu_model' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNTjbEai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:46:18 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:46:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:46:18 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:46:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:46:18 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:46:18 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[739d9c79-9a13-41e8-a46b-af1d721a02fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:46:18 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f37f782-781a-4bc1-8667-840fa71c2b1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61] added
Apr 12 10:46:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5499f1f0-036f-4f38-8e26-6138c4f8e636]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.044s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[921806f3-0458-460f-9ca3-533700224a7c]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNTjbEai {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNTjbEai" returned: 0 in 0.032s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f766af2f-2e86-4808-a245-f6a2a6355878]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rNTjbEai'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:46:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.144s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[157b0ee3-25ba-4199-b9b9-f6084539485e]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a598a0cc-3fc0-495c-a998-8595e9f216c2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:46:19 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:46:19 user nova-compute[71557]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:46:19 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:46:19 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:46:19 user nova-compute[71557]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:46:19 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[612ed2bf-ca22-4314-b320-79e5114cae78]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260]
Apr 12 10:46:19 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260] successful.
Apr 12 10:46:19 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef54544-db6b-4bb7-813b-d948e8689ddf]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e5a070-65a4-4566-bf7f-2f4b9fc8dff5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:46:19 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:46:19 user nova-compute[71557]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:46:19 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:46:19 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:46:19 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:46:19 user nova-compute[71557]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:46:19 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:46:19 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.485s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[078cab4b-8981-4d75-889f-ab1c5e7dc778]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:46:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNTjbEai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:46:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.519s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:46:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] <== connect_volume: return (1521ms) {'type': 'block', 'scsi_wwn': '26331306233373636', 'path': '/dev/sdc'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:46:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331306233373636', 'path': '/dev/sdc'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:46:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T10:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1895953867',display_name='tempest-ServerActionsTestJSON-server-1970085629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1895953867',id=4,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSPzZAK4K6WfKgZv6ul+nJ2Lzppw5IMfK0+f9KuGByC6XjA59WQJmgMTCh01/yWlwW8qMjnx6gjYen9tQKzYmdVo3Z1KGqS/wGYHKKDRVeNNONzm9HfPYp2EDH6xyugDA==',key_name='tempest-keypair-1241183546',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:44:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32235c67d269474b879a58269c1bfb28',ramdisk_id='',reservation_id='r-m0f2y2eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2042231427',owner_user_name='tempest-ServerActionsTestJSON-2042231427-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:46:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0059d31539304ffcb5214b408751cd4f',uuid=bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:46:20 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converting VIF {"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:46:20 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:46:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:46:20 user nova-compute[71557]:   <uuid>bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b</uuid>
Apr 12 10:46:20 user nova-compute[71557]:   <name>instance-00000004</name>
Apr 12 10:46:20 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:46:20 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:46:20 user nova-compute[71557]:   <metadata>
Apr 12 10:46:20 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:46:20 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:46:20 user nova-compute[71557]:       <nova:name>tempest-ServerActionsTestJSON-server-1970085629</nova:name>
Apr 12 10:46:20 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:46:18</nova:creationTime>
Apr 12 10:46:20 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:46:20 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:46:20 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:46:20 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:46:20 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:46:20 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:46:20 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:46:20 user nova-compute[71557]:       <nova:owner>
Apr 12 10:46:20 user nova-compute[71557]:         <nova:user uuid="0059d31539304ffcb5214b408751cd4f">tempest-ServerActionsTestJSON-2042231427-project-member</nova:user>
Apr 12 10:46:20 user nova-compute[71557]:         <nova:project uuid="32235c67d269474b879a58269c1bfb28">tempest-ServerActionsTestJSON-2042231427</nova:project>
Apr 12 10:46:20 user nova-compute[71557]:       </nova:owner>
Apr 12 10:46:20 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:46:20 user nova-compute[71557]:       <nova:ports>
Apr 12 10:46:20 user nova-compute[71557]:         <nova:port uuid="fa1878d2-9c1a-4fda-bdbf-b226839d56c4">
Apr 12 10:46:20 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 10:46:20 user nova-compute[71557]:         </nova:port>
Apr 12 10:46:20 user nova-compute[71557]:       </nova:ports>
Apr 12 10:46:20 user nova-compute[71557]:     </nova:instance>
Apr 12 10:46:20 user nova-compute[71557]:   </metadata>
Apr 12 10:46:20 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:46:20 user nova-compute[71557]:     <system>
Apr 12 10:46:20 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:46:20 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:46:20 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:46:20 user nova-compute[71557]:       <entry name="serial">bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b</entry>
Apr 12 10:46:20 user nova-compute[71557]:       <entry name="uuid">bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b</entry>
Apr 12 10:46:20 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:46:20 user nova-compute[71557]:     </system>
Apr 12 10:46:20 user nova-compute[71557]:   </sysinfo>
Apr 12 10:46:20 user nova-compute[71557]:   <os>
Apr 12 10:46:20 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:46:20 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:46:20 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:46:20 user nova-compute[71557]:   </os>
Apr 12 10:46:20 user nova-compute[71557]:   <features>
Apr 12 10:46:20 user nova-compute[71557]:     <acpi/>
Apr 12 10:46:20 user nova-compute[71557]:     <apic/>
Apr 12 10:46:20 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:46:20 user nova-compute[71557]:   </features>
Apr 12 10:46:20 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:46:20 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:46:20 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:46:20 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:46:20 user nova-compute[71557]:   </clock>
Apr 12 10:46:20 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:46:20 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:46:20 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:46:20 user nova-compute[71557]:   </cpu>
Apr 12 10:46:20 user nova-compute[71557]:   <devices>
Apr 12 10:46:20 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:46:20 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:46:20 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk"/>
Apr 12 10:46:20 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:46:20 user nova-compute[71557]:     </disk>
Apr 12 10:46:20 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:46:20 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:46:20 user nova-compute[71557]:       <source dev="/dev/sdc"/>
Apr 12 10:46:20 user nova-compute[71557]:       <target dev="vdb" bus="virtio"/>
Apr 12 10:46:20 user nova-compute[71557]:       <serial>84e79e7d-5eb0-4960-b9ba-ff1afd54aa61</serial>
Apr 12 10:46:20 user nova-compute[71557]:     </disk>
Apr 12 10:46:20 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:46:20 user nova-compute[71557]:       <mac address="fa:16:3e:fe:65:45"/>
Apr 12 10:46:20 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:46:20 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:46:20 user nova-compute[71557]:       <target dev="tapfa1878d2-9c"/>
Apr 12 10:46:20 user nova-compute[71557]:     </interface>
Apr 12 10:46:20 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:46:20 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/console.log" append="off"/>
Apr 12 10:46:20 user nova-compute[71557]:     </serial>
Apr 12 10:46:20 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:46:20 user nova-compute[71557]:     <video>
Apr 12 10:46:20 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:46:20 user nova-compute[71557]:     </video>
Apr 12 10:46:20 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:46:20 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:46:20 user nova-compute[71557]:     </rng>
Apr 12 10:46:20 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:46:20 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:46:20 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:46:20 user nova-compute[71557]:     </memballoon>
Apr 12 10:46:20 user nova-compute[71557]:   </devices>
Apr 12 10:46:20 user nova-compute[71557]: </domain>
Apr 12 10:46:20 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:46:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T10:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1895953867',display_name='tempest-ServerActionsTestJSON-server-1970085629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1895953867',id=4,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSPzZAK4K6WfKgZv6ul+nJ2Lzppw5IMfK0+f9KuGByC6XjA59WQJmgMTCh01/yWlwW8qMjnx6gjYen9tQKzYmdVo3Z1KGqS/wGYHKKDRVeNNONzm9HfPYp2EDH6xyugDA==',key_name='tempest-keypair-1241183546',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:44:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32235c67d269474b879a58269c1bfb28',ramdisk_id='',reservation_id='r-m0f2y2eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2042231427',owner_user_name='tempest-ServerActionsTestJSON-2042231427-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:46:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0059d31539304ffcb5214b408751cd4f',uuid=bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:46:20 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converting VIF {"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:46:20 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:46:20 user nova-compute[71557]: DEBUG os_vif [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:46:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:46:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:46:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa1878d2-9c, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:46:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfa1878d2-9c, col_values=(('external_ids', {'iface-id': 'fa1878d2-9c1a-4fda-bdbf-b226839d56c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:65:45', 'vm-uuid': 'bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:46:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:46:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:20 user nova-compute[71557]: INFO os_vif [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c')
Apr 12 10:46:21 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:46:21 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Cleaning up deleted instances with incomplete migration  {{(pid=71557) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 10:46:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:22 user nova-compute[71557]: DEBUG nova.compute.manager [req-064e1694-f27b-4191-b97a-fdc6d528d1dc req-13b977f7-f46b-4807-a1a9-58081b95fc89 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:46:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-064e1694-f27b-4191-b97a-fdc6d528d1dc req-13b977f7-f46b-4807-a1a9-58081b95fc89 service nova] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-064e1694-f27b-4191-b97a-fdc6d528d1dc req-13b977f7-f46b-4807-a1a9-58081b95fc89 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-064e1694-f27b-4191-b97a-fdc6d528d1dc req-13b977f7-f46b-4807-a1a9-58081b95fc89 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:22 user nova-compute[71557]: DEBUG nova.compute.manager [req-064e1694-f27b-4191-b97a-fdc6d528d1dc req-13b977f7-f46b-4807-a1a9-58081b95fc89 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] No waiting events found dispatching network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:46:22 user nova-compute[71557]: WARNING nova.compute.manager [req-064e1694-f27b-4191-b97a-fdc6d528d1dc req-13b977f7-f46b-4807-a1a9-58081b95fc89 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received unexpected event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance with vm_state resized and task_state resize_reverting.
Apr 12 10:46:22 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:46:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:46:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "aa5a8d3c-a65a-4a05-9874-ad22b597ddec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "aa5a8d3c-a65a-4a05-9874-ad22b597ddec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:46:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:23 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:46:23 user nova-compute[71557]: INFO nova.compute.claims [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Claim successful on node user
Apr 12 10:46:23 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:46:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:23 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:46:23 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:46:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:46:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.365s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:23 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:46:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:46:23 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:46:23 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:46:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:46:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:23 user nova-compute[71557]: INFO nova.virt.block_device [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Booting with volume snapshot fcd3e73e-84d4-4ba4-a63d-270062819303 at /dev/vda
Apr 12 10:46:23 user nova-compute[71557]: DEBUG nova.policy [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:46:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:46:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:46:24 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Removed pending event for bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b due to event {{(pid=71557) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 10:46:24 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296384.0024536, bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:46:24 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] VM Resumed (Lifecycle Event)
Apr 12 10:46:24 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Instance running successfully.
Apr 12 10:46:24 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] finish_revert_migration finished successfully. {{(pid=71557) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 12 10:46:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:46:24 user nova-compute[71557]: DEBUG nova.compute.manager [req-43b13a1e-2c64-4e61-a18c-a78a00595052 req-ff4b200d-2d72-40b7-a091-aac462bcd263 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:46:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-43b13a1e-2c64-4e61-a18c-a78a00595052 req-ff4b200d-2d72-40b7-a091-aac462bcd263 service nova] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-43b13a1e-2c64-4e61-a18c-a78a00595052 req-ff4b200d-2d72-40b7-a091-aac462bcd263 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-43b13a1e-2c64-4e61-a18c-a78a00595052 req-ff4b200d-2d72-40b7-a091-aac462bcd263 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:24 user nova-compute[71557]: DEBUG nova.compute.manager [req-43b13a1e-2c64-4e61-a18c-a78a00595052 req-ff4b200d-2d72-40b7-a091-aac462bcd263 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] No waiting events found dispatching network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:46:24 user nova-compute[71557]: WARNING nova.compute.manager [req-43b13a1e-2c64-4e61-a18c-a78a00595052 req-ff4b200d-2d72-40b7-a091-aac462bcd263 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received unexpected event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance with vm_state resized and task_state resize_reverting.
Apr 12 10:46:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk --force-share --output=json" returned: 0 in 0.404s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:46:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:24 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 12 10:46:24 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296384.0113008, bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:46:24 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] VM Started (Lifecycle Event)
Apr 12 10:46:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:46:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:46:24 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 12 10:46:24 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Successfully created port: 363567f1-4d02-4e70-aba9-b7b5c7e2b7ab {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:46:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:24 user nova-compute[71557]: INFO nova.compute.manager [None req-bc5bf4be-1074-48ab-b3ad-88671ad7e634 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Updating instance to original state: 'active'
Apr 12 10:46:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/979fbc15-1dd0-46b8-a9c4-54be9d93da44/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/979fbc15-1dd0-46b8-a9c4-54be9d93da44/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/979fbc15-1dd0-46b8-a9c4-54be9d93da44/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/979fbc15-1dd0-46b8-a9c4-54be9d93da44/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:25 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Successfully updated port: 363567f1-4d02-4e70-aba9-b7b5c7e2b7ab {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:46:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "refresh_cache-aa5a8d3c-a65a-4a05-9874-ad22b597ddec" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:46:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquired lock "refresh_cache-aa5a8d3c-a65a-4a05-9874-ad22b597ddec" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:46:25 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:46:25 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:46:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:26 user nova-compute[71557]: DEBUG nova.compute.manager [req-3f074330-c822-47c5-93d5-8cf3bbbae0fc req-e6d3039a-77ba-4203-9199-c0de170e4a5c service nova] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Received event network-changed-363567f1-4d02-4e70-aba9-b7b5c7e2b7ab {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:46:26 user nova-compute[71557]: DEBUG nova.compute.manager [req-3f074330-c822-47c5-93d5-8cf3bbbae0fc req-e6d3039a-77ba-4203-9199-c0de170e4a5c service nova] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Refreshing instance network info cache due to event network-changed-363567f1-4d02-4e70-aba9-b7b5c7e2b7ab. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:46:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3f074330-c822-47c5-93d5-8cf3bbbae0fc req-e6d3039a-77ba-4203-9199-c0de170e4a5c service nova] Acquiring lock "refresh_cache-aa5a8d3c-a65a-4a05-9874-ad22b597ddec" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:46:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:26 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Updating instance_info_cache with network_info: [{"id": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab", "address": "fa:16:3e:9f:71:e1", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363567f1-4d", "ovs_interfaceid": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:46:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Releasing lock "refresh_cache-aa5a8d3c-a65a-4a05-9874-ad22b597ddec" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:46:26 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Instance network_info: |[{"id": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab", "address": "fa:16:3e:9f:71:e1", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363567f1-4d", "ovs_interfaceid": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:46:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3f074330-c822-47c5-93d5-8cf3bbbae0fc req-e6d3039a-77ba-4203-9199-c0de170e4a5c service nova] Acquired lock "refresh_cache-aa5a8d3c-a65a-4a05-9874-ad22b597ddec" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:46:26 user nova-compute[71557]: DEBUG nova.network.neutron [req-3f074330-c822-47c5-93d5-8cf3bbbae0fc req-e6d3039a-77ba-4203-9199-c0de170e4a5c service nova] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Refreshing network info cache for port 363567f1-4d02-4e70-aba9-b7b5c7e2b7ab {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:46:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:27 user nova-compute[71557]: DEBUG nova.network.neutron [req-3f074330-c822-47c5-93d5-8cf3bbbae0fc req-e6d3039a-77ba-4203-9199-c0de170e4a5c service nova] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Updated VIF entry in instance network info cache for port 363567f1-4d02-4e70-aba9-b7b5c7e2b7ab. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:46:27 user nova-compute[71557]: DEBUG nova.network.neutron [req-3f074330-c822-47c5-93d5-8cf3bbbae0fc req-e6d3039a-77ba-4203-9199-c0de170e4a5c service nova] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Updating instance_info_cache with network_info: [{"id": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab", "address": "fa:16:3e:9f:71:e1", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363567f1-4d", "ovs_interfaceid": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:46:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:46:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3f074330-c822-47c5-93d5-8cf3bbbae0fc req-e6d3039a-77ba-4203-9199-c0de170e4a5c service nova] Releasing lock "refresh_cache-aa5a8d3c-a65a-4a05-9874-ad22b597ddec" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:46:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:46:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:46:28 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:46:28 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:46:28 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=7658MB free_disk=26.142894744873047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:46:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:28 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:46:28 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:46:28 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:46:28 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:46:28 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 97bafe22-36bf-4939-baf8-9602551bad52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:46:28 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:46:28 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:46:28 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:46:28 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance d687131b-6853-4d65-b8f7-ecef019ae9f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:46:28 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 68b29390-867e-4bf3-bc93-b401f32b130e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:46:28 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:46:28 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:46:28 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:46:28 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:46:28 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:46:28 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:46:28 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:46:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.507s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG os_brick.utils [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6002fc4f-07dc-4dc2-a5bc-6b4bdee73b18]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6c42c8-d926-404f-a09b-223c538c553c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[473b138e-0931-42d8-bedd-71bc65d71e1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc3bf64-134f-4edf-b3b4-2c26509630a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:46:29 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:46:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6602431d-6e1b-412d-bbb8-18b1b99ed2df]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG os_brick.utils [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:46:29 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Updating existing volume attachment record: 4877dd66-6fcb-479a-abad-fd4857bacb2d {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:46:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:30 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Updating instance_info_cache with network_info: [{"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:46:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:46:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:46:30 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:46:30 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:46:30 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:46:30 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:46:30 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:46:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Cleaning up deleted instances {{(pid=71557) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 10:46:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] There are 0 instances to clean {{(pid=71557) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 10:46:31 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:46:32 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:46:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:46:34 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Creating image(s)
Apr 12 10:46:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Did not create local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Ensure instance console log exists: /opt/stack/data/nova/instances/aa5a8d3c-a65a-4a05-9874-ad22b597ddec/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Start _get_guest_xml network_info=[{"id": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab", "address": "fa:16:3e:9f:71:e1", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363567f1-4d", "ovs_interfaceid": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': '4877dd66-6fcb-479a-abad-fd4857bacb2d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqZrEkch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa5a8d3c-a65a-4a05-9874-ad22b597ddec', 'attached_at': '', 'detached_at': '', 'volume_id': 'e487b918-a464-4f8b-95a7-797c580b92cf', 'serial': 'e487b918-a464-4f8b-95a7-797c580b92cf'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:46:34 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:46:34 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:46:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqZrEkch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:46:34 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:46:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:46:34 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:46:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:46:34 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:46:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c269dd-c559-4d68-8f0b-5522fc47b52d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:46:34 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3520eb68-2554-4b2d-bf16-b2d94f5439c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf] added
Apr 12 10:46:34 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6841789-6f83-4935-822d-c2e509dcba38]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2db58d5-d02a-44cf-944a-5e5edad910b1]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DqZrEkch {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DqZrEkch" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbdadf3-be88-4dc1-80df-43a169f595b5]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DqZrEkch'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:46:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5178d38d-ed89-426b-ab57-9b50f1feab94]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d904add-8ab7-4aa5-80e4-19ff874523e3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:46:35 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:46:35 user nova-compute[71557]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:46:35 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:46:35 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:46:35 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:46:35 user nova-compute[71557]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:46:35 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:46:35 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2490ca47-47d6-4748-a1e9-b0e5c16e085a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf, portal: 172.16.0.220,3260]
Apr 12 10:46:35 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf, portal: 172.16.0.220,3260] successful.
Apr 12 10:46:35 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba219b26-3904-4707-8fe2-7f537f257a1f]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dc816c-8944-4814-b3a0-ad7d982d5cc5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:46:35 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:46:35 user nova-compute[71557]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:46:35 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:46:35 user nova-compute[71557]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)
Apr 12 10:46:35 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:46:35 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:46:35 user nova-compute[71557]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:46:35 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:46:35 user nova-compute[71557]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)
Apr 12 10:46:35 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f200f5a-dc3d-43e1-a878-19bd6c7bbb1b]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqZrEkch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:46:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:46:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26666613265343131', 'path': '/dev/sdf'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:46:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666613265343131', 'path': '/dev/sdf'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:46:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:46:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-803081492',display_name='tempest-TestVolumeBootPattern-server-803081492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-803081492',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a67f3d23b8f74a9496d445c7fc75717e',ramdisk_id='',reservation_id='r-yihb7xeq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-638607559',owner_user_name='tempest-TestVolumeBootPattern-638607559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:46:24Z,user_data=None,user_id='b914d7ca786f455baf120f98816abffd',uuid=aa5a8d3c-a65a-4a05-9874-ad22b597ddec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab", "address": "fa:16:3e:9f:71:e1", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363567f1-4d", "ovs_interfaceid": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:46:36 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converting VIF {"id": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab", "address": "fa:16:3e:9f:71:e1", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363567f1-4d", "ovs_interfaceid": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:46:36 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:71:e1,bridge_name='br-int',has_traffic_filtering=True,id=363567f1-4d02-4e70-aba9-b7b5c7e2b7ab,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363567f1-4d') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:46:36 user nova-compute[71557]: DEBUG nova.objects.instance [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lazy-loading 'pci_devices' on Instance uuid aa5a8d3c-a65a-4a05-9874-ad22b597ddec {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:46:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:46:36 user nova-compute[71557]:   <uuid>aa5a8d3c-a65a-4a05-9874-ad22b597ddec</uuid>
Apr 12 10:46:36 user nova-compute[71557]:   <name>instance-0000001d</name>
Apr 12 10:46:36 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:46:36 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:46:36 user nova-compute[71557]:   <metadata>
Apr 12 10:46:36 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:46:36 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:46:36 user nova-compute[71557]:       <nova:name>tempest-TestVolumeBootPattern-server-803081492</nova:name>
Apr 12 10:46:36 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:46:34</nova:creationTime>
Apr 12 10:46:36 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:46:36 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:46:36 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:46:36 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:46:36 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:46:36 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:46:36 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:46:36 user nova-compute[71557]:       <nova:owner>
Apr 12 10:46:36 user nova-compute[71557]:         <nova:user uuid="b914d7ca786f455baf120f98816abffd">tempest-TestVolumeBootPattern-638607559-project-member</nova:user>
Apr 12 10:46:36 user nova-compute[71557]:         <nova:project uuid="a67f3d23b8f74a9496d445c7fc75717e">tempest-TestVolumeBootPattern-638607559</nova:project>
Apr 12 10:46:36 user nova-compute[71557]:       </nova:owner>
Apr 12 10:46:36 user nova-compute[71557]:       <nova:ports>
Apr 12 10:46:36 user nova-compute[71557]:         <nova:port uuid="363567f1-4d02-4e70-aba9-b7b5c7e2b7ab">
Apr 12 10:46:36 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 10:46:36 user nova-compute[71557]:         </nova:port>
Apr 12 10:46:36 user nova-compute[71557]:       </nova:ports>
Apr 12 10:46:36 user nova-compute[71557]:     </nova:instance>
Apr 12 10:46:36 user nova-compute[71557]:   </metadata>
Apr 12 10:46:36 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:46:36 user nova-compute[71557]:     <system>
Apr 12 10:46:36 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:46:36 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:46:36 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:46:36 user nova-compute[71557]:       <entry name="serial">aa5a8d3c-a65a-4a05-9874-ad22b597ddec</entry>
Apr 12 10:46:36 user nova-compute[71557]:       <entry name="uuid">aa5a8d3c-a65a-4a05-9874-ad22b597ddec</entry>
Apr 12 10:46:36 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:46:36 user nova-compute[71557]:     </system>
Apr 12 10:46:36 user nova-compute[71557]:   </sysinfo>
Apr 12 10:46:36 user nova-compute[71557]:   <os>
Apr 12 10:46:36 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:46:36 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:46:36 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:46:36 user nova-compute[71557]:   </os>
Apr 12 10:46:36 user nova-compute[71557]:   <features>
Apr 12 10:46:36 user nova-compute[71557]:     <acpi/>
Apr 12 10:46:36 user nova-compute[71557]:     <apic/>
Apr 12 10:46:36 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:46:36 user nova-compute[71557]:   </features>
Apr 12 10:46:36 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:46:36 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:46:36 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:46:36 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:46:36 user nova-compute[71557]:   </clock>
Apr 12 10:46:36 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:46:36 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:46:36 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:46:36 user nova-compute[71557]:   </cpu>
Apr 12 10:46:36 user nova-compute[71557]:   <devices>
Apr 12 10:46:36 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:46:36 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:46:36 user nova-compute[71557]:       <source dev="/dev/sdf"/>
Apr 12 10:46:36 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:46:36 user nova-compute[71557]:       <serial>e487b918-a464-4f8b-95a7-797c580b92cf</serial>
Apr 12 10:46:36 user nova-compute[71557]:     </disk>
Apr 12 10:46:36 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:46:36 user nova-compute[71557]:       <mac address="fa:16:3e:9f:71:e1"/>
Apr 12 10:46:36 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:46:36 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:46:36 user nova-compute[71557]:       <target dev="tap363567f1-4d"/>
Apr 12 10:46:36 user nova-compute[71557]:     </interface>
Apr 12 10:46:36 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:46:36 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/aa5a8d3c-a65a-4a05-9874-ad22b597ddec/console.log" append="off"/>
Apr 12 10:46:36 user nova-compute[71557]:     </serial>
Apr 12 10:46:36 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:46:36 user nova-compute[71557]:     <video>
Apr 12 10:46:36 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:46:36 user nova-compute[71557]:     </video>
Apr 12 10:46:36 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:46:36 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:46:36 user nova-compute[71557]:     </rng>
Apr 12 10:46:36 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:46:36 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:46:36 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:46:36 user nova-compute[71557]:     </memballoon>
Apr 12 10:46:36 user nova-compute[71557]:   </devices>
Apr 12 10:46:36 user nova-compute[71557]: </domain>
Apr 12 10:46:36 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:46:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:46:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-803081492',display_name='tempest-TestVolumeBootPattern-server-803081492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-803081492',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a67f3d23b8f74a9496d445c7fc75717e',ramdisk_id='',reservation_id='r-yihb7xeq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-638607559',owner_user_name='tempest-TestVolumeBootPattern-638607559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:46:24Z,user_data=None,user_id='b914d7ca786f455baf120f98816abffd',uuid=aa5a8d3c-a65a-4a05-9874-ad22b597ddec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab", "address": "fa:16:3e:9f:71:e1", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363567f1-4d", "ovs_interfaceid": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:46:36 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converting VIF {"id": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab", "address": "fa:16:3e:9f:71:e1", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363567f1-4d", "ovs_interfaceid": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:46:36 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:71:e1,bridge_name='br-int',has_traffic_filtering=True,id=363567f1-4d02-4e70-aba9-b7b5c7e2b7ab,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363567f1-4d') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:46:36 user nova-compute[71557]: DEBUG os_vif [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:71:e1,bridge_name='br-int',has_traffic_filtering=True,id=363567f1-4d02-4e70-aba9-b7b5c7e2b7ab,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363567f1-4d') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:46:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:46:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:46:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap363567f1-4d, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:46:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap363567f1-4d, col_values=(('external_ids', {'iface-id': '363567f1-4d02-4e70-aba9-b7b5c7e2b7ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:71:e1', 'vm-uuid': 'aa5a8d3c-a65a-4a05-9874-ad22b597ddec'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:46:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:46:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:36 user nova-compute[71557]: INFO os_vif [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:71:e1,bridge_name='br-int',has_traffic_filtering=True,id=363567f1-4d02-4e70-aba9-b7b5c7e2b7ab,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363567f1-4d')
Apr 12 10:46:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:46:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] No VIF found with MAC fa:16:3e:9f:71:e1, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:46:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:37 user nova-compute[71557]: DEBUG nova.compute.manager [req-9fd80e78-2342-4545-a588-f86296e3f8d5 req-0ddd8f9b-6309-4b79-8506-03a634348aed service nova] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Received event network-vif-plugged-363567f1-4d02-4e70-aba9-b7b5c7e2b7ab {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:46:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9fd80e78-2342-4545-a588-f86296e3f8d5 req-0ddd8f9b-6309-4b79-8506-03a634348aed service nova] Acquiring lock "aa5a8d3c-a65a-4a05-9874-ad22b597ddec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9fd80e78-2342-4545-a588-f86296e3f8d5 req-0ddd8f9b-6309-4b79-8506-03a634348aed service nova] Lock "aa5a8d3c-a65a-4a05-9874-ad22b597ddec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9fd80e78-2342-4545-a588-f86296e3f8d5 req-0ddd8f9b-6309-4b79-8506-03a634348aed service nova] Lock "aa5a8d3c-a65a-4a05-9874-ad22b597ddec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:37 user nova-compute[71557]: DEBUG nova.compute.manager [req-9fd80e78-2342-4545-a588-f86296e3f8d5 req-0ddd8f9b-6309-4b79-8506-03a634348aed service nova] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] No waiting events found dispatching network-vif-plugged-363567f1-4d02-4e70-aba9-b7b5c7e2b7ab {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:46:37 user nova-compute[71557]: WARNING nova.compute.manager [req-9fd80e78-2342-4545-a588-f86296e3f8d5 req-0ddd8f9b-6309-4b79-8506-03a634348aed service nova] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Received unexpected event network-vif-plugged-363567f1-4d02-4e70-aba9-b7b5c7e2b7ab for instance with vm_state building and task_state spawning.
Apr 12 10:46:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:39 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296399.700813, aa5a8d3c-a65a-4a05-9874-ad22b597ddec => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:46:39 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] VM Resumed (Lifecycle Event)
Apr 12 10:46:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:46:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:46:39 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Instance spawned successfully.
Apr 12 10:46:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:46:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:46:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:46:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:46:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:46:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:46:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:46:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:46:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:46:39 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:46:39 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296399.7064586, aa5a8d3c-a65a-4a05-9874-ad22b597ddec => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:46:39 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] VM Started (Lifecycle Event)
Apr 12 10:46:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:46:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:46:39 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:46:39 user nova-compute[71557]: INFO nova.compute.manager [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Took 4.97 seconds to spawn the instance on the hypervisor.
Apr 12 10:46:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:46:39 user nova-compute[71557]: INFO nova.compute.manager [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Took 16.85 seconds to build instance.
Apr 12 10:46:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5b08278e-81d8-4eec-8fa4-34c4138fdc90 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "aa5a8d3c-a65a-4a05-9874-ad22b597ddec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.945s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-4c1e66eb-1d38-4303-bbf7-2986e60b02b5 req-453849de-d50f-42f3-9aef-514ef1896646 service nova] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Received event network-vif-plugged-363567f1-4d02-4e70-aba9-b7b5c7e2b7ab {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:46:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4c1e66eb-1d38-4303-bbf7-2986e60b02b5 req-453849de-d50f-42f3-9aef-514ef1896646 service nova] Acquiring lock "aa5a8d3c-a65a-4a05-9874-ad22b597ddec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4c1e66eb-1d38-4303-bbf7-2986e60b02b5 req-453849de-d50f-42f3-9aef-514ef1896646 service nova] Lock "aa5a8d3c-a65a-4a05-9874-ad22b597ddec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4c1e66eb-1d38-4303-bbf7-2986e60b02b5 req-453849de-d50f-42f3-9aef-514ef1896646 service nova] Lock "aa5a8d3c-a65a-4a05-9874-ad22b597ddec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-4c1e66eb-1d38-4303-bbf7-2986e60b02b5 req-453849de-d50f-42f3-9aef-514ef1896646 service nova] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] No waiting events found dispatching network-vif-plugged-363567f1-4d02-4e70-aba9-b7b5c7e2b7ab {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:46:39 user nova-compute[71557]: WARNING nova.compute.manager [req-4c1e66eb-1d38-4303-bbf7-2986e60b02b5 req-453849de-d50f-42f3-9aef-514ef1896646 service nova] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Received unexpected event network-vif-plugged-363567f1-4d02-4e70-aba9-b7b5c7e2b7ab for instance with vm_state active and task_state None.
Apr 12 10:46:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-cbd7a418-85fe-451b-a3b6-156868b02b78 req-068adbe3-c4fd-404a-b65b-3965ba00183a service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Received event network-changed-84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:46:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-cbd7a418-85fe-451b-a3b6-156868b02b78 req-068adbe3-c4fd-404a-b65b-3965ba00183a service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Refreshing instance network info cache due to event network-changed-84c5d9c8-683a-4733-86ba-4f9f2e89e5f0. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:46:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cbd7a418-85fe-451b-a3b6-156868b02b78 req-068adbe3-c4fd-404a-b65b-3965ba00183a service nova] Acquiring lock "refresh_cache-979fbc15-1dd0-46b8-a9c4-54be9d93da44" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:46:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cbd7a418-85fe-451b-a3b6-156868b02b78 req-068adbe3-c4fd-404a-b65b-3965ba00183a service nova] Acquired lock "refresh_cache-979fbc15-1dd0-46b8-a9c4-54be9d93da44" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:46:41 user nova-compute[71557]: DEBUG nova.network.neutron [req-cbd7a418-85fe-451b-a3b6-156868b02b78 req-068adbe3-c4fd-404a-b65b-3965ba00183a service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Refreshing network info cache for port 84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:46:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "979fbc15-1dd0-46b8-a9c4-54be9d93da44" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "979fbc15-1dd0-46b8-a9c4-54be9d93da44" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "979fbc15-1dd0-46b8-a9c4-54be9d93da44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "979fbc15-1dd0-46b8-a9c4-54be9d93da44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "979fbc15-1dd0-46b8-a9c4-54be9d93da44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:41 user nova-compute[71557]: INFO nova.compute.manager [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Terminating instance
Apr 12 10:46:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:46:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:42 user nova-compute[71557]: DEBUG nova.network.neutron [req-cbd7a418-85fe-451b-a3b6-156868b02b78 req-068adbe3-c4fd-404a-b65b-3965ba00183a service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Updated VIF entry in instance network info cache for port 84c5d9c8-683a-4733-86ba-4f9f2e89e5f0. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:46:42 user nova-compute[71557]: DEBUG nova.network.neutron [req-cbd7a418-85fe-451b-a3b6-156868b02b78 req-068adbe3-c4fd-404a-b65b-3965ba00183a service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Updating instance_info_cache with network_info: [{"id": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0", "address": "fa:16:3e:a4:e0:cf", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c5d9c8-68", "ovs_interfaceid": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:46:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cbd7a418-85fe-451b-a3b6-156868b02b78 req-068adbe3-c4fd-404a-b65b-3965ba00183a service nova] Releasing lock "refresh_cache-979fbc15-1dd0-46b8-a9c4-54be9d93da44" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:46:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:42 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Instance destroyed successfully.
Apr 12 10:46:42 user nova-compute[71557]: DEBUG nova.objects.instance [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'resources' on Instance uuid 979fbc15-1dd0-46b8-a9c4-54be9d93da44 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:46:42 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1530539013',display_name='tempest-AttachVolumeNegativeTest-server-1530539013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1530539013',id=26,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVmlusjBbAhyfKjhgK8Wa0Pp75RNtE1Qsp17vW0I9s4GPmFdzLWN9G7QfMJm6jzPTGesB4vogBF69JOIb6I1a2Sp2CezrTO671jnBpw/4t36Yvu2usg+rqCY+LYMh5Aig==',key_name='tempest-keypair-615324409',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:44:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3cecbfbfd5f42dbb663367f6fbdf3b0',ramdisk_id='',reservation_id='r-zb10ciff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-249658876',owner_user_name='tempest-AttachVolumeNegativeTest-249658876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ec47d3cdacb45e5a39509e76b546e34',uuid=979fbc15-1dd0-46b8-a9c4-54be9d93da44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0", "address": "fa:16:3e:a4:e0:cf", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c5d9c8-68", "ovs_interfaceid": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:46:42 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converting VIF {"id": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0", "address": "fa:16:3e:a4:e0:cf", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c5d9c8-68", "ovs_interfaceid": "84c5d9c8-683a-4733-86ba-4f9f2e89e5f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:46:42 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e0:cf,bridge_name='br-int',has_traffic_filtering=True,id=84c5d9c8-683a-4733-86ba-4f9f2e89e5f0,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c5d9c8-68') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:46:42 user nova-compute[71557]: DEBUG os_vif [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e0:cf,bridge_name='br-int',has_traffic_filtering=True,id=84c5d9c8-683a-4733-86ba-4f9f2e89e5f0,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c5d9c8-68') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:46:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84c5d9c8-68, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:46:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:46:42 user nova-compute[71557]: INFO os_vif [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e0:cf,bridge_name='br-int',has_traffic_filtering=True,id=84c5d9c8-683a-4733-86ba-4f9f2e89e5f0,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c5d9c8-68')
Apr 12 10:46:42 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Deleting instance files /opt/stack/data/nova/instances/979fbc15-1dd0-46b8-a9c4-54be9d93da44_del
Apr 12 10:46:42 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Deletion of /opt/stack/data/nova/instances/979fbc15-1dd0-46b8-a9c4-54be9d93da44_del complete
Apr 12 10:46:42 user nova-compute[71557]: INFO nova.compute.manager [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 12 10:46:42 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:46:42 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:46:42 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:46:43 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:46:43 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Took 0.76 seconds to deallocate network for instance.
Apr 12 10:46:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-16473cfc-7447-4d96-a938-1f5db946f531 req-c73aef09-11c1-47e9-a646-2eb360cee06f service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Received event network-vif-deleted-84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:46:43 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:46:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-18045390-ea59-4efe-a7e9-22e33ae7a6fa req-0172609b-8208-412b-a832-72725a78d1e2 service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Received event network-vif-unplugged-84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:46:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-18045390-ea59-4efe-a7e9-22e33ae7a6fa req-0172609b-8208-412b-a832-72725a78d1e2 service nova] Acquiring lock "979fbc15-1dd0-46b8-a9c4-54be9d93da44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-18045390-ea59-4efe-a7e9-22e33ae7a6fa req-0172609b-8208-412b-a832-72725a78d1e2 service nova] Lock "979fbc15-1dd0-46b8-a9c4-54be9d93da44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-18045390-ea59-4efe-a7e9-22e33ae7a6fa req-0172609b-8208-412b-a832-72725a78d1e2 service nova] Lock "979fbc15-1dd0-46b8-a9c4-54be9d93da44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-18045390-ea59-4efe-a7e9-22e33ae7a6fa req-0172609b-8208-412b-a832-72725a78d1e2 service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] No waiting events found dispatching network-vif-unplugged-84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:46:43 user nova-compute[71557]: WARNING nova.compute.manager [req-18045390-ea59-4efe-a7e9-22e33ae7a6fa req-0172609b-8208-412b-a832-72725a78d1e2 service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Received unexpected event network-vif-unplugged-84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 for instance with vm_state deleted and task_state None.
Apr 12 10:46:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-18045390-ea59-4efe-a7e9-22e33ae7a6fa req-0172609b-8208-412b-a832-72725a78d1e2 service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Received event network-vif-plugged-84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:46:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-18045390-ea59-4efe-a7e9-22e33ae7a6fa req-0172609b-8208-412b-a832-72725a78d1e2 service nova] Acquiring lock "979fbc15-1dd0-46b8-a9c4-54be9d93da44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-18045390-ea59-4efe-a7e9-22e33ae7a6fa req-0172609b-8208-412b-a832-72725a78d1e2 service nova] Lock "979fbc15-1dd0-46b8-a9c4-54be9d93da44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-18045390-ea59-4efe-a7e9-22e33ae7a6fa req-0172609b-8208-412b-a832-72725a78d1e2 service nova] Lock "979fbc15-1dd0-46b8-a9c4-54be9d93da44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:43 user nova-compute[71557]: DEBUG nova.compute.manager [req-18045390-ea59-4efe-a7e9-22e33ae7a6fa req-0172609b-8208-412b-a832-72725a78d1e2 service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] No waiting events found dispatching network-vif-plugged-84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:46:43 user nova-compute[71557]: WARNING nova.compute.manager [req-18045390-ea59-4efe-a7e9-22e33ae7a6fa req-0172609b-8208-412b-a832-72725a78d1e2 service nova] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Received unexpected event network-vif-plugged-84c5d9c8-683a-4733-86ba-4f9f2e89e5f0 for instance with vm_state deleted and task_state None.
Apr 12 10:46:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:43 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:46:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:43 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Deleted allocations for instance 979fbc15-1dd0-46b8-a9c4-54be9d93da44
Apr 12 10:46:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d0912dc9-033b-4e9a-af6a-e1eef2fd7b77 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "979fbc15-1dd0-46b8-a9c4-54be9d93da44" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.044s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:54 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:46:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:46:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:46:54 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:46:54 user nova-compute[71557]: INFO nova.compute.claims [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Claim successful on node user
Apr 12 10:46:55 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:46:55 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:46:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:46:55 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:46:55 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:46:55 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:46:55 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:46:55 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:46:55 user nova-compute[71557]: INFO nova.virt.block_device [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Booting with volume-backed-image 3dd4c04b-7ffb-4200-9900-d3e99c6da7a0 at /dev/vda
Apr 12 10:46:55 user nova-compute[71557]: DEBUG nova.policy [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba49b947c74e48f3b161b6f9fce8b1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3789b59ccc704f86afac83af21fd84f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:46:56 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Successfully created port: 48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:46:56 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Successfully updated port: 48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:46:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "refresh_cache-7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:46:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquired lock "refresh_cache-7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:46:56 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:46:56 user nova-compute[71557]: DEBUG nova.compute.manager [req-8c7d4b33-f650-4b30-aec9-50904c3dabb0 req-1292ccc4-26db-4a75-bd4d-238224f62832 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received event network-changed-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:46:56 user nova-compute[71557]: DEBUG nova.compute.manager [req-8c7d4b33-f650-4b30-aec9-50904c3dabb0 req-1292ccc4-26db-4a75-bd4d-238224f62832 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Refreshing instance network info cache due to event network-changed-48ecbe51-c168-45fd-9029-d5cfa270e5c5. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:46:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8c7d4b33-f650-4b30-aec9-50904c3dabb0 req-1292ccc4-26db-4a75-bd4d-238224f62832 service nova] Acquiring lock "refresh_cache-7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:46:56 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:46:57 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Updating instance_info_cache with network_info: [{"id": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "address": "fa:16:3e:74:b6:77", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ecbe51-c1", "ovs_interfaceid": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:46:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Releasing lock "refresh_cache-7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:46:57 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Instance network_info: |[{"id": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "address": "fa:16:3e:74:b6:77", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ecbe51-c1", "ovs_interfaceid": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:46:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8c7d4b33-f650-4b30-aec9-50904c3dabb0 req-1292ccc4-26db-4a75-bd4d-238224f62832 service nova] Acquired lock "refresh_cache-7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:46:57 user nova-compute[71557]: DEBUG nova.network.neutron [req-8c7d4b33-f650-4b30-aec9-50904c3dabb0 req-1292ccc4-26db-4a75-bd4d-238224f62832 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Refreshing network info cache for port 48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:46:57 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296402.5153823, 979fbc15-1dd0-46b8-a9c4-54be9d93da44 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:46:57 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] VM Stopped (Lifecycle Event)
Apr 12 10:46:57 user nova-compute[71557]: DEBUG nova.compute.manager [None req-1a7d6a14-8638-4275-8c1d-912d1f1d6506 None None] [instance: 979fbc15-1dd0-46b8-a9c4-54be9d93da44] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:46:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:46:57 user nova-compute[71557]: DEBUG nova.network.neutron [req-8c7d4b33-f650-4b30-aec9-50904c3dabb0 req-1292ccc4-26db-4a75-bd4d-238224f62832 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Updated VIF entry in instance network info cache for port 48ecbe51-c168-45fd-9029-d5cfa270e5c5. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:46:57 user nova-compute[71557]: DEBUG nova.network.neutron [req-8c7d4b33-f650-4b30-aec9-50904c3dabb0 req-1292ccc4-26db-4a75-bd4d-238224f62832 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Updating instance_info_cache with network_info: [{"id": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "address": "fa:16:3e:74:b6:77", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ecbe51-c1", "ovs_interfaceid": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:46:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8c7d4b33-f650-4b30-aec9-50904c3dabb0 req-1292ccc4-26db-4a75-bd4d-238224f62832 service nova] Releasing lock "refresh_cache-7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:46:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:01 user nova-compute[71557]: DEBUG os_brick.utils [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:47:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:01 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4bbdc7-756a-49a9-9f61-450dc4dc3390]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.030s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:01 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[433f5ed1-cfe9-40bd-b296-e7f94530120f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:01 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1bc766-b1b5-46c7-93e2-c498c4af77b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:01 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8a870e-a86f-47b3-8b3d-fe09003e29f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:47:01 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:47:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:47:01 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:47:01 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00b603d-2efd-4f8d-9b7b-b6cfae2f41ec]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:01 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:47:01 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:47:01 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:47:01 user nova-compute[71557]: DEBUG os_brick.utils [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:47:01 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Updating existing volume attachment record: 97e4f1d1-d798-42bd-b53e-66a3c837c391 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:47:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:47:06 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Creating image(s)
Apr 12 10:47:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Did not create local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Ensure instance console log exists: /opt/stack/data/nova/instances/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Start _get_guest_xml network_info=[{"id": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "address": "fa:16:3e:74:b6:77", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ecbe51-c1", "ovs_interfaceid": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': '97e4f1d1-d798-42bd-b53e-66a3c837c391', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WsBbchPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7ba7c401-554c-4610-b8a3-8cf7e62f8cfa', 'attached_at': '', 'detached_at': '', 'volume_id': '54a3fe1e-1437-4c58-8c76-d506fbf77a36', 'serial': '54a3fe1e-1437-4c58-8c76-d506fbf77a36'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:47:06 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:47:06 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:47:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WsBbchPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:47:06 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:47:06 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:47:06 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260" returned: 21 in 0.050s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[46faaeb9-c38d-4c76-9723-dfa8cc6843d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:47:06 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca2fb83-a481-490b-87c6-c59f794112b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36] added
Apr 12 10:47:06 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8d3ed2-7c7d-4f87-bff5-260a4652e4c2]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2deba25-c282-4b81-9246-1b012555bd80]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WsBbchPQ {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WsBbchPQ" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b29ea62-0a3b-4659-bb25-b435dcb0395b]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WsBbchPQ'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0d2011-2e97-49b3-ad1b-d8c0b42ecb03]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a7c813-2c24-4235-9b14-7c32667b5f1d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bb30b45-54da-4866-a8c0-9b24b223d646 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:47:06 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:47:06 user nova-compute[71557]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:47:06 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:47:06 user nova-compute[71557]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)
Apr 12 10:47:06 user nova-compute[71557]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bb30b45-54da-4866-a8c0-9b24b223d646 (non-flash)
Apr 12 10:47:06 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:47:06 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:47:06 user nova-compute[71557]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:47:06 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:47:06 user nova-compute[71557]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)
Apr 12 10:47:06 user nova-compute[71557]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bb30b45-54da-4866-a8c0-9b24b223d646 (non-flash)
Apr 12 10:47:06 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fc6fbe-3738-411d-9aaf-dc00fd2831f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36, portal: 172.16.0.220,3260]
Apr 12 10:47:06 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36, portal: 172.16.0.220,3260] successful.
Apr 12 10:47:06 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b31ad4-eaaa-45fb-ba3c-3276d43a43a9]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e05e96-d5d8-45f9-a725-d85be7bac60e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bb30b45-54da-4866-a8c0-9b24b223d646 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:47:06 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:47:06 user nova-compute[71557]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:47:06 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:47:06 user nova-compute[71557]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)
Apr 12 10:47:06 user nova-compute[71557]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bb30b45-54da-4866-a8c0-9b24b223d646 (non-flash)
Apr 12 10:47:06 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:47:06 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:47:06 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:47:06 user nova-compute[71557]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:47:06 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:47:06 user nova-compute[71557]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)
Apr 12 10:47:06 user nova-compute[71557]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bb30b45-54da-4866-a8c0-9b24b223d646 (non-flash)
Apr 12 10:47:06 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:47:06 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] HCTL ('39', '-', '-', 0) found on session 30 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.028s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b502287-2165-495e-adda-208382373b6f]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Searching for a device in session 30 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:47:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WsBbchPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:47:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.455s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:47:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] <== connect_volume: return (1456ms) {'type': 'block', 'scsi_wwn': '23439383130613864', 'path': '/dev/sdh'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:47:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439383130613864', 'path': '/dev/sdh'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:47:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-432183052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-432183052',id=30,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3789b59ccc704f86afac83af21fd84f9',ramdisk_id='',reservation_id='r-rqnoyn8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:46:55Z,user_data=None,user_id='ba49b947c74e48f3b161b6f9fce8b1c5',uuid=7ba7c401-554c-4610-b8a3-8cf7e62f8cfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "address": "fa:16:3e:74:b6:77", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ecbe51-c1", "ovs_interfaceid": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:47:07 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converting VIF {"id": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "address": "fa:16:3e:74:b6:77", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ecbe51-c1", "ovs_interfaceid": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:47:07 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:b6:77,bridge_name='br-int',has_traffic_filtering=True,id=48ecbe51-c168-45fd-9029-d5cfa270e5c5,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ecbe51-c1') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:47:07 user nova-compute[71557]: DEBUG nova.objects.instance [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:47:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:47:07 user nova-compute[71557]:   <uuid>7ba7c401-554c-4610-b8a3-8cf7e62f8cfa</uuid>
Apr 12 10:47:07 user nova-compute[71557]:   <name>instance-0000001e</name>
Apr 12 10:47:07 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:47:07 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:47:07 user nova-compute[71557]:   <metadata>
Apr 12 10:47:07 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:47:07 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:47:07 user nova-compute[71557]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-432183052</nova:name>
Apr 12 10:47:07 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:47:06</nova:creationTime>
Apr 12 10:47:07 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:47:07 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:47:07 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:47:07 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:47:07 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:47:07 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:47:07 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:47:07 user nova-compute[71557]:       <nova:owner>
Apr 12 10:47:07 user nova-compute[71557]:         <nova:user uuid="ba49b947c74e48f3b161b6f9fce8b1c5">tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member</nova:user>
Apr 12 10:47:07 user nova-compute[71557]:         <nova:project uuid="3789b59ccc704f86afac83af21fd84f9">tempest-ServerBootFromVolumeStableRescueTest-1826285115</nova:project>
Apr 12 10:47:07 user nova-compute[71557]:       </nova:owner>
Apr 12 10:47:07 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:47:07 user nova-compute[71557]:       <nova:ports>
Apr 12 10:47:07 user nova-compute[71557]:         <nova:port uuid="48ecbe51-c168-45fd-9029-d5cfa270e5c5">
Apr 12 10:47:07 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 10:47:07 user nova-compute[71557]:         </nova:port>
Apr 12 10:47:07 user nova-compute[71557]:       </nova:ports>
Apr 12 10:47:07 user nova-compute[71557]:     </nova:instance>
Apr 12 10:47:07 user nova-compute[71557]:   </metadata>
Apr 12 10:47:07 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:47:07 user nova-compute[71557]:     <system>
Apr 12 10:47:07 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:47:07 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:47:07 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:47:07 user nova-compute[71557]:       <entry name="serial">7ba7c401-554c-4610-b8a3-8cf7e62f8cfa</entry>
Apr 12 10:47:07 user nova-compute[71557]:       <entry name="uuid">7ba7c401-554c-4610-b8a3-8cf7e62f8cfa</entry>
Apr 12 10:47:07 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:47:07 user nova-compute[71557]:     </system>
Apr 12 10:47:07 user nova-compute[71557]:   </sysinfo>
Apr 12 10:47:07 user nova-compute[71557]:   <os>
Apr 12 10:47:07 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:47:07 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:47:07 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:47:07 user nova-compute[71557]:   </os>
Apr 12 10:47:07 user nova-compute[71557]:   <features>
Apr 12 10:47:07 user nova-compute[71557]:     <acpi/>
Apr 12 10:47:07 user nova-compute[71557]:     <apic/>
Apr 12 10:47:07 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:47:07 user nova-compute[71557]:   </features>
Apr 12 10:47:07 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:47:07 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:47:07 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:47:07 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:47:07 user nova-compute[71557]:   </clock>
Apr 12 10:47:07 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:47:07 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:47:07 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:47:07 user nova-compute[71557]:   </cpu>
Apr 12 10:47:07 user nova-compute[71557]:   <devices>
Apr 12 10:47:07 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:47:07 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:47:07 user nova-compute[71557]:       <source dev="/dev/sdh"/>
Apr 12 10:47:07 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:47:07 user nova-compute[71557]:       <serial>54a3fe1e-1437-4c58-8c76-d506fbf77a36</serial>
Apr 12 10:47:07 user nova-compute[71557]:     </disk>
Apr 12 10:47:07 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:47:07 user nova-compute[71557]:       <mac address="fa:16:3e:74:b6:77"/>
Apr 12 10:47:07 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:47:07 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:47:07 user nova-compute[71557]:       <target dev="tap48ecbe51-c1"/>
Apr 12 10:47:07 user nova-compute[71557]:     </interface>
Apr 12 10:47:07 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:47:07 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa/console.log" append="off"/>
Apr 12 10:47:07 user nova-compute[71557]:     </serial>
Apr 12 10:47:07 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:47:07 user nova-compute[71557]:     <video>
Apr 12 10:47:07 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:47:07 user nova-compute[71557]:     </video>
Apr 12 10:47:07 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:47:07 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:47:07 user nova-compute[71557]:     </rng>
Apr 12 10:47:07 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:47:07 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:47:07 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:47:07 user nova-compute[71557]:     </memballoon>
Apr 12 10:47:07 user nova-compute[71557]:   </devices>
Apr 12 10:47:07 user nova-compute[71557]: </domain>
Apr 12 10:47:07 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:47:08 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-432183052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-432183052',id=30,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3789b59ccc704f86afac83af21fd84f9',ramdisk_id='',reservation_id='r-rqnoyn8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:46:55Z,user_data=None,user_id='ba49b947c74e48f3b161b6f9fce8b1c5',uuid=7ba7c401-554c-4610-b8a3-8cf7e62f8cfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "address": "fa:16:3e:74:b6:77", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ecbe51-c1", "ovs_interfaceid": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:47:08 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converting VIF {"id": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "address": "fa:16:3e:74:b6:77", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ecbe51-c1", "ovs_interfaceid": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:47:08 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:b6:77,bridge_name='br-int',has_traffic_filtering=True,id=48ecbe51-c168-45fd-9029-d5cfa270e5c5,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ecbe51-c1') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:47:08 user nova-compute[71557]: DEBUG os_vif [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:b6:77,bridge_name='br-int',has_traffic_filtering=True,id=48ecbe51-c168-45fd-9029-d5cfa270e5c5,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ecbe51-c1') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:47:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:47:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:47:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48ecbe51-c1, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:47:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap48ecbe51-c1, col_values=(('external_ids', {'iface-id': '48ecbe51-c168-45fd-9029-d5cfa270e5c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:b6:77', 'vm-uuid': '7ba7c401-554c-4610-b8a3-8cf7e62f8cfa'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:47:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:47:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:08 user nova-compute[71557]: INFO os_vif [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:b6:77,bridge_name='br-int',has_traffic_filtering=True,id=48ecbe51-c168-45fd-9029-d5cfa270e5c5,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ecbe51-c1')
Apr 12 10:47:08 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:47:08 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] No VIF found with MAC fa:16:3e:74:b6:77, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:47:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:10 user nova-compute[71557]: DEBUG nova.compute.manager [req-8cc5045e-aeab-4357-be56-62989a9f788a req-3c666239-13fd-42b3-9bc4-24d525660804 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received event network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:47:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8cc5045e-aeab-4357-be56-62989a9f788a req-3c666239-13fd-42b3-9bc4-24d525660804 service nova] Acquiring lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8cc5045e-aeab-4357-be56-62989a9f788a req-3c666239-13fd-42b3-9bc4-24d525660804 service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8cc5045e-aeab-4357-be56-62989a9f788a req-3c666239-13fd-42b3-9bc4-24d525660804 service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:10 user nova-compute[71557]: DEBUG nova.compute.manager [req-8cc5045e-aeab-4357-be56-62989a9f788a req-3c666239-13fd-42b3-9bc4-24d525660804 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] No waiting events found dispatching network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:47:10 user nova-compute[71557]: WARNING nova.compute.manager [req-8cc5045e-aeab-4357-be56-62989a9f788a req-3c666239-13fd-42b3-9bc4-24d525660804 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received unexpected event network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance with vm_state building and task_state spawning.
Apr 12 10:47:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "d687131b-6853-4d65-b8f7-ecef019ae9f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:10 user nova-compute[71557]: DEBUG nova.objects.instance [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lazy-loading 'flavor' on Instance uuid d687131b-6853-4d65-b8f7-ecef019ae9f3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:47:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "d687131b-6853-4d65-b8f7-ecef019ae9f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:11 user nova-compute[71557]: INFO nova.compute.manager [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Attaching volume 28d188bd-314c-45f4-b762-cb2b3be5b226 to /dev/vdb
Apr 12 10:47:11 user nova-compute[71557]: DEBUG os_brick.utils [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:47:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:11 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b605830b-c99d-43aa-a80b-888ef8541d91]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:11 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1add751-9fc4-4124-b5d6-93964569ad92]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:11 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a25b30e-0f1c-4df2-b205-de3be8fded10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:11 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcd85c4-0eda-4977-ad15-4afd2589d130]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:47:11 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:47:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:47:11 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:47:11 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50fb45b-676d-48fb-bf7f-b81306e385f4]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:11 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:47:11 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:47:11 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:47:11 user nova-compute[71557]: DEBUG os_brick.utils [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:47:11 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Updating existing volume attachment record: 88d8d62d-5992-4782-8a4a-0a1cb4dfe918 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:47:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-70d73ac6-272d-4824-a080-64a0ab3d3ab1 req-9134ceaf-b464-46fb-b767-a3d8175a9247 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received event network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:47:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-70d73ac6-272d-4824-a080-64a0ab3d3ab1 req-9134ceaf-b464-46fb-b767-a3d8175a9247 service nova] Acquiring lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-70d73ac6-272d-4824-a080-64a0ab3d3ab1 req-9134ceaf-b464-46fb-b767-a3d8175a9247 service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-70d73ac6-272d-4824-a080-64a0ab3d3ab1 req-9134ceaf-b464-46fb-b767-a3d8175a9247 service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-70d73ac6-272d-4824-a080-64a0ab3d3ab1 req-9134ceaf-b464-46fb-b767-a3d8175a9247 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] No waiting events found dispatching network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:47:12 user nova-compute[71557]: WARNING nova.compute.manager [req-70d73ac6-272d-4824-a080-64a0ab3d3ab1 req-9134ceaf-b464-46fb-b767-a3d8175a9247 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received unexpected event network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance with vm_state building and task_state spawning.
Apr 12 10:47:12 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296432.1337004, 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:47:12 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] VM Resumed (Lifecycle Event)
Apr 12 10:47:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:47:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:47:12 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Instance spawned successfully.
Apr 12 10:47:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:47:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:47:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:47:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:47:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:47:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:47:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:47:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:47:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:47:12 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:47:12 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296432.1344705, 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:47:12 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] VM Started (Lifecycle Event)
Apr 12 10:47:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:47:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:47:12 user nova-compute[71557]: INFO nova.compute.manager [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Took 6.01 seconds to spawn the instance on the hypervisor.
Apr 12 10:47:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:47:12 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:47:12 user nova-compute[71557]: INFO nova.compute.manager [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Took 17.70 seconds to build instance.
Apr 12 10:47:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4cb0f103-8f53-47a8-80d7-1a8c2d056a03 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.804s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-05c10d7a-d07c-40d3-9da2-8a0b0e8c39e3 req-8a55909b-ffd7-4c9e-abc1-cf8fe59e9c5e service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Received event network-changed-78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-05c10d7a-d07c-40d3-9da2-8a0b0e8c39e3 req-8a55909b-ffd7-4c9e-abc1-cf8fe59e9c5e service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Refreshing instance network info cache due to event network-changed-78a8426a-653a-44cb-80b7-8a8b14d78cf4. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-05c10d7a-d07c-40d3-9da2-8a0b0e8c39e3 req-8a55909b-ffd7-4c9e-abc1-cf8fe59e9c5e service nova] Acquiring lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-05c10d7a-d07c-40d3-9da2-8a0b0e8c39e3 req-8a55909b-ffd7-4c9e-abc1-cf8fe59e9c5e service nova] Acquired lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG nova.network.neutron [req-05c10d7a-d07c-40d3-9da2-8a0b0e8c39e3 req-8a55909b-ffd7-4c9e-abc1-cf8fe59e9c5e service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Refreshing network info cache for port 78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "68b29390-867e-4bf3-bc93-b401f32b130e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "68b29390-867e-4bf3-bc93-b401f32b130e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:15 user nova-compute[71557]: INFO nova.compute.manager [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Terminating instance
Apr 12 10:47:15 user nova-compute[71557]: DEBUG nova.compute.manager [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-f76ae28e-6036-47fb-9bfb-8766d1fa80b5 req-db73a3f9-80f6-4f2f-be36-0ff326a4598e service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Received event network-vif-unplugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f76ae28e-6036-47fb-9bfb-8766d1fa80b5 req-db73a3f9-80f6-4f2f-be36-0ff326a4598e service nova] Acquiring lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f76ae28e-6036-47fb-9bfb-8766d1fa80b5 req-db73a3f9-80f6-4f2f-be36-0ff326a4598e service nova] Lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f76ae28e-6036-47fb-9bfb-8766d1fa80b5 req-db73a3f9-80f6-4f2f-be36-0ff326a4598e service nova] Lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-f76ae28e-6036-47fb-9bfb-8766d1fa80b5 req-db73a3f9-80f6-4f2f-be36-0ff326a4598e service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] No waiting events found dispatching network-vif-unplugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-f76ae28e-6036-47fb-9bfb-8766d1fa80b5 req-db73a3f9-80f6-4f2f-be36-0ff326a4598e service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Received event network-vif-unplugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMuCsHqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:47:15 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:47:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:47:15 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:47:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:47:15 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7cfe7c-3b1c-4f17-978e-1411e2d277ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:47:15 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee44c9a7-9bb3-4c6d-b392-e1ab6e67c62e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226] added
Apr 12 10:47:15 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e397237-1860-42e8-9055-716b856f365a]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0454836f-982c-40b4-97d2-73c8b1816263]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xMuCsHqP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xMuCsHqP" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0c3bd0-8b28-4d51-a856-17671c53ef3b]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xMuCsHqP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c065ce-a479-4e79-a298-827f8442ad21]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bdefdb-c1cd-47c0-a65f-3574a8bbf955]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:47:16 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:47:16 user nova-compute[71557]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:47:16 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:47:16 user nova-compute[71557]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)
Apr 12 10:47:16 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:47:16 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:47:16 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:47:16 user nova-compute[71557]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:47:16 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:47:16 user nova-compute[71557]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)
Apr 12 10:47:16 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:47:16 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:16 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Instance destroyed successfully.
Apr 12 10:47:16 user nova-compute[71557]: DEBUG nova.objects.instance [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lazy-loading 'resources' on Instance uuid 68b29390-867e-4bf3-bc93-b401f32b130e {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T10:41:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1222922378',display_name='tempest-TestShelveInstance-server-1222922378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1222922378',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOk2UPAom5CjZdHfplY6HjUNzNcB4NEAH+k/X71Ve1S4CsmjYhLiu/vz+zIBK/KpJ2uQiNOTfsgNS8zhPMGpKrvMmQM5PVNKr7l+PqrgS24giNXUhI2aB8tdrnYrhcS2EQ==',key_name='tempest-TestShelveInstance-577615131',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:45:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90ef7aa45de34b01a97b6bc5e0acece5',ramdisk_id='',reservation_id='r-yukf9uzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1176962424',owner_user_name='tempest-TestShelveInstance-1176962424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:45:36Z,user_data=None,user_id='574af27cae41457c9be3d5d50d347b27',uuid=68b29390-867e-4bf3-bc93-b401f32b130e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Converting VIF {"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:d2:fe,bridge_name='br-int',has_traffic_filtering=True,id=78a8426a-653a-44cb-80b7-8a8b14d78cf4,network=Network(f87563f2-62e3-4d56-b03a-0a830493f69b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a8426a-65') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG os_vif [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:d2:fe,bridge_name='br-int',has_traffic_filtering=True,id=78a8426a-653a-44cb-80b7-8a8b14d78cf4,network=Network(f87563f2-62e3-4d56-b03a-0a830493f69b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a8426a-65') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[372b67e5-f0aa-46c9-b3bd-857c8c778224]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226, portal: 172.16.0.220,3260]
Apr 12 10:47:16 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226, portal: 172.16.0.220,3260] successful.
Apr 12 10:47:16 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78a8426a-65, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:47:16 user nova-compute[71557]: INFO os_vif [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:d2:fe,bridge_name='br-int',has_traffic_filtering=True,id=78a8426a-653a-44cb-80b7-8a8b14d78cf4,network=Network(f87563f2-62e3-4d56-b03a-0a830493f69b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a8426a-65')
Apr 12 10:47:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AuHwQTaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:47:16 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:47:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG nova.network.neutron [req-05c10d7a-d07c-40d3-9da2-8a0b0e8c39e3 req-8a55909b-ffd7-4c9e-abc1-cf8fe59e9c5e service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Updated VIF entry in instance network info cache for port 78a8426a-653a-44cb-80b7-8a8b14d78cf4. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG nova.network.neutron [req-05c10d7a-d07c-40d3-9da2-8a0b0e8c39e3 req-8a55909b-ffd7-4c9e-abc1-cf8fe59e9c5e service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Updating instance_info_cache with network_info: [{"id": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "address": "fa:16:3e:6a:d2:fe", "network": {"id": "f87563f2-62e3-4d56-b03a-0a830493f69b", "bridge": "br-int", "label": "tempest-TestShelveInstance-325340905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ef7aa45de34b01a97b6bc5e0acece5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a8426a-65", "ovs_interfaceid": "78a8426a-653a-44cb-80b7-8a8b14d78cf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66c960b-f5f6-4805-ae84-f8489227db75]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-05c10d7a-d07c-40d3-9da2-8a0b0e8c39e3 req-8a55909b-ffd7-4c9e-abc1-cf8fe59e9c5e service nova] Releasing lock "refresh_cache-68b29390-867e-4bf3-bc93-b401f32b130e" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df8242c-e452-403e-82af-11318d024afd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:47:16 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:47:16 user nova-compute[71557]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:47:16 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:47:16 user nova-compute[71557]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)
Apr 12 10:47:16 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:47:16 user nova-compute[71557]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)
Apr 12 10:47:16 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:47:16 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:47:16 user nova-compute[71557]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:47:16 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:47:16 user nova-compute[71557]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)
Apr 12 10:47:16 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:47:16 user nova-compute[71557]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)
Apr 12 10:47:16 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] HCTL ('38', '-', '-', 0) found on session 31 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[452ed6ea-c71d-42f3-8c45-c1fda6d1e3c3]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:47:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMuCsHqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '23136356335396435', 'path': '/dev/sdg'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136356335396435', 'path': '/dev/sdg'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.100s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG nova.objects.instance [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lazy-loading 'flavor' on Instance uuid d687131b-6853-4d65-b8f7-ecef019ae9f3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ba65a2-d7e6-4880-95d1-565b33dcd2c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:47:17 user nova-compute[71557]: No targets found.
Apr 12 10:47:17 user nova-compute[71557]: iSNS:
Apr 12 10:47:17 user nova-compute[71557]: No targets found.
Apr 12 10:47:17 user nova-compute[71557]: STATIC:
Apr 12 10:47:17 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:47:17 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:47:17 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:47:17 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b
Apr 12 10:47:17 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:47:17 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:47:17 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226
Apr 12 10:47:17 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:47:17 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:47:17 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf
Apr 12 10:47:17 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:47:17 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:47:17 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36
Apr 12 10:47:17 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:47:17 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:47:17 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61
Apr 12 10:47:17 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:47:17 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:47:17 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711
Apr 12 10:47:17 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:47:17 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:47:17 user nova-compute[71557]: FIRMWARE:
Apr 12 10:47:17 user nova-compute[71557]: No targets found.
Apr 12 10:47:17 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:47:17 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:47:17 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 10:47:17 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:47:17 user nova-compute[71557]:   <source dev="/dev/sdg"/>
Apr 12 10:47:17 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:47:17 user nova-compute[71557]:   <serial>28d188bd-314c-45f4-b762-cb2b3be5b226</serial>
Apr 12 10:47:17 user nova-compute[71557]: </disk>
Apr 12 10:47:17 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0237009a-9332-4a11-805f-a6eb51836944]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[05944e8e-0e4f-43c7-8115-28124e73013f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:47:17 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:47:17 user nova-compute[71557]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:47:17 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:47:17 user nova-compute[71557]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)
Apr 12 10:47:17 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:47:17 user nova-compute[71557]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)
Apr 12 10:47:17 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:47:17 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:47:17 user nova-compute[71557]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b (non-flash)
Apr 12 10:47:17 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:47:17 user nova-compute[71557]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)
Apr 12 10:47:17 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:47:17 user nova-compute[71557]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)
Apr 12 10:47:17 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fddfb5fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b'): ({'sde'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Removing single pathed devices sde {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5439fca-3535-4a28-97b0-843d68c1f3e7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3066c9e-baae-4677-a315-6bf18418452e]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Flushing IO for device /dev/sde {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[423e850c-7419-4826-a51e-83a26ef4693a]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec7a2ba-9ff8-4a3a-a6b5-fb63541c302f]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] SCSI volumes sde have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e6583c-fa1f-447b-bef1-7511abdf1280]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d21405-b3ea-41b0-b350-2cb0604d463d]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b, portal: 172.16.0.220,3260]
Apr 12 10:47:17 user nova-compute[71557]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b, portal: 172.16.0.220,3260] successful.
Apr 12 10:47:17 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6850f05-a7ca-4a81-ad02-a1e4d506702b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94f0705-7a17-4f43-b4aa-005b28a55bc6]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] <== disconnect_volume: return (1484ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:47:17 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Deleting instance files /opt/stack/data/nova/instances/68b29390-867e-4bf3-bc93-b401f32b130e_del
Apr 12 10:47:17 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Deletion of /opt/stack/data/nova/instances/68b29390-867e-4bf3-bc93-b401f32b130e_del complete
Apr 12 10:47:17 user nova-compute[71557]: DEBUG nova.compute.manager [req-481c131b-f6ce-4306-816b-374c9fc0f7b0 req-72df544c-3b80-4286-b33f-ec1f46bd0ab0 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Received event network-vif-plugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-481c131b-f6ce-4306-816b-374c9fc0f7b0 req-72df544c-3b80-4286-b33f-ec1f46bd0ab0 service nova] Acquiring lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-481c131b-f6ce-4306-816b-374c9fc0f7b0 req-72df544c-3b80-4286-b33f-ec1f46bd0ab0 service nova] Lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-481c131b-f6ce-4306-816b-374c9fc0f7b0 req-72df544c-3b80-4286-b33f-ec1f46bd0ab0 service nova] Lock "68b29390-867e-4bf3-bc93-b401f32b130e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG nova.compute.manager [req-481c131b-f6ce-4306-816b-374c9fc0f7b0 req-72df544c-3b80-4286-b33f-ec1f46bd0ab0 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] No waiting events found dispatching network-vif-plugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:47:17 user nova-compute[71557]: WARNING nova.compute.manager [req-481c131b-f6ce-4306-816b-374c9fc0f7b0 req-72df544c-3b80-4286-b33f-ec1f46bd0ab0 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Received unexpected event network-vif-plugged-78a8426a-653a-44cb-80b7-8a8b14d78cf4 for instance with vm_state active and task_state deleting.
Apr 12 10:47:17 user nova-compute[71557]: INFO nova.compute.manager [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Took 2.44 seconds to destroy the instance on the hypervisor.
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] No VIF found with MAC fa:16:3e:f4:d5:7d, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:47:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e100975e-54c7-4de9-a1d4-9c5a97f34de6 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.874s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:18 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:47:18 user nova-compute[71557]: DEBUG nova.compute.manager [req-62c8bd24-3268-45f0-9b55-4603845d24a4 req-3f583066-5bea-4896-a961-a2283cd53e21 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Received event network-vif-deleted-78a8426a-653a-44cb-80b7-8a8b14d78cf4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:47:18 user nova-compute[71557]: INFO nova.compute.manager [req-62c8bd24-3268-45f0-9b55-4603845d24a4 req-3f583066-5bea-4896-a961-a2283cd53e21 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Neutron deleted interface 78a8426a-653a-44cb-80b7-8a8b14d78cf4; detaching it from the instance and deleting it from the info cache
Apr 12 10:47:18 user nova-compute[71557]: DEBUG nova.network.neutron [req-62c8bd24-3268-45f0-9b55-4603845d24a4 req-3f583066-5bea-4896-a961-a2283cd53e21 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:47:18 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Took 0.53 seconds to deallocate network for instance.
Apr 12 10:47:18 user nova-compute[71557]: DEBUG nova.compute.manager [req-62c8bd24-3268-45f0-9b55-4603845d24a4 req-3f583066-5bea-4896-a961-a2283cd53e21 service nova] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Detach interface failed, port_id=78a8426a-653a-44cb-80b7-8a8b14d78cf4, reason: Instance 68b29390-867e-4bf3-bc93-b401f32b130e could not be found. {{(pid=71557) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 10:47:18 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:18 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:19 user nova-compute[71557]: INFO nova.compute.manager [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Took 0.92 seconds to detach 1 volumes for instance.
Apr 12 10:47:19 user nova-compute[71557]: DEBUG nova.compute.manager [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Deleting volume: e6850f05-a7ca-4a81-ad02-a1e4d506702b {{(pid=71557) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 10:47:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:19 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:47:19 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:47:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:19 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Deleted allocations for instance 68b29390-867e-4bf3-bc93-b401f32b130e
Apr 12 10:47:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-feceec5f-e09f-4ebf-8ce1-b27ac102755f tempest-TestShelveInstance-1176962424 tempest-TestShelveInstance-1176962424-project-member] Lock "68b29390-867e-4bf3-bc93-b401f32b130e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.642s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:22 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:47:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:47:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-79a2edbe-5a6e-4c7e-be72-b15b98f6d5e0 req-334dde7b-6f6e-43b2-9392-d371076ffdd9 service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Received event network-changed-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:47:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-79a2edbe-5a6e-4c7e-be72-b15b98f6d5e0 req-334dde7b-6f6e-43b2-9392-d371076ffdd9 service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Refreshing instance network info cache due to event network-changed-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:47:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-79a2edbe-5a6e-4c7e-be72-b15b98f6d5e0 req-334dde7b-6f6e-43b2-9392-d371076ffdd9 service nova] Acquiring lock "refresh_cache-d687131b-6853-4d65-b8f7-ecef019ae9f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:47:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-79a2edbe-5a6e-4c7e-be72-b15b98f6d5e0 req-334dde7b-6f6e-43b2-9392-d371076ffdd9 service nova] Acquired lock "refresh_cache-d687131b-6853-4d65-b8f7-ecef019ae9f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:47:23 user nova-compute[71557]: DEBUG nova.network.neutron [req-79a2edbe-5a6e-4c7e-be72-b15b98f6d5e0 req-334dde7b-6f6e-43b2-9392-d371076ffdd9 service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Refreshing network info cache for port 04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:47:23 user nova-compute[71557]: DEBUG nova.network.neutron [req-79a2edbe-5a6e-4c7e-be72-b15b98f6d5e0 req-334dde7b-6f6e-43b2-9392-d371076ffdd9 service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Updated VIF entry in instance network info cache for port 04a9fb9a-518e-4c3c-bf70-d2a7cff04e43. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:47:23 user nova-compute[71557]: DEBUG nova.network.neutron [req-79a2edbe-5a6e-4c7e-be72-b15b98f6d5e0 req-334dde7b-6f6e-43b2-9392-d371076ffdd9 service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Updating instance_info_cache with network_info: [{"id": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "address": "fa:16:3e:f4:d5:7d", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9fb9a-51", "ovs_interfaceid": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:47:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-79a2edbe-5a6e-4c7e-be72-b15b98f6d5e0 req-334dde7b-6f6e-43b2-9392-d371076ffdd9 service nova] Releasing lock "refresh_cache-d687131b-6853-4d65-b8f7-ecef019ae9f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:47:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:25 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:47:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:47:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-0dae2ef6-416c-43fe-8a54-00d86b3f7fad req-8f18a4ad-0562-4502-92ba-e4603c49381f service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Received event network-changed-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:47:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-0dae2ef6-416c-43fe-8a54-00d86b3f7fad req-8f18a4ad-0562-4502-92ba-e4603c49381f service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Refreshing instance network info cache due to event network-changed-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:47:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0dae2ef6-416c-43fe-8a54-00d86b3f7fad req-8f18a4ad-0562-4502-92ba-e4603c49381f service nova] Acquiring lock "refresh_cache-d687131b-6853-4d65-b8f7-ecef019ae9f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:47:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0dae2ef6-416c-43fe-8a54-00d86b3f7fad req-8f18a4ad-0562-4502-92ba-e4603c49381f service nova] Acquired lock "refresh_cache-d687131b-6853-4d65-b8f7-ecef019ae9f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:47:25 user nova-compute[71557]: DEBUG nova.network.neutron [req-0dae2ef6-416c-43fe-8a54-00d86b3f7fad req-8f18a4ad-0562-4502-92ba-e4603c49381f service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Refreshing network info cache for port 04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:47:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-4b79f4d7-f34e-4971-8a6f-171c2d71d683" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:47:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-4b79f4d7-f34e-4971-8a6f-171c2d71d683" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:47:25 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:47:26 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Updating instance_info_cache with network_info: [{"id": "ac9512bb-5122-4a70-b970-f82605ed0606", "address": "fa:16:3e:74:3e:82", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9512bb-51", "ovs_interfaceid": "ac9512bb-5122-4a70-b970-f82605ed0606", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:47:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-4b79f4d7-f34e-4971-8a6f-171c2d71d683" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:47:26 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:47:26 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:47:26 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:47:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:26 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:47:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:47:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:47:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:26 user nova-compute[71557]: DEBUG nova.network.neutron [req-0dae2ef6-416c-43fe-8a54-00d86b3f7fad req-8f18a4ad-0562-4502-92ba-e4603c49381f service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Updated VIF entry in instance network info cache for port 04a9fb9a-518e-4c3c-bf70-d2a7cff04e43. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:47:26 user nova-compute[71557]: DEBUG nova.network.neutron [req-0dae2ef6-416c-43fe-8a54-00d86b3f7fad req-8f18a4ad-0562-4502-92ba-e4603c49381f service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Updating instance_info_cache with network_info: [{"id": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "address": "fa:16:3e:f4:d5:7d", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9fb9a-51", "ovs_interfaceid": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:47:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0dae2ef6-416c-43fe-8a54-00d86b3f7fad req-8f18a4ad-0562-4502-92ba-e4603c49381f service nova] Releasing lock "refresh_cache-d687131b-6853-4d65-b8f7-ecef019ae9f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:47:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:47:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "d687131b-6853-4d65-b8f7-ecef019ae9f3" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:28 user nova-compute[71557]: INFO nova.compute.manager [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Rebooting instance
Apr 12 10:47:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "refresh_cache-d687131b-6853-4d65-b8f7-ecef019ae9f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:47:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquired lock "refresh_cache-d687131b-6853-4d65-b8f7-ecef019ae9f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:47:28 user nova-compute[71557]: DEBUG nova.network.neutron [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:47:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:28 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:47:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.network.neutron [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Updating instance_info_cache with network_info: [{"id": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "address": "fa:16:3e:f4:d5:7d", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9fb9a-51", "ovs_interfaceid": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Releasing lock "refresh_cache-d687131b-6853-4d65-b8f7-ecef019ae9f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.compute.manager [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:47:29 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:47:29 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=7558MB free_disk=26.147876739501953GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 97bafe22-36bf-4939-baf8-9602551bad52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance d687131b-6853-4d65-b8f7-ecef019ae9f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Refreshing inventories for resource provider 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Updating ProviderTree inventory for provider 24299bcb-a671-492d-9d13-df83697a8f87 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Updating inventory in ProviderTree for provider 24299bcb-a671-492d-9d13-df83697a8f87 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.compute.manager [req-d17519b3-f3f1-487b-94ef-fd9f04708f25 req-fcc06f07-06d5-4ce1-a8cf-5b2857bff129 service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Received event network-vif-unplugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d17519b3-f3f1-487b-94ef-fd9f04708f25 req-fcc06f07-06d5-4ce1-a8cf-5b2857bff129 service nova] Acquiring lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d17519b3-f3f1-487b-94ef-fd9f04708f25 req-fcc06f07-06d5-4ce1-a8cf-5b2857bff129 service nova] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d17519b3-f3f1-487b-94ef-fd9f04708f25 req-fcc06f07-06d5-4ce1-a8cf-5b2857bff129 service nova] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.compute.manager [req-d17519b3-f3f1-487b-94ef-fd9f04708f25 req-fcc06f07-06d5-4ce1-a8cf-5b2857bff129 service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] No waiting events found dispatching network-vif-unplugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:47:29 user nova-compute[71557]: WARNING nova.compute.manager [req-d17519b3-f3f1-487b-94ef-fd9f04708f25 req-fcc06f07-06d5-4ce1-a8cf-5b2857bff129 service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Received unexpected event network-vif-unplugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 for instance with vm_state active and task_state reboot_started_hard.
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Refreshing aggregate associations for resource provider 24299bcb-a671-492d-9d13-df83697a8f87, aggregates: None {{(pid=71557) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 10:47:29 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Refreshing trait associations for resource provider 24299bcb-a671-492d-9d13-df83697a8f87, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=71557) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.684s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:30 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Instance destroyed successfully.
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.objects.instance [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lazy-loading 'resources' on Instance uuid d687131b-6853-4d65-b8f7-ecef019ae9f3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-158631664',display_name='tempest-TestMinimumBasicScenario-server-158631664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-158631664',id=27,image_ref='5bdef35f-97c6-4c63-9b32-a181693bd012',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2R09lY3z1ofkLd/mex8UHM7qHU7uJkgT1OJi5eN5mVbcu+cTMWeldTRYda5cvD2AEA6DLVvL+HztqfG6Bz3W8LigkJXzJuoHTW2uKsH+Ju0S6/fUn1Cb36RGt8Yf4qPQ==',key_name='tempest-TestMinimumBasicScenario-2015119923',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:45:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b467fac451ee466fb93cec3d3aa3b408',ramdisk_id='',reservation_id='r-93l3f400',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5bdef35f-97c6-4c63-9b32-a181693bd012',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2095634766',owner_user_name='tempest-TestMinimumBasicScenario-2095634766-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:47:29Z,user_data=None,user_id='a633ec4046a9467683cbfd2ebe59600f',uuid=d687131b-6853-4d65-b8f7-ecef019ae9f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "address": "fa:16:3e:f4:d5:7d", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9fb9a-51", "ovs_interfaceid": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Converting VIF {"id": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "address": "fa:16:3e:f4:d5:7d", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9fb9a-51", "ovs_interfaceid": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:d5:7d,bridge_name='br-int',has_traffic_filtering=True,id=04a9fb9a-518e-4c3c-bf70-d2a7cff04e43,network=Network(d284a588-7406-446d-af3c-874a119b7536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04a9fb9a-51') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_vif [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:d5:7d,bridge_name='br-int',has_traffic_filtering=True,id=04a9fb9a-518e-4c3c-bf70-d2a7cff04e43,network=Network(d284a588-7406-446d-af3c-874a119b7536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04a9fb9a-51') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04a9fb9a-51, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:30 user nova-compute[71557]: INFO os_vif [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:d5:7d,bridge_name='br-int',has_traffic_filtering=True,id=04a9fb9a-518e-4c3c-bf70-d2a7cff04e43,network=Network(d284a588-7406-446d-af3c-874a119b7536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04a9fb9a-51')
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMuCsHqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:47:30 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[25334529-069f-4079-a95f-f386745a84d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:47:30 user nova-compute[71557]: No targets found.
Apr 12 10:47:30 user nova-compute[71557]: iSNS:
Apr 12 10:47:30 user nova-compute[71557]: No targets found.
Apr 12 10:47:30 user nova-compute[71557]: STATIC:
Apr 12 10:47:30 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:47:30 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:47:30 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:47:30 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226
Apr 12 10:47:30 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:47:30 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:47:30 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf
Apr 12 10:47:30 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:47:30 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:47:30 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36
Apr 12 10:47:30 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:47:30 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:47:30 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61
Apr 12 10:47:30 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:47:30 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:47:30 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711
Apr 12 10:47:30 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:47:30 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:47:30 user nova-compute[71557]: FIRMWARE:
Apr 12 10:47:30 user nova-compute[71557]: No targets found.
Apr 12 10:47:30 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:47:30 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:47:30 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb91d5d-932b-4bb1-9118-0ba18858f8f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ea3efb-89f2-4d59-8a23-70b7466f8fa2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:47:30 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:47:30 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:47:30 user nova-compute[71557]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)
Apr 12 10:47:30 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:47:30 user nova-compute[71557]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)
Apr 12 10:47:30 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:47:30 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:47:30 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:47:30 user nova-compute[71557]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)
Apr 12 10:47:30 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:47:30 user nova-compute[71557]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)
Apr 12 10:47:30 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd448cdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226'): ({'sdg'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Removing single pathed devices sdg {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee301386-4eab-4fdf-b447-1b5868c1215a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fc8102-7324-4129-98f1-015c4dd7684f]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Flushing IO for device /dev/sdg {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[880af984-ebce-44bb-802e-3b8ccc23b45a]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1c9994-36be-4a56-b810-a3d8217d9b83]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] SCSI volumes sdg have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d750fb-8670-4b81-aec1-43a3a245dd23]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d141c0-1c9a-4335-8847-caaf835263cf]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226, portal: 172.16.0.220,3260]
Apr 12 10:47:30 user nova-compute[71557]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226, portal: 172.16.0.220,3260] successful.
Apr 12 10:47:30 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[92dacecf-d6af-4173-9a8e-d624a329f012]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] <== disconnect_volume: return (347ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Start _get_guest_xml network_info=[{"id": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "address": "fa:16:3e:f4:d5:7d", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9fb9a-51", "ovs_interfaceid": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5bdef35f-97c6-4c63-9b32-a181693bd012,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5bdef35f-97c6-4c63-9b32-a181693bd012'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'attachment_id': '88d8d62d-5992-4782-8a4a-0a1cb4dfe918', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMuCsHqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'd687131b-6853-4d65-b8f7-ecef019ae9f3', 'attached_at': '', 'detached_at': '', 'volume_id': '28d188bd-314c-45f4-b762-cb2b3be5b226', 'serial': '28d188bd-314c-45f4-b762-cb2b3be5b226'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:47:30 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:47:30 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5bdef35f-97c6-4c63-9b32-a181693bd012,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.objects.instance [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lazy-loading 'vcpu_model' on Instance uuid d687131b-6853-4d65-b8f7-ecef019ae9f3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMuCsHqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:47:30 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:47:30 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:47:30 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdba3333-b0a9-40e7-95c4-c415e9b298c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:47:30 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ceddc77-69d8-4acc-a6b9-0cd2f86dd830]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226] added
Apr 12 10:47:30 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afa453d-ee6e-48bf-8b9a-6361a4597218]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f659b49-404f-4206-b144-e1f2f1114c5f]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xMuCsHqP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xMuCsHqP" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0200d9-4feb-479a-a513-37462cfe3451]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:30 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xMuCsHqP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bda04bd-8422-4a15-bb4a-9532c0f5f83e]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[de62f8b6-cb77-4de3-a13f-32ee0d00258d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:47:31 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:47:31 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:47:31 user nova-compute[71557]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)
Apr 12 10:47:31 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:47:31 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:47:31 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:47:31 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:47:31 user nova-compute[71557]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)
Apr 12 10:47:31 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:47:31 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296436.0817032, 68b29390-867e-4bf3-bc93-b401f32b130e => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:47:31 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] VM Stopped (Lifecycle Event)
Apr 12 10:47:31 user nova-compute[71557]: DEBUG nova.compute.manager [None req-1b2ea017-119e-4aae-9930-3bd6b178e70d None None] [instance: 68b29390-867e-4bf3-bc93-b401f32b130e] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[276fd398-5780-444b-8acd-5039cf36fce5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226, portal: 172.16.0.220,3260]
Apr 12 10:47:31 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226, portal: 172.16.0.220,3260] successful.
Apr 12 10:47:31 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc0f052-6ac7-47aa-825f-972bc8a9d05c]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade75a2c-edc1-406b-b4a7-ee1dd4e4bbde]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:47:31 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:47:31 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:47:31 user nova-compute[71557]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)
Apr 12 10:47:31 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:47:31 user nova-compute[71557]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)
Apr 12 10:47:31 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:47:31 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:47:31 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:47:31 user nova-compute[71557]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)
Apr 12 10:47:31 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:47:31 user nova-compute[71557]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)
Apr 12 10:47:31 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ad17af-9811-457d-83cb-39bb74886085]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: None {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG nova.compute.manager [req-06e999a0-a222-4899-8a95-1026720f568b req-9324ba4d-56a6-40f9-bfe5-8e8d82d1a196 service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Received event network-vif-plugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-06e999a0-a222-4899-8a95-1026720f568b req-9324ba4d-56a6-40f9-bfe5-8e8d82d1a196 service nova] Acquiring lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-06e999a0-a222-4899-8a95-1026720f568b req-9324ba4d-56a6-40f9-bfe5-8e8d82d1a196 service nova] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-06e999a0-a222-4899-8a95-1026720f568b req-9324ba4d-56a6-40f9-bfe5-8e8d82d1a196 service nova] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:31 user nova-compute[71557]: DEBUG nova.compute.manager [req-06e999a0-a222-4899-8a95-1026720f568b req-9324ba4d-56a6-40f9-bfe5-8e8d82d1a196 service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] No waiting events found dispatching network-vif-plugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:47:31 user nova-compute[71557]: WARNING nova.compute.manager [req-06e999a0-a222-4899-8a95-1026720f568b req-9324ba4d-56a6-40f9-bfe5-8e8d82d1a196 service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Received unexpected event network-vif-plugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 for instance with vm_state active and task_state reboot_started_hard.
Apr 12 10:47:32 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMuCsHqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23136356335396435', 'path': '/dev/sde'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136356335396435', 'path': '/dev/sde'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-158631664',display_name='tempest-TestMinimumBasicScenario-server-158631664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-158631664',id=27,image_ref='5bdef35f-97c6-4c63-9b32-a181693bd012',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2R09lY3z1ofkLd/mex8UHM7qHU7uJkgT1OJi5eN5mVbcu+cTMWeldTRYda5cvD2AEA6DLVvL+HztqfG6Bz3W8LigkJXzJuoHTW2uKsH+Ju0S6/fUn1Cb36RGt8Yf4qPQ==',key_name='tempest-TestMinimumBasicScenario-2015119923',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:45:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b467fac451ee466fb93cec3d3aa3b408',ramdisk_id='',reservation_id='r-93l3f400',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5bdef35f-97c6-4c63-9b32-a181693bd012',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2095634766',owner_user_name='tempest-TestMinimumBasicScenario-2095634766-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:47:29Z,user_data=None,user_id='a633ec4046a9467683cbfd2ebe59600f',uuid=d687131b-6853-4d65-b8f7-ecef019ae9f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "address": "fa:16:3e:f4:d5:7d", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9fb9a-51", "ovs_interfaceid": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Converting VIF {"id": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "address": "fa:16:3e:f4:d5:7d", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9fb9a-51", "ovs_interfaceid": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:d5:7d,bridge_name='br-int',has_traffic_filtering=True,id=04a9fb9a-518e-4c3c-bf70-d2a7cff04e43,network=Network(d284a588-7406-446d-af3c-874a119b7536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04a9fb9a-51') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG nova.objects.instance [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lazy-loading 'pci_devices' on Instance uuid d687131b-6853-4d65-b8f7-ecef019ae9f3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:47:32 user nova-compute[71557]:   <uuid>d687131b-6853-4d65-b8f7-ecef019ae9f3</uuid>
Apr 12 10:47:32 user nova-compute[71557]:   <name>instance-0000001b</name>
Apr 12 10:47:32 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:47:32 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:47:32 user nova-compute[71557]:   <metadata>
Apr 12 10:47:32 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:47:32 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:47:32 user nova-compute[71557]:       <nova:name>tempest-TestMinimumBasicScenario-server-158631664</nova:name>
Apr 12 10:47:32 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:47:30</nova:creationTime>
Apr 12 10:47:32 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:47:32 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:47:32 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:47:32 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:47:32 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:47:32 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:47:32 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:47:32 user nova-compute[71557]:       <nova:owner>
Apr 12 10:47:32 user nova-compute[71557]:         <nova:user uuid="a633ec4046a9467683cbfd2ebe59600f">tempest-TestMinimumBasicScenario-2095634766-project-member</nova:user>
Apr 12 10:47:32 user nova-compute[71557]:         <nova:project uuid="b467fac451ee466fb93cec3d3aa3b408">tempest-TestMinimumBasicScenario-2095634766</nova:project>
Apr 12 10:47:32 user nova-compute[71557]:       </nova:owner>
Apr 12 10:47:32 user nova-compute[71557]:       <nova:root type="image" uuid="5bdef35f-97c6-4c63-9b32-a181693bd012"/>
Apr 12 10:47:32 user nova-compute[71557]:       <nova:ports>
Apr 12 10:47:32 user nova-compute[71557]:         <nova:port uuid="04a9fb9a-518e-4c3c-bf70-d2a7cff04e43">
Apr 12 10:47:32 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 10:47:32 user nova-compute[71557]:         </nova:port>
Apr 12 10:47:32 user nova-compute[71557]:       </nova:ports>
Apr 12 10:47:32 user nova-compute[71557]:     </nova:instance>
Apr 12 10:47:32 user nova-compute[71557]:   </metadata>
Apr 12 10:47:32 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:47:32 user nova-compute[71557]:     <system>
Apr 12 10:47:32 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:47:32 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:47:32 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:47:32 user nova-compute[71557]:       <entry name="serial">d687131b-6853-4d65-b8f7-ecef019ae9f3</entry>
Apr 12 10:47:32 user nova-compute[71557]:       <entry name="uuid">d687131b-6853-4d65-b8f7-ecef019ae9f3</entry>
Apr 12 10:47:32 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:47:32 user nova-compute[71557]:     </system>
Apr 12 10:47:32 user nova-compute[71557]:   </sysinfo>
Apr 12 10:47:32 user nova-compute[71557]:   <os>
Apr 12 10:47:32 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:47:32 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:47:32 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:47:32 user nova-compute[71557]:   </os>
Apr 12 10:47:32 user nova-compute[71557]:   <features>
Apr 12 10:47:32 user nova-compute[71557]:     <acpi/>
Apr 12 10:47:32 user nova-compute[71557]:     <apic/>
Apr 12 10:47:32 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:47:32 user nova-compute[71557]:   </features>
Apr 12 10:47:32 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:47:32 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:47:32 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:47:32 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:47:32 user nova-compute[71557]:   </clock>
Apr 12 10:47:32 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:47:32 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:47:32 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:47:32 user nova-compute[71557]:   </cpu>
Apr 12 10:47:32 user nova-compute[71557]:   <devices>
Apr 12 10:47:32 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:47:32 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:47:32 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk"/>
Apr 12 10:47:32 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:47:32 user nova-compute[71557]:     </disk>
Apr 12 10:47:32 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:47:32 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:47:32 user nova-compute[71557]:       <source dev="/dev/sde"/>
Apr 12 10:47:32 user nova-compute[71557]:       <target dev="vdb" bus="virtio"/>
Apr 12 10:47:32 user nova-compute[71557]:       <serial>28d188bd-314c-45f4-b762-cb2b3be5b226</serial>
Apr 12 10:47:32 user nova-compute[71557]:     </disk>
Apr 12 10:47:32 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:47:32 user nova-compute[71557]:       <mac address="fa:16:3e:f4:d5:7d"/>
Apr 12 10:47:32 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:47:32 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:47:32 user nova-compute[71557]:       <target dev="tap04a9fb9a-51"/>
Apr 12 10:47:32 user nova-compute[71557]:     </interface>
Apr 12 10:47:32 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:47:32 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/console.log" append="off"/>
Apr 12 10:47:32 user nova-compute[71557]:     </serial>
Apr 12 10:47:32 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:47:32 user nova-compute[71557]:     <video>
Apr 12 10:47:32 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:47:32 user nova-compute[71557]:     </video>
Apr 12 10:47:32 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:47:32 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:47:32 user nova-compute[71557]:     </rng>
Apr 12 10:47:32 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:47:32 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:47:32 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:47:32 user nova-compute[71557]:     </memballoon>
Apr 12 10:47:32 user nova-compute[71557]:   </devices>
Apr 12 10:47:32 user nova-compute[71557]: </domain>
Apr 12 10:47:32 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG nova.objects.instance [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lazy-loading 'trusted_certs' on Instance uuid d687131b-6853-4d65-b8f7-ecef019ae9f3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5c52322154532de0ef8c1e725423b0e091601d8 --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a5c52322154532de0ef8c1e725423b0e091601d8 --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Cannot resize image /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG nova.objects.instance [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lazy-loading 'migration_context' on Instance uuid d687131b-6853-4d65-b8f7-ecef019ae9f3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-158631664',display_name='tempest-TestMinimumBasicScenario-server-158631664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-158631664',id=27,image_ref='5bdef35f-97c6-4c63-9b32-a181693bd012',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2R09lY3z1ofkLd/mex8UHM7qHU7uJkgT1OJi5eN5mVbcu+cTMWeldTRYda5cvD2AEA6DLVvL+HztqfG6Bz3W8LigkJXzJuoHTW2uKsH+Ju0S6/fUn1Cb36RGt8Yf4qPQ==',key_name='tempest-TestMinimumBasicScenario-2015119923',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:45:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='b467fac451ee466fb93cec3d3aa3b408',ramdisk_id='',reservation_id='r-93l3f400',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5bdef35f-97c6-4c63-9b32-a181693bd012',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2095634766',owner_user_name='tempest-TestMinimumBasicScenario-2095634766-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:47:29Z,user_data=None,user_id='a633ec4046a9467683cbfd2ebe59600f',uuid=d687131b-6853-4d65-b8f7-ecef019ae9f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "address": "fa:16:3e:f4:d5:7d", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9fb9a-51", "ovs_interfaceid": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Converting VIF {"id": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "address": "fa:16:3e:f4:d5:7d", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9fb9a-51", "ovs_interfaceid": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:d5:7d,bridge_name='br-int',has_traffic_filtering=True,id=04a9fb9a-518e-4c3c-bf70-d2a7cff04e43,network=Network(d284a588-7406-446d-af3c-874a119b7536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04a9fb9a-51') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG os_vif [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:d5:7d,bridge_name='br-int',has_traffic_filtering=True,id=04a9fb9a-518e-4c3c-bf70-d2a7cff04e43,network=Network(d284a588-7406-446d-af3c-874a119b7536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04a9fb9a-51') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04a9fb9a-51, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap04a9fb9a-51, col_values=(('external_ids', {'iface-id': '04a9fb9a-518e-4c3c-bf70-d2a7cff04e43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:d5:7d', 'vm-uuid': 'd687131b-6853-4d65-b8f7-ecef019ae9f3'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:47:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:32 user nova-compute[71557]: INFO os_vif [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:d5:7d,bridge_name='br-int',has_traffic_filtering=True,id=04a9fb9a-518e-4c3c-bf70-d2a7cff04e43,network=Network(d284a588-7406-446d-af3c-874a119b7536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04a9fb9a-51')
Apr 12 10:47:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:33 user nova-compute[71557]: INFO nova.compute.manager [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Detaching volume 520ed03a-e80e-4bc4-afed-57601fa90711
Apr 12 10:47:33 user nova-compute[71557]: INFO nova.virt.block_device [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Attempting to driver detach volume 520ed03a-e80e-4bc4-afed-57601fa90711 from mountpoint /dev/vdb
Apr 12 10:47:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Attempting to detach device vdb from instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:47:33 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:47:33 user nova-compute[71557]:   <source dev="/dev/sdd"/>
Apr 12 10:47:33 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:47:33 user nova-compute[71557]:   <serial>520ed03a-e80e-4bc4-afed-57601fa90711</serial>
Apr 12 10:47:33 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:47:33 user nova-compute[71557]: </disk>
Apr 12 10:47:33 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:47:33 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Successfully detached device vdb from instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 from the persistent domain config.
Apr 12 10:47:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:47:33 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:47:33 user nova-compute[71557]:   <source dev="/dev/sdd"/>
Apr 12 10:47:33 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:47:33 user nova-compute[71557]:   <serial>520ed03a-e80e-4bc4-afed-57601fa90711</serial>
Apr 12 10:47:33 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:47:33 user nova-compute[71557]: </disk>
Apr 12 10:47:33 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681296453.8922472, 4b79f4d7-f34e-4971-8a6f-171c2d71d683 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 10:47:33 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Successfully detached device vdb from instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683 from the live domain config.
Apr 12 10:47:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AdEDnoQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:47:33 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:47:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43c576d-848f-4fae-b7fc-9d3c1b190a58]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:47:33 user nova-compute[71557]: No targets found.
Apr 12 10:47:33 user nova-compute[71557]: iSNS:
Apr 12 10:47:33 user nova-compute[71557]: No targets found.
Apr 12 10:47:33 user nova-compute[71557]: STATIC:
Apr 12 10:47:33 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:47:33 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:47:33 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:47:33 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226
Apr 12 10:47:33 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:47:33 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:47:33 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf
Apr 12 10:47:33 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:47:33 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:47:33 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36
Apr 12 10:47:33 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:47:33 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:47:33 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61
Apr 12 10:47:33 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:47:33 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:47:33 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711
Apr 12 10:47:33 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:47:33 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:47:33 user nova-compute[71557]: FIRMWARE:
Apr 12 10:47:33 user nova-compute[71557]: No targets found.
Apr 12 10:47:33 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:47:33 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:47:33 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1a2b75-bd49-4ef1-9fa9-08746f3d736c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f8aea8-a304-4241-9bbd-267f2f655182]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:47:33 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:47:33 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:47:33 user nova-compute[71557]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)
Apr 12 10:47:33 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:47:33 user nova-compute[71557]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)
Apr 12 10:47:33 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:47:33 user nova-compute[71557]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 (non-flash)
Apr 12 10:47:33 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:47:33 user nova-compute[71557]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)
Apr 12 10:47:33 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:47:33 user nova-compute[71557]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)
Apr 12 10:47:33 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fe12d9090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711'): ({'sdd'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Removing single pathed devices sdd {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:47:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d722333a-b13f-41e1-ba35-9fdaba587fad]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1fe030-dac2-448d-afa5-558a1b7c6b1c]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Flushing IO for device /dev/sdd {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[02775c7f-be70-494f-b3dc-441777a645e7]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[755cab61-aa82-481c-9240-f6b154ff207c]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] SCSI volumes sdd have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6498f15-a960-4d6e-8e6e-078e31ad8e99]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe03bc2-47d9-4081-bbbe-d72d934567db]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711, portal: 172.16.0.220,3260]
Apr 12 10:47:34 user nova-compute[71557]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711, portal: 172.16.0.220,3260] successful.
Apr 12 10:47:34 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520ed03a-e80e-4bc4-afed-57601fa90711 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a184bf07-7138-468c-aa70-25864dfe1100]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] <== disconnect_volume: return (316ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG nova.compute.manager [req-8ca7fe0b-d181-466e-a9ad-bfde6c4499de req-3ab3815e-7c6a-48f6-a067-669ac7c9cc8a service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Received event network-vif-plugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8ca7fe0b-d181-466e-a9ad-bfde6c4499de req-3ab3815e-7c6a-48f6-a067-669ac7c9cc8a service nova] Acquiring lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8ca7fe0b-d181-466e-a9ad-bfde6c4499de req-3ab3815e-7c6a-48f6-a067-669ac7c9cc8a service nova] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8ca7fe0b-d181-466e-a9ad-bfde6c4499de req-3ab3815e-7c6a-48f6-a067-669ac7c9cc8a service nova] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:34 user nova-compute[71557]: DEBUG nova.compute.manager [req-8ca7fe0b-d181-466e-a9ad-bfde6c4499de req-3ab3815e-7c6a-48f6-a067-669ac7c9cc8a service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] No waiting events found dispatching network-vif-plugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:47:34 user nova-compute[71557]: WARNING nova.compute.manager [req-8ca7fe0b-d181-466e-a9ad-bfde6c4499de req-3ab3815e-7c6a-48f6-a067-669ac7c9cc8a service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Received unexpected event network-vif-plugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 for instance with vm_state active and task_state reboot_started_hard.
Apr 12 10:47:35 user nova-compute[71557]: INFO nova.compute.manager [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Rescuing
Apr 12 10:47:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "refresh_cache-be3f67e5-420d-42a2-b68a-7cadff22fa48" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:47:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquired lock "refresh_cache-be3f67e5-420d-42a2-b68a-7cadff22fa48" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:47:35 user nova-compute[71557]: DEBUG nova.network.neutron [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:47:35 user nova-compute[71557]: DEBUG nova.objects.instance [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'flavor' on Instance uuid 4b79f4d7-f34e-4971-8a6f-171c2d71d683 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:47:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9e16182d-8564-430c-a64b-0a8eab641d60 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.054s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:35 user nova-compute[71557]: DEBUG nova.network.neutron [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Updating instance_info_cache with network_info: [{"id": "943dbed4-3180-4221-b27c-710c0118b7cf", "address": "fa:16:3e:d5:a9:3b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap943dbed4-31", "ovs_interfaceid": "943dbed4-3180-4221-b27c-710c0118b7cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:47:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Releasing lock "refresh_cache-be3f67e5-420d-42a2-b68a-7cadff22fa48" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:47:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:35 user nova-compute[71557]: DEBUG nova.compute.manager [req-7e2c59ad-0479-4971-ba9f-482a94add591 req-34bb5c31-2724-4df5-a9f0-bde9589e155e service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received event network-vif-unplugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:47:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7e2c59ad-0479-4971-ba9f-482a94add591 req-34bb5c31-2724-4df5-a9f0-bde9589e155e service nova] Acquiring lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7e2c59ad-0479-4971-ba9f-482a94add591 req-34bb5c31-2724-4df5-a9f0-bde9589e155e service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7e2c59ad-0479-4971-ba9f-482a94add591 req-34bb5c31-2724-4df5-a9f0-bde9589e155e service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:35 user nova-compute[71557]: DEBUG nova.compute.manager [req-7e2c59ad-0479-4971-ba9f-482a94add591 req-34bb5c31-2724-4df5-a9f0-bde9589e155e service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] No waiting events found dispatching network-vif-unplugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:47:35 user nova-compute[71557]: WARNING nova.compute.manager [req-7e2c59ad-0479-4971-ba9f-482a94add591 req-34bb5c31-2724-4df5-a9f0-bde9589e155e service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received unexpected event network-vif-unplugged-943dbed4-3180-4221-b27c-710c0118b7cf for instance with vm_state active and task_state rescuing.
Apr 12 10:47:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:36 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Instance destroyed successfully.
Apr 12 10:47:36 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Attempting rescue
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71557) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Instance directory exists: not creating {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 10:47:36 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Creating image(s)
Apr 12 10:47:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "/opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "/opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "/opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.objects.instance [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'trusted_certs' on Instance uuid be3f67e5-420d-42a2-b68a-7cadff22fa48 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk.rescue {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk.rescue" returned: 0 in 0.047s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.objects.instance [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'migration_context' on Instance uuid be3f67e5-420d-42a2-b68a-7cadff22fa48 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Start _get_guest_xml network_info=[{"id": "943dbed4-3180-4221-b27c-710c0118b7cf", "address": "fa:16:3e:d5:a9:3b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "vif_mac": "fa:16:3e:d5:a9:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap943dbed4-31", "ovs_interfaceid": "943dbed4-3180-4221-b27c-710c0118b7cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.objects.instance [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'resources' on Instance uuid be3f67e5-420d-42a2-b68a-7cadff22fa48 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.objects.instance [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'numa_topology' on Instance uuid be3f67e5-420d-42a2-b68a-7cadff22fa48 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:47:36 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:47:36 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.objects.instance [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'vcpu_model' on Instance uuid be3f67e5-420d-42a2-b68a-7cadff22fa48 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1871933050',display_name='tempest-ServerRescueNegativeTestJSON-server-1871933050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1871933050',id=22,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:43:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b39cd8e55b54a86a7784f2934273e20',ramdisk_id='',reservation_id='r-14dvps6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1632398833',owner_user_name='tempest-ServerRescueNegativeTestJSON-1632398833-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:43:01Z,user_data=None,user_id='abdf772f2c7341c29159b6f1f2ce7ccb',uuid=be3f67e5-420d-42a2-b68a-7cadff22fa48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "943dbed4-3180-4221-b27c-710c0118b7cf", "address": "fa:16:3e:d5:a9:3b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "vif_mac": "fa:16:3e:d5:a9:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap943dbed4-31", "ovs_interfaceid": "943dbed4-3180-4221-b27c-710c0118b7cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converting VIF {"id": "943dbed4-3180-4221-b27c-710c0118b7cf", "address": "fa:16:3e:d5:a9:3b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "vif_mac": "fa:16:3e:d5:a9:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap943dbed4-31", "ovs_interfaceid": "943dbed4-3180-4221-b27c-710c0118b7cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a9:3b,bridge_name='br-int',has_traffic_filtering=True,id=943dbed4-3180-4221-b27c-710c0118b7cf,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap943dbed4-31') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.objects.instance [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'pci_devices' on Instance uuid be3f67e5-420d-42a2-b68a-7cadff22fa48 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:47:36 user nova-compute[71557]:   <uuid>be3f67e5-420d-42a2-b68a-7cadff22fa48</uuid>
Apr 12 10:47:36 user nova-compute[71557]:   <name>instance-00000016</name>
Apr 12 10:47:36 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:47:36 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:47:36 user nova-compute[71557]:   <metadata>
Apr 12 10:47:36 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:47:36 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:47:36 user nova-compute[71557]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1871933050</nova:name>
Apr 12 10:47:36 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:47:36</nova:creationTime>
Apr 12 10:47:36 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:47:36 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:47:36 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:47:36 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:47:36 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:47:36 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:47:36 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:47:36 user nova-compute[71557]:       <nova:owner>
Apr 12 10:47:36 user nova-compute[71557]:         <nova:user uuid="abdf772f2c7341c29159b6f1f2ce7ccb">tempest-ServerRescueNegativeTestJSON-1632398833-project-member</nova:user>
Apr 12 10:47:36 user nova-compute[71557]:         <nova:project uuid="2b39cd8e55b54a86a7784f2934273e20">tempest-ServerRescueNegativeTestJSON-1632398833</nova:project>
Apr 12 10:47:36 user nova-compute[71557]:       </nova:owner>
Apr 12 10:47:36 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:47:36 user nova-compute[71557]:       <nova:ports>
Apr 12 10:47:36 user nova-compute[71557]:         <nova:port uuid="943dbed4-3180-4221-b27c-710c0118b7cf">
Apr 12 10:47:36 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 10:47:36 user nova-compute[71557]:         </nova:port>
Apr 12 10:47:36 user nova-compute[71557]:       </nova:ports>
Apr 12 10:47:36 user nova-compute[71557]:     </nova:instance>
Apr 12 10:47:36 user nova-compute[71557]:   </metadata>
Apr 12 10:47:36 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:47:36 user nova-compute[71557]:     <system>
Apr 12 10:47:36 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:47:36 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:47:36 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:47:36 user nova-compute[71557]:       <entry name="serial">be3f67e5-420d-42a2-b68a-7cadff22fa48</entry>
Apr 12 10:47:36 user nova-compute[71557]:       <entry name="uuid">be3f67e5-420d-42a2-b68a-7cadff22fa48</entry>
Apr 12 10:47:36 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:47:36 user nova-compute[71557]:     </system>
Apr 12 10:47:36 user nova-compute[71557]:   </sysinfo>
Apr 12 10:47:36 user nova-compute[71557]:   <os>
Apr 12 10:47:36 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:47:36 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:47:36 user nova-compute[71557]:   </os>
Apr 12 10:47:36 user nova-compute[71557]:   <features>
Apr 12 10:47:36 user nova-compute[71557]:     <acpi/>
Apr 12 10:47:36 user nova-compute[71557]:     <apic/>
Apr 12 10:47:36 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:47:36 user nova-compute[71557]:   </features>
Apr 12 10:47:36 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:47:36 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:47:36 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:47:36 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:47:36 user nova-compute[71557]:   </clock>
Apr 12 10:47:36 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:47:36 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:47:36 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:47:36 user nova-compute[71557]:   </cpu>
Apr 12 10:47:36 user nova-compute[71557]:   <devices>
Apr 12 10:47:36 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:47:36 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:47:36 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk.rescue"/>
Apr 12 10:47:36 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:47:36 user nova-compute[71557]:     </disk>
Apr 12 10:47:36 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:47:36 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:47:36 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk"/>
Apr 12 10:47:36 user nova-compute[71557]:       <target dev="vdb" bus="virtio"/>
Apr 12 10:47:36 user nova-compute[71557]:     </disk>
Apr 12 10:47:36 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:47:36 user nova-compute[71557]:       <mac address="fa:16:3e:d5:a9:3b"/>
Apr 12 10:47:36 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:47:36 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:47:36 user nova-compute[71557]:       <target dev="tap943dbed4-31"/>
Apr 12 10:47:36 user nova-compute[71557]:     </interface>
Apr 12 10:47:36 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:47:36 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/console.log" append="off"/>
Apr 12 10:47:36 user nova-compute[71557]:     </serial>
Apr 12 10:47:36 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:47:36 user nova-compute[71557]:     <video>
Apr 12 10:47:36 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:47:36 user nova-compute[71557]:     </video>
Apr 12 10:47:36 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:47:36 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:47:36 user nova-compute[71557]:     </rng>
Apr 12 10:47:36 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:47:36 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:47:36 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:47:36 user nova-compute[71557]:     </memballoon>
Apr 12 10:47:36 user nova-compute[71557]:   </devices>
Apr 12 10:47:36 user nova-compute[71557]: </domain>
Apr 12 10:47:36 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:47:36 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Instance destroyed successfully.
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] No VIF found with MAC fa:16:3e:d5:a9:3b, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-deb9f6a7-f668-4311-87af-77e3d91951ca req-bc66af3d-0ba8-4388-bc3f-31d2c46fe13e service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Received event network-vif-plugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-deb9f6a7-f668-4311-87af-77e3d91951ca req-bc66af3d-0ba8-4388-bc3f-31d2c46fe13e service nova] Acquiring lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-deb9f6a7-f668-4311-87af-77e3d91951ca req-bc66af3d-0ba8-4388-bc3f-31d2c46fe13e service nova] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-deb9f6a7-f668-4311-87af-77e3d91951ca req-bc66af3d-0ba8-4388-bc3f-31d2c46fe13e service nova] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-deb9f6a7-f668-4311-87af-77e3d91951ca req-bc66af3d-0ba8-4388-bc3f-31d2c46fe13e service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] No waiting events found dispatching network-vif-plugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:47:36 user nova-compute[71557]: WARNING nova.compute.manager [req-deb9f6a7-f668-4311-87af-77e3d91951ca req-bc66af3d-0ba8-4388-bc3f-31d2c46fe13e service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Received unexpected event network-vif-plugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 for instance with vm_state active and task_state reboot_started_hard.
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.compute.manager [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Removed pending event for d687131b-6853-4d65-b8f7-ecef019ae9f3 due to event {{(pid=71557) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296456.9111688, d687131b-6853-4d65-b8f7-ecef019ae9f3 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:47:36 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] VM Resumed (Lifecycle Event)
Apr 12 10:47:36 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Instance rebooted successfully.
Apr 12 10:47:36 user nova-compute[71557]: DEBUG nova.compute.manager [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:47:37 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:47:37 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:47:37 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 12 10:47:37 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296456.912269, d687131b-6853-4d65-b8f7-ecef019ae9f3 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:47:37 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] VM Started (Lifecycle Event)
Apr 12 10:47:37 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:47:37 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:47:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-315c1bef-8689-4780-8ac0-acb8de93e76e tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.717s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:37 user nova-compute[71557]: DEBUG nova.compute.manager [req-795e2f1e-a3d9-4a9c-ad0c-b74a94f1b78b req-5e44a633-a2d7-4468-b30a-7db367e9e136 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received event network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:47:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-795e2f1e-a3d9-4a9c-ad0c-b74a94f1b78b req-5e44a633-a2d7-4468-b30a-7db367e9e136 service nova] Acquiring lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-795e2f1e-a3d9-4a9c-ad0c-b74a94f1b78b req-5e44a633-a2d7-4468-b30a-7db367e9e136 service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-795e2f1e-a3d9-4a9c-ad0c-b74a94f1b78b req-5e44a633-a2d7-4468-b30a-7db367e9e136 service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:37 user nova-compute[71557]: DEBUG nova.compute.manager [req-795e2f1e-a3d9-4a9c-ad0c-b74a94f1b78b req-5e44a633-a2d7-4468-b30a-7db367e9e136 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] No waiting events found dispatching network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:47:37 user nova-compute[71557]: WARNING nova.compute.manager [req-795e2f1e-a3d9-4a9c-ad0c-b74a94f1b78b req-5e44a633-a2d7-4468-b30a-7db367e9e136 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received unexpected event network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf for instance with vm_state active and task_state rescuing.
Apr 12 10:47:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:40 user nova-compute[71557]: DEBUG nova.compute.manager [req-90c7f493-251e-4afb-b63f-624524e4e0e8 req-cfb144e7-a8b5-44e7-9f7d-f192a061bef4 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received event network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:47:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-90c7f493-251e-4afb-b63f-624524e4e0e8 req-cfb144e7-a8b5-44e7-9f7d-f192a061bef4 service nova] Acquiring lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-90c7f493-251e-4afb-b63f-624524e4e0e8 req-cfb144e7-a8b5-44e7-9f7d-f192a061bef4 service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-90c7f493-251e-4afb-b63f-624524e4e0e8 req-cfb144e7-a8b5-44e7-9f7d-f192a061bef4 service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:40 user nova-compute[71557]: DEBUG nova.compute.manager [req-90c7f493-251e-4afb-b63f-624524e4e0e8 req-cfb144e7-a8b5-44e7-9f7d-f192a061bef4 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] No waiting events found dispatching network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:47:40 user nova-compute[71557]: WARNING nova.compute.manager [req-90c7f493-251e-4afb-b63f-624524e4e0e8 req-cfb144e7-a8b5-44e7-9f7d-f192a061bef4 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received unexpected event network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf for instance with vm_state active and task_state rescuing.
Apr 12 10:47:40 user nova-compute[71557]: DEBUG nova.compute.manager [req-90c7f493-251e-4afb-b63f-624524e4e0e8 req-cfb144e7-a8b5-44e7-9f7d-f192a061bef4 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received event network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:47:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-90c7f493-251e-4afb-b63f-624524e4e0e8 req-cfb144e7-a8b5-44e7-9f7d-f192a061bef4 service nova] Acquiring lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-90c7f493-251e-4afb-b63f-624524e4e0e8 req-cfb144e7-a8b5-44e7-9f7d-f192a061bef4 service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-90c7f493-251e-4afb-b63f-624524e4e0e8 req-cfb144e7-a8b5-44e7-9f7d-f192a061bef4 service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:40 user nova-compute[71557]: DEBUG nova.compute.manager [req-90c7f493-251e-4afb-b63f-624524e4e0e8 req-cfb144e7-a8b5-44e7-9f7d-f192a061bef4 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] No waiting events found dispatching network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:47:40 user nova-compute[71557]: WARNING nova.compute.manager [req-90c7f493-251e-4afb-b63f-624524e4e0e8 req-cfb144e7-a8b5-44e7-9f7d-f192a061bef4 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received unexpected event network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf for instance with vm_state active and task_state rescuing.
Apr 12 10:47:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Removed pending event for be3f67e5-420d-42a2-b68a-7cadff22fa48 due to event {{(pid=71557) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 10:47:40 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296460.6096106, be3f67e5-420d-42a2-b68a-7cadff22fa48 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:47:40 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] VM Resumed (Lifecycle Event)
Apr 12 10:47:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c7575717-f712-48ae-afd5-78a3705ccda0 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:47:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:47:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:47:40 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 10:47:40 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296460.611392, be3f67e5-420d-42a2-b68a-7cadff22fa48 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:47:40 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] VM Started (Lifecycle Event)
Apr 12 10:47:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:47:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:47:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:47:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:54 user nova-compute[71557]: DEBUG nova.compute.manager [req-2acc909c-ccc3-4696-a635-eb4850fd978e req-c9f0d638-4000-4cdd-8aab-089285f88247 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Received event network-changed-65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:47:54 user nova-compute[71557]: DEBUG nova.compute.manager [req-2acc909c-ccc3-4696-a635-eb4850fd978e req-c9f0d638-4000-4cdd-8aab-089285f88247 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Refreshing instance network info cache due to event network-changed-65d96800-cdfa-49fe-a407-05d5b661f452. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:47:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2acc909c-ccc3-4696-a635-eb4850fd978e req-c9f0d638-4000-4cdd-8aab-089285f88247 service nova] Acquiring lock "refresh_cache-76758da6-ef8f-433f-b4e8-8d72f01b6b34" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:47:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2acc909c-ccc3-4696-a635-eb4850fd978e req-c9f0d638-4000-4cdd-8aab-089285f88247 service nova] Acquired lock "refresh_cache-76758da6-ef8f-433f-b4e8-8d72f01b6b34" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:47:54 user nova-compute[71557]: DEBUG nova.network.neutron [req-2acc909c-ccc3-4696-a635-eb4850fd978e req-c9f0d638-4000-4cdd-8aab-089285f88247 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Refreshing network info cache for port 65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:47:55 user nova-compute[71557]: DEBUG nova.network.neutron [req-2acc909c-ccc3-4696-a635-eb4850fd978e req-c9f0d638-4000-4cdd-8aab-089285f88247 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Updated VIF entry in instance network info cache for port 65d96800-cdfa-49fe-a407-05d5b661f452. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:47:55 user nova-compute[71557]: DEBUG nova.network.neutron [req-2acc909c-ccc3-4696-a635-eb4850fd978e req-c9f0d638-4000-4cdd-8aab-089285f88247 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Updating instance_info_cache with network_info: [{"id": "65d96800-cdfa-49fe-a407-05d5b661f452", "address": "fa:16:3e:29:b0:94", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d96800-cd", "ovs_interfaceid": "65d96800-cdfa-49fe-a407-05d5b661f452", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:47:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2acc909c-ccc3-4696-a635-eb4850fd978e req-c9f0d638-4000-4cdd-8aab-089285f88247 service nova] Releasing lock "refresh_cache-76758da6-ef8f-433f-b4e8-8d72f01b6b34" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:47:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:56 user nova-compute[71557]: INFO nova.compute.manager [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Shelving
Apr 12 10:47:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:57 user nova-compute[71557]: DEBUG nova.compute.manager [req-582e0e02-64e3-4433-a0d1-98acb0034220 req-a3b3b8a0-5aca-4575-abd8-472edd18ca21 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Received event network-vif-unplugged-65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:47:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-582e0e02-64e3-4433-a0d1-98acb0034220 req-a3b3b8a0-5aca-4575-abd8-472edd18ca21 service nova] Acquiring lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-582e0e02-64e3-4433-a0d1-98acb0034220 req-a3b3b8a0-5aca-4575-abd8-472edd18ca21 service nova] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-582e0e02-64e3-4433-a0d1-98acb0034220 req-a3b3b8a0-5aca-4575-abd8-472edd18ca21 service nova] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:57 user nova-compute[71557]: DEBUG nova.compute.manager [req-582e0e02-64e3-4433-a0d1-98acb0034220 req-a3b3b8a0-5aca-4575-abd8-472edd18ca21 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] No waiting events found dispatching network-vif-unplugged-65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:47:57 user nova-compute[71557]: WARNING nova.compute.manager [req-582e0e02-64e3-4433-a0d1-98acb0034220 req-a3b3b8a0-5aca-4575-abd8-472edd18ca21 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Received unexpected event network-vif-unplugged-65d96800-cdfa-49fe-a407-05d5b661f452 for instance with vm_state active and task_state shelving.
Apr 12 10:47:57 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Instance destroyed successfully.
Apr 12 10:47:57 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Beginning cold snapshot process
Apr 12 10:47:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:58 user nova-compute[71557]: DEBUG nova.privsep.utils [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71557) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 10:47:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk /opt/stack/data/nova/instances/snapshots/tmpx9j_yig3/190fabeb3a3a4d4ab864a85a5c4e859a {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:47:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk /opt/stack/data/nova/instances/snapshots/tmpx9j_yig3/190fabeb3a3a4d4ab864a85a5c4e859a" returned: 0 in 0.600s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:47:58 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Snapshot extracted, beginning image upload
Apr 12 10:47:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:47:59 user nova-compute[71557]: DEBUG nova.compute.manager [req-2a7a8339-70f2-40d1-b948-89aa3017177d req-86291f2c-6c39-4a42-8970-336d8fcdb7d6 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Received event network-vif-plugged-65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:47:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a7a8339-70f2-40d1-b948-89aa3017177d req-86291f2c-6c39-4a42-8970-336d8fcdb7d6 service nova] Acquiring lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:47:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a7a8339-70f2-40d1-b948-89aa3017177d req-86291f2c-6c39-4a42-8970-336d8fcdb7d6 service nova] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:47:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2a7a8339-70f2-40d1-b948-89aa3017177d req-86291f2c-6c39-4a42-8970-336d8fcdb7d6 service nova] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:47:59 user nova-compute[71557]: DEBUG nova.compute.manager [req-2a7a8339-70f2-40d1-b948-89aa3017177d req-86291f2c-6c39-4a42-8970-336d8fcdb7d6 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] No waiting events found dispatching network-vif-plugged-65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:47:59 user nova-compute[71557]: WARNING nova.compute.manager [req-2a7a8339-70f2-40d1-b948-89aa3017177d req-86291f2c-6c39-4a42-8970-336d8fcdb7d6 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Received unexpected event network-vif-plugged-65d96800-cdfa-49fe-a407-05d5b661f452 for instance with vm_state active and task_state shelving_image_uploading.
Apr 12 10:48:00 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Snapshot image upload complete
Apr 12 10:48:00 user nova-compute[71557]: DEBUG nova.compute.manager [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:48:00 user nova-compute[71557]: INFO nova.compute.manager [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Shelve offloading
Apr 12 10:48:00 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Instance destroyed successfully.
Apr 12 10:48:00 user nova-compute[71557]: DEBUG nova.compute.manager [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:48:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "refresh_cache-76758da6-ef8f-433f-b4e8-8d72f01b6b34" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:48:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquired lock "refresh_cache-76758da6-ef8f-433f-b4e8-8d72f01b6b34" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:48:00 user nova-compute[71557]: DEBUG nova.network.neutron [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:48:01 user nova-compute[71557]: DEBUG nova.network.neutron [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Updating instance_info_cache with network_info: [{"id": "65d96800-cdfa-49fe-a407-05d5b661f452", "address": "fa:16:3e:29:b0:94", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d96800-cd", "ovs_interfaceid": "65d96800-cdfa-49fe-a407-05d5b661f452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:48:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Releasing lock "refresh_cache-76758da6-ef8f-433f-b4e8-8d72f01b6b34" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:48:01 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Instance destroyed successfully.
Apr 12 10:48:01 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'resources' on Instance uuid 76758da6-ef8f-433f-b4e8-8d72f01b6b34 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:48:01 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-637881895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-637881895',id=28,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+kfG5JhTbXJvo4JchrKmOzn92ZUEmlrTD0glXq+axhyaimCqqgKU45MbV6YpEhNYXodiKBbWNpJwThQxwbW5Ag7tRarIRqtDBp4vnVNoqqjXoHeq8fGfxhehEge51e0Q==',key_name='tempest-keypair-538398767',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:46:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='af33ce0944194932b663c3b8aef9783d',ramdisk_id='',reservation_id='r-g610bp0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-603525697',owner_user_name='tempest-AttachVolumeShelveTestJSON-603525697-project-member',shelved_at='2023-04-12T10:48:00.714395',shelved_host='user',shelved_image_id='8575029c-3469-4a97-844b-84ed215601e4'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:47:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d6279f1ce94008a2898ade6f730b40',uuid=76758da6-ef8f-433f-b4e8-8d72f01b6b34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "65d96800-cdfa-49fe-a407-05d5b661f452", "address": "fa:16:3e:29:b0:94", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d96800-cd", "ovs_interfaceid": "65d96800-cdfa-49fe-a407-05d5b661f452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:48:01 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converting VIF {"id": "65d96800-cdfa-49fe-a407-05d5b661f452", "address": "fa:16:3e:29:b0:94", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d96800-cd", "ovs_interfaceid": "65d96800-cdfa-49fe-a407-05d5b661f452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:48:01 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:b0:94,bridge_name='br-int',has_traffic_filtering=True,id=65d96800-cdfa-49fe-a407-05d5b661f452,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d96800-cd') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:48:01 user nova-compute[71557]: DEBUG os_vif [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:b0:94,bridge_name='br-int',has_traffic_filtering=True,id=65d96800-cdfa-49fe-a407-05d5b661f452,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d96800-cd') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:48:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65d96800-cd, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:48:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:48:02 user nova-compute[71557]: INFO os_vif [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:b0:94,bridge_name='br-int',has_traffic_filtering=True,id=65d96800-cdfa-49fe-a407-05d5b661f452,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d96800-cd')
Apr 12 10:48:02 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Deleting instance files /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34_del
Apr 12 10:48:02 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Deletion of /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34_del complete
Apr 12 10:48:02 user nova-compute[71557]: DEBUG nova.compute.manager [req-d7c79d9f-ca5e-45da-8665-954a91caf50a req-5ab1a462-a1cb-48ec-b972-5ec01ce82f71 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Received event network-changed-65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:48:02 user nova-compute[71557]: DEBUG nova.compute.manager [req-d7c79d9f-ca5e-45da-8665-954a91caf50a req-5ab1a462-a1cb-48ec-b972-5ec01ce82f71 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Refreshing instance network info cache due to event network-changed-65d96800-cdfa-49fe-a407-05d5b661f452. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:48:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d7c79d9f-ca5e-45da-8665-954a91caf50a req-5ab1a462-a1cb-48ec-b972-5ec01ce82f71 service nova] Acquiring lock "refresh_cache-76758da6-ef8f-433f-b4e8-8d72f01b6b34" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:48:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d7c79d9f-ca5e-45da-8665-954a91caf50a req-5ab1a462-a1cb-48ec-b972-5ec01ce82f71 service nova] Acquired lock "refresh_cache-76758da6-ef8f-433f-b4e8-8d72f01b6b34" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:48:02 user nova-compute[71557]: DEBUG nova.network.neutron [req-d7c79d9f-ca5e-45da-8665-954a91caf50a req-5ab1a462-a1cb-48ec-b972-5ec01ce82f71 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Refreshing network info cache for port 65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:48:02 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Deleted allocations for instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34
Apr 12 10:48:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:48:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:48:02 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'numa_topology' on Instance uuid 76758da6-ef8f-433f-b4e8-8d72f01b6b34 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:48:02 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:48:02 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:48:02 user nova-compute[71557]: DEBUG nova.network.neutron [req-d7c79d9f-ca5e-45da-8665-954a91caf50a req-5ab1a462-a1cb-48ec-b972-5ec01ce82f71 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Updated VIF entry in instance network info cache for port 65d96800-cdfa-49fe-a407-05d5b661f452. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:48:02 user nova-compute[71557]: DEBUG nova.network.neutron [req-d7c79d9f-ca5e-45da-8665-954a91caf50a req-5ab1a462-a1cb-48ec-b972-5ec01ce82f71 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Updating instance_info_cache with network_info: [{"id": "65d96800-cdfa-49fe-a407-05d5b661f452", "address": "fa:16:3e:29:b0:94", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap65d96800-cd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:48:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d7c79d9f-ca5e-45da-8665-954a91caf50a req-5ab1a462-a1cb-48ec-b972-5ec01ce82f71 service nova] Releasing lock "refresh_cache-76758da6-ef8f-433f-b4e8-8d72f01b6b34" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:48:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:48:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a6f1fb2b-6a00-46d5-91cd-84b984c02116 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.667s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:48:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:12 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296477.6861186, 76758da6-ef8f-433f-b4e8-8d72f01b6b34 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:48:12 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] VM Stopped (Lifecycle Event)
Apr 12 10:48:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c44bc205-0435-4941-93d1-b2b1fa8f2238 None None] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:48:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "aa5a8d3c-a65a-4a05-9874-ad22b597ddec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:48:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "aa5a8d3c-a65a-4a05-9874-ad22b597ddec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:48:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "aa5a8d3c-a65a-4a05-9874-ad22b597ddec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:48:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "aa5a8d3c-a65a-4a05-9874-ad22b597ddec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:48:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "aa5a8d3c-a65a-4a05-9874-ad22b597ddec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:48:13 user nova-compute[71557]: INFO nova.compute.manager [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Terminating instance
Apr 12 10:48:13 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:48:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-63e053f6-33cf-46af-abe8-1df296947302 req-db31c859-6b2a-4f4c-959c-f431ddd8b897 service nova] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Received event network-vif-unplugged-363567f1-4d02-4e70-aba9-b7b5c7e2b7ab {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:48:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-63e053f6-33cf-46af-abe8-1df296947302 req-db31c859-6b2a-4f4c-959c-f431ddd8b897 service nova] Acquiring lock "aa5a8d3c-a65a-4a05-9874-ad22b597ddec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:48:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-63e053f6-33cf-46af-abe8-1df296947302 req-db31c859-6b2a-4f4c-959c-f431ddd8b897 service nova] Lock "aa5a8d3c-a65a-4a05-9874-ad22b597ddec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:48:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-63e053f6-33cf-46af-abe8-1df296947302 req-db31c859-6b2a-4f4c-959c-f431ddd8b897 service nova] Lock "aa5a8d3c-a65a-4a05-9874-ad22b597ddec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:48:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-63e053f6-33cf-46af-abe8-1df296947302 req-db31c859-6b2a-4f4c-959c-f431ddd8b897 service nova] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] No waiting events found dispatching network-vif-unplugged-363567f1-4d02-4e70-aba9-b7b5c7e2b7ab {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:48:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-63e053f6-33cf-46af-abe8-1df296947302 req-db31c859-6b2a-4f4c-959c-f431ddd8b897 service nova] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Received event network-vif-unplugged-363567f1-4d02-4e70-aba9-b7b5c7e2b7ab for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:48:14 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Instance destroyed successfully.
Apr 12 10:48:14 user nova-compute[71557]: DEBUG nova.objects.instance [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lazy-loading 'resources' on Instance uuid aa5a8d3c-a65a-4a05-9874-ad22b597ddec {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:46:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-803081492',display_name='tempest-TestVolumeBootPattern-server-803081492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-803081492',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:46:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a67f3d23b8f74a9496d445c7fc75717e',ramdisk_id='',reservation_id='r-yihb7xeq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-638607559',owner_user_name='tempest-TestVolumeBootPattern-638607559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:46:40Z,user_data=None,user_id='b914d7ca786f455baf120f98816abffd',uuid=aa5a8d3c-a65a-4a05-9874-ad22b597ddec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab", "address": "fa:16:3e:9f:71:e1", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363567f1-4d", "ovs_interfaceid": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converting VIF {"id": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab", "address": "fa:16:3e:9f:71:e1", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363567f1-4d", "ovs_interfaceid": "363567f1-4d02-4e70-aba9-b7b5c7e2b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:71:e1,bridge_name='br-int',has_traffic_filtering=True,id=363567f1-4d02-4e70-aba9-b7b5c7e2b7ab,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363567f1-4d') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG os_vif [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:71:e1,bridge_name='br-int',has_traffic_filtering=True,id=363567f1-4d02-4e70-aba9-b7b5c7e2b7ab,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363567f1-4d') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap363567f1-4d, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:48:14 user nova-compute[71557]: INFO os_vif [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:71:e1,bridge_name='br-int',has_traffic_filtering=True,id=363567f1-4d02-4e70-aba9-b7b5c7e2b7ab,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363567f1-4d')
Apr 12 10:48:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqZrEkch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:48:14 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:48:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9819c7e-171e-4e4e-96dd-04b519a82593]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:48:14 user nova-compute[71557]: No targets found.
Apr 12 10:48:14 user nova-compute[71557]: iSNS:
Apr 12 10:48:14 user nova-compute[71557]: No targets found.
Apr 12 10:48:14 user nova-compute[71557]: STATIC:
Apr 12 10:48:14 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:48:14 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:48:14 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:48:14 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226
Apr 12 10:48:14 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:48:14 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:48:14 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf
Apr 12 10:48:14 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:48:14 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:48:14 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36
Apr 12 10:48:14 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:48:14 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:48:14 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61
Apr 12 10:48:14 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:48:14 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:48:14 user nova-compute[71557]: FIRMWARE:
Apr 12 10:48:14 user nova-compute[71557]: No targets found.
Apr 12 10:48:14 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:48:14 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:48:14 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab61131c-78f7-4db2-a755-d4d90ba9a5c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cece9cbe-54a8-40f1-8ea6-bdff781e970d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:48:14 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:48:14 user nova-compute[71557]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)
Apr 12 10:48:14 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:48:14 user nova-compute[71557]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)
Apr 12 10:48:14 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:48:14 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:48:14 user nova-compute[71557]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf (non-flash)
Apr 12 10:48:14 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:48:14 user nova-compute[71557]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)
Apr 12 10:48:14 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fc4137d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf'): ({'sdf'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Removing single pathed devices sdf {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22fefb3-cd2e-4cc8-8621-329dd4964351]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[287c139f-97c4-4261-a55e-9e2fffa9dca5]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flushing IO for device /dev/sdf {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4997c564-cc1e-4d04-9058-ad288e74fab6]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d6bb84-4a5b-4784-b70a-76995fddcdf7]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] SCSI volumes sdf have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_8bf89103', '/dev/disk/by-id/scsi-1SCST_BIO8bf89103-ffa2e4117ab7d720', '/dev/disk/by-id/scsi-26666613265343131') {{(pid=82009) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4392a950-c55c-4bfa-8ab0-11b02db7c752]: (4, None) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e15ebe-ec71-4fbc-ac8c-b6dc9fc55e4c]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[05faca2b-2e18-4a38-a69d-2ea6f64767e6]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf, portal: 172.16.0.220,3260]
Apr 12 10:48:14 user nova-compute[71557]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf, portal: 172.16.0.220,3260] successful.
Apr 12 10:48:14 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e487b918-a464-4f8b-95a7-797c580b92cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a211772-43fa-4d8f-bc06-808d7e8d4923]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] <== disconnect_volume: return (340ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:48:14 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Deleting instance files /opt/stack/data/nova/instances/aa5a8d3c-a65a-4a05-9874-ad22b597ddec_del
Apr 12 10:48:14 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Deletion of /opt/stack/data/nova/instances/aa5a8d3c-a65a-4a05-9874-ad22b597ddec_del complete
Apr 12 10:48:14 user nova-compute[71557]: INFO nova.compute.manager [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 12 10:48:14 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:48:14 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:48:15 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:48:15 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Took 0.47 seconds to deallocate network for instance.
Apr 12 10:48:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-044ea6fd-6a5a-4d1a-b677-76420155f371 req-9945aa57-19e8-4d35-bcd0-f8903f48d54b service nova] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Received event network-vif-plugged-363567f1-4d02-4e70-aba9-b7b5c7e2b7ab {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:48:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-044ea6fd-6a5a-4d1a-b677-76420155f371 req-9945aa57-19e8-4d35-bcd0-f8903f48d54b service nova] Acquiring lock "aa5a8d3c-a65a-4a05-9874-ad22b597ddec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:48:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-044ea6fd-6a5a-4d1a-b677-76420155f371 req-9945aa57-19e8-4d35-bcd0-f8903f48d54b service nova] Lock "aa5a8d3c-a65a-4a05-9874-ad22b597ddec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:48:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-044ea6fd-6a5a-4d1a-b677-76420155f371 req-9945aa57-19e8-4d35-bcd0-f8903f48d54b service nova] Lock "aa5a8d3c-a65a-4a05-9874-ad22b597ddec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:48:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-044ea6fd-6a5a-4d1a-b677-76420155f371 req-9945aa57-19e8-4d35-bcd0-f8903f48d54b service nova] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] No waiting events found dispatching network-vif-plugged-363567f1-4d02-4e70-aba9-b7b5c7e2b7ab {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:48:16 user nova-compute[71557]: WARNING nova.compute.manager [req-044ea6fd-6a5a-4d1a-b677-76420155f371 req-9945aa57-19e8-4d35-bcd0-f8903f48d54b service nova] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Received unexpected event network-vif-plugged-363567f1-4d02-4e70-aba9-b7b5c7e2b7ab for instance with vm_state active and task_state deleting.
Apr 12 10:48:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-044ea6fd-6a5a-4d1a-b677-76420155f371 req-9945aa57-19e8-4d35-bcd0-f8903f48d54b service nova] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Received event network-vif-deleted-363567f1-4d02-4e70-aba9-b7b5c7e2b7ab {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:48:16 user nova-compute[71557]: INFO nova.compute.manager [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Took 0.86 seconds to detach 1 volumes for instance.
Apr 12 10:48:16 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Deleting volume: e487b918-a464-4f8b-95a7-797c580b92cf {{(pid=71557) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 10:48:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:48:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:48:16 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:48:16 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:48:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:48:16 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Deleted allocations for instance aa5a8d3c-a65a-4a05-9874-ad22b597ddec
Apr 12 10:48:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4810a785-e5af-4f72-91e4-6f105b6efc0b tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "aa5a8d3c-a65a-4a05-9874-ad22b597ddec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.113s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:48:18 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:23 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:48:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:48:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:48:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:48:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:48:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:48:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:48:23 user nova-compute[71557]: INFO nova.compute.manager [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Terminating instance
Apr 12 10:48:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:48:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-9f1c783f-57d7-4e1c-88df-003c947f92b5 req-fce3f0a8-3a57-4b61-bde5-d86f5863df40 service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Received event network-vif-unplugged-ac9512bb-5122-4a70-b970-f82605ed0606 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:48:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9f1c783f-57d7-4e1c-88df-003c947f92b5 req-fce3f0a8-3a57-4b61-bde5-d86f5863df40 service nova] Acquiring lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:48:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9f1c783f-57d7-4e1c-88df-003c947f92b5 req-fce3f0a8-3a57-4b61-bde5-d86f5863df40 service nova] Lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:48:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9f1c783f-57d7-4e1c-88df-003c947f92b5 req-fce3f0a8-3a57-4b61-bde5-d86f5863df40 service nova] Lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:48:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-9f1c783f-57d7-4e1c-88df-003c947f92b5 req-fce3f0a8-3a57-4b61-bde5-d86f5863df40 service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] No waiting events found dispatching network-vif-unplugged-ac9512bb-5122-4a70-b970-f82605ed0606 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:48:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-9f1c783f-57d7-4e1c-88df-003c947f92b5 req-fce3f0a8-3a57-4b61-bde5-d86f5863df40 service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Received event network-vif-unplugged-ac9512bb-5122-4a70-b970-f82605ed0606 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:48:24 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Instance destroyed successfully.
Apr 12 10:48:24 user nova-compute[71557]: DEBUG nova.objects.instance [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'resources' on Instance uuid 4b79f4d7-f34e-4971-8a6f-171c2d71d683 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:48:24 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:42:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-454382670',display_name='tempest-AttachVolumeNegativeTest-server-454382670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-454382670',id=21,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLI/6/yskGDC/kneATQrlM5ySdnkfz5IHk2qD3yn85kz4nSdofboB+BktBB+DBbMhyOy23QhYD/YquSqOPbUt1xakLZAcNyRXoXQD1kQSLURiFJdfuh9KazJ/4uYci+IOg==',key_name='tempest-keypair-427188730',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:42:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3cecbfbfd5f42dbb663367f6fbdf3b0',ramdisk_id='',reservation_id='r-dsoszcjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-249658876',owner_user_name='tempest-AttachVolumeNegativeTest-249658876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:42:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ec47d3cdacb45e5a39509e76b546e34',uuid=4b79f4d7-f34e-4971-8a6f-171c2d71d683,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac9512bb-5122-4a70-b970-f82605ed0606", "address": "fa:16:3e:74:3e:82", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9512bb-51", "ovs_interfaceid": "ac9512bb-5122-4a70-b970-f82605ed0606", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:48:24 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converting VIF {"id": "ac9512bb-5122-4a70-b970-f82605ed0606", "address": "fa:16:3e:74:3e:82", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9512bb-51", "ovs_interfaceid": "ac9512bb-5122-4a70-b970-f82605ed0606", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:48:24 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:3e:82,bridge_name='br-int',has_traffic_filtering=True,id=ac9512bb-5122-4a70-b970-f82605ed0606,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac9512bb-51') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:48:24 user nova-compute[71557]: DEBUG os_vif [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:3e:82,bridge_name='br-int',has_traffic_filtering=True,id=ac9512bb-5122-4a70-b970-f82605ed0606,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac9512bb-51') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:48:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac9512bb-51, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:48:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:48:24 user nova-compute[71557]: INFO os_vif [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:3e:82,bridge_name='br-int',has_traffic_filtering=True,id=ac9512bb-5122-4a70-b970-f82605ed0606,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac9512bb-51')
Apr 12 10:48:24 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Deleting instance files /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683_del
Apr 12 10:48:24 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Deletion of /opt/stack/data/nova/instances/4b79f4d7-f34e-4971-8a6f-171c2d71d683_del complete
Apr 12 10:48:24 user nova-compute[71557]: INFO nova.compute.manager [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 12 10:48:24 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:48:24 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:48:24 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:48:25 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:48:25 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Took 1.07 seconds to deallocate network for instance.
Apr 12 10:48:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-c07e775f-bea2-4cca-bc8b-65b66493f7ca req-fe6d7cb8-deb0-412a-9053-a0b623bebf1d service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Received event network-vif-deleted-ac9512bb-5122-4a70-b970-f82605ed0606 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:48:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:48:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:48:25 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:48:26 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:48:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:48:26 user nova-compute[71557]: DEBUG nova.compute.manager [req-64998ad0-474f-44a4-acb3-126b19509bec req-7eef3025-29b8-45b7-ba2e-9577748e9ad5 service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Received event network-vif-plugged-ac9512bb-5122-4a70-b970-f82605ed0606 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:48:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-64998ad0-474f-44a4-acb3-126b19509bec req-7eef3025-29b8-45b7-ba2e-9577748e9ad5 service nova] Acquiring lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:48:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-64998ad0-474f-44a4-acb3-126b19509bec req-7eef3025-29b8-45b7-ba2e-9577748e9ad5 service nova] Lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:48:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-64998ad0-474f-44a4-acb3-126b19509bec req-7eef3025-29b8-45b7-ba2e-9577748e9ad5 service nova] Lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:48:26 user nova-compute[71557]: DEBUG nova.compute.manager [req-64998ad0-474f-44a4-acb3-126b19509bec req-7eef3025-29b8-45b7-ba2e-9577748e9ad5 service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] No waiting events found dispatching network-vif-plugged-ac9512bb-5122-4a70-b970-f82605ed0606 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:48:26 user nova-compute[71557]: WARNING nova.compute.manager [req-64998ad0-474f-44a4-acb3-126b19509bec req-7eef3025-29b8-45b7-ba2e-9577748e9ad5 service nova] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Received unexpected event network-vif-plugged-ac9512bb-5122-4a70-b970-f82605ed0606 for instance with vm_state deleted and task_state None.
Apr 12 10:48:26 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Deleted allocations for instance 4b79f4d7-f34e-4971-8a6f-171c2d71d683
Apr 12 10:48:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-efd798d5-9b32-4f84-bf4d-3bd18f18aaed tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "4b79f4d7-f34e-4971-8a6f-171c2d71d683" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.557s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:48:27 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:48:27 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:48:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-be3f67e5-420d-42a2-b68a-7cadff22fa48" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:48:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-be3f67e5-420d-42a2-b68a-7cadff22fa48" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:48:27 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:48:27 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Updating instance_info_cache with network_info: [{"id": "943dbed4-3180-4221-b27c-710c0118b7cf", "address": "fa:16:3e:d5:a9:3b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap943dbed4-31", "ovs_interfaceid": "943dbed4-3180-4221-b27c-710c0118b7cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:48:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-be3f67e5-420d-42a2-b68a-7cadff22fa48" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:48:27 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:48:27 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:48:27 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:48:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:48:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:48:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:48:27 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:48:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:48:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:28 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:48:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:29 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296494.4777367, aa5a8d3c-a65a-4a05-9874-ad22b597ddec => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:48:29 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] VM Stopped (Lifecycle Event)
Apr 12 10:48:29 user nova-compute[71557]: DEBUG nova.compute.manager [None req-1fd9b793-dbd9-4648-972b-1387e8c18462 None None] [instance: aa5a8d3c-a65a-4a05-9874-ad22b597ddec] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:48:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:48:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:48:30 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:48:30 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:48:30 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=7928MB free_disk=26.127567291259766GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:48:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:48:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:48:30 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:48:30 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:48:30 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:48:30 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 97bafe22-36bf-4939-baf8-9602551bad52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:48:30 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:48:30 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:48:30 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance d687131b-6853-4d65-b8f7-ecef019ae9f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:48:30 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:48:30 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:48:30 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:48:31 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:48:31 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:48:31 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:48:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.390s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:48:31 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:48:31 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:48:31 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:48:31 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:48:34 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:48:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:48:39 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296504.427498, 4b79f4d7-f34e-4971-8a6f-171c2d71d683 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:48:39 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] VM Stopped (Lifecycle Event)
Apr 12 10:48:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2395dcd9-be8d-41b1-82f7-2e772d0067f3 None None] [instance: 4b79f4d7-f34e-4971-8a6f-171c2d71d683] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:48:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:48:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:45 user nova-compute[71557]: INFO nova.compute.manager [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Rescuing
Apr 12 10:48:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "refresh_cache-7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:48:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquired lock "refresh_cache-7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:48:45 user nova-compute[71557]: DEBUG nova.network.neutron [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:48:45 user nova-compute[71557]: DEBUG nova.network.neutron [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Updating instance_info_cache with network_info: [{"id": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "address": "fa:16:3e:74:b6:77", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ecbe51-c1", "ovs_interfaceid": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:48:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Releasing lock "refresh_cache-7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:48:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-157664c3-32c4-4fe1-89ee-8b95d2b3c206 req-ecde6e0b-ec3d-4a82-bfd4-8e518bc9f0e8 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received event network-vif-unplugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:48:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-157664c3-32c4-4fe1-89ee-8b95d2b3c206 req-ecde6e0b-ec3d-4a82-bfd4-8e518bc9f0e8 service nova] Acquiring lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:48:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-157664c3-32c4-4fe1-89ee-8b95d2b3c206 req-ecde6e0b-ec3d-4a82-bfd4-8e518bc9f0e8 service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:48:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-157664c3-32c4-4fe1-89ee-8b95d2b3c206 req-ecde6e0b-ec3d-4a82-bfd4-8e518bc9f0e8 service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:48:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-157664c3-32c4-4fe1-89ee-8b95d2b3c206 req-ecde6e0b-ec3d-4a82-bfd4-8e518bc9f0e8 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] No waiting events found dispatching network-vif-unplugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:48:46 user nova-compute[71557]: WARNING nova.compute.manager [req-157664c3-32c4-4fe1-89ee-8b95d2b3c206 req-ecde6e0b-ec3d-4a82-bfd4-8e518bc9f0e8 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received unexpected event network-vif-unplugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance with vm_state active and task_state rescuing.
Apr 12 10:48:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:46 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Instance destroyed successfully.
Apr 12 10:48:46 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Attempting a stable device rescue
Apr 12 10:48:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71557) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 10:48:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Instance directory exists: not creating {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 10:48:46 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Creating image(s)
Apr 12 10:48:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:48:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "/opt/stack/data/nova/instances/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:48:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "/opt/stack/data/nova/instances/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:48:46 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:48:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "b13c7cc1e365d8b0ca94340093a07373c0c4470d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:48:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "b13c7cc1e365d8b0ca94340093a07373c0c4470d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:48:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b13c7cc1e365d8b0ca94340093a07373c0c4470d.part --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b13c7cc1e365d8b0ca94340093a07373c0c4470d.part --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:47 user nova-compute[71557]: DEBUG nova.virt.images [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] fa426117-53a4-4a92-ae78-36075528e224 was qcow2, converting to raw {{(pid=71557) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 10:48:47 user nova-compute[71557]: DEBUG nova.privsep.utils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71557) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 10:48:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b13c7cc1e365d8b0ca94340093a07373c0c4470d.part /opt/stack/data/nova/instances/_base/b13c7cc1e365d8b0ca94340093a07373c0c4470d.converted {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b13c7cc1e365d8b0ca94340093a07373c0c4470d.part /opt/stack/data/nova/instances/_base/b13c7cc1e365d8b0ca94340093a07373c0c4470d.converted" returned: 0 in 0.175s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b13c7cc1e365d8b0ca94340093a07373c0c4470d.converted --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b13c7cc1e365d8b0ca94340093a07373c0c4470d.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "b13c7cc1e365d8b0ca94340093a07373c0c4470d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.165s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:48:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "b13c7cc1e365d8b0ca94340093a07373c0c4470d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:48:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "b13c7cc1e365d8b0ca94340093a07373c0c4470d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:48:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b13c7cc1e365d8b0ca94340093a07373c0c4470d --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b13c7cc1e365d8b0ca94340093a07373c0c4470d --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b13c7cc1e365d8b0ca94340093a07373c0c4470d,backing_fmt=raw /opt/stack/data/nova/instances/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa/disk.rescue {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b13c7cc1e365d8b0ca94340093a07373c0c4470d,backing_fmt=raw /opt/stack/data/nova/instances/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa/disk.rescue" returned: 0 in 0.045s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "b13c7cc1e365d8b0ca94340093a07373c0c4470d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'migration_context' on Instance uuid 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Start _get_guest_xml network_info=[{"id": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "address": "fa:16:3e:74:b6:77", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "vif_mac": "fa:16:3e:74:b6:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ecbe51-c1", "ovs_interfaceid": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fa426117-53a4-4a92-ae78-36075528e224', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': '97e4f1d1-d798-42bd-b53e-66a3c837c391', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WsBbchPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '7ba7c401-554c-4610-b8a3-8cf7e62f8cfa', 'attached_at': '', 'detached_at': '', 'volume_id': '54a3fe1e-1437-4c58-8c76-d506fbf77a36', 'serial': '54a3fe1e-1437-4c58-8c76-d506fbf77a36'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'resources' on Instance uuid 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'numa_topology' on Instance uuid 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:48:48 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:48:48 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WsBbchPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:48:48 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:48:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:48:48 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:48:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:48:48 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.compute.manager [req-8d8c9f72-e537-4a8e-80d6-e7332b7fc429 req-dc9463c9-2189-45a5-ad23-9501b2dd6973 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received event network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8d8c9f72-e537-4a8e-80d6-e7332b7fc429 req-dc9463c9-2189-45a5-ad23-9501b2dd6973 service nova] Acquiring lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8d8c9f72-e537-4a8e-80d6-e7332b7fc429 req-dc9463c9-2189-45a5-ad23-9501b2dd6973 service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8d8c9f72-e537-4a8e-80d6-e7332b7fc429 req-dc9463c9-2189-45a5-ad23-9501b2dd6973 service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.compute.manager [req-8d8c9f72-e537-4a8e-80d6-e7332b7fc429 req-dc9463c9-2189-45a5-ad23-9501b2dd6973 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] No waiting events found dispatching network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:48:48 user nova-compute[71557]: WARNING nova.compute.manager [req-8d8c9f72-e537-4a8e-80d6-e7332b7fc429 req-dc9463c9-2189-45a5-ad23-9501b2dd6973 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received unexpected event network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance with vm_state active and task_state rescuing.
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8332fd6e-32f9-4879-a51b-32377ca5248c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = WsBbchPQ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 10:48:48 user nova-compute[71557]: node.name = iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36
Apr 12 10:48:48 user nova-compute[71557]: node.tpgt = -1
Apr 12 10:48:48 user nova-compute[71557]: node.startup = automatic
Apr 12 10:48:48 user nova-compute[71557]: node.leading_login = No
Apr 12 10:48:48 user nova-compute[71557]: iface.iscsi_ifacename = default
Apr 12 10:48:48 user nova-compute[71557]: iface.net_ifacename = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.ipaddress = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.prefix_len = 0
Apr 12 10:48:48 user nova-compute[71557]: iface.hwaddress = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.transport_name = tcp
Apr 12 10:48:48 user nova-compute[71557]: iface.initiatorname = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.state = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.vlan_id = 0
Apr 12 10:48:48 user nova-compute[71557]: iface.vlan_priority = 0
Apr 12 10:48:48 user nova-compute[71557]: iface.vlan_state = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.iface_num = 0
Apr 12 10:48:48 user nova-compute[71557]: iface.mtu = 0
Apr 12 10:48:48 user nova-compute[71557]: iface.port = 0
Apr 12 10:48:48 user nova-compute[71557]: iface.bootproto = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.subnet_mask = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.gateway = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.dhcp_alt_client_id = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.dhcp_dns = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.dhcp_learn_iqn = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.dhcp_vendor_id_state = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.dhcp_vendor_id = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.dhcp_slp_da = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.fragmentation = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.gratuitous_arp = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.incoming_forwarding = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.tos_state = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.tos = 0
Apr 12 10:48:48 user nova-compute[71557]: iface.ttl = 0
Apr 12 10:48:48 user nova-compute[71557]: iface.delayed_ack = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.tcp_nagle = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.tcp_wsf_state = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.tcp_wsf = 0
Apr 12 10:48:48 user nova-compute[71557]: iface.tcp_timer_scale = 0
Apr 12 10:48:48 user nova-compute[71557]: iface.tcp_timestamp = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.redirect = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.def_task_mgmt_timeout = 0
Apr 12 10:48:48 user nova-compute[71557]: iface.header_digest = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.data_digest = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.immediate_data = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.initial_r2t = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.data_seq_inorder = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.data_pdu_inorder = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.erl = 0
Apr 12 10:48:48 user nova-compute[71557]: iface.max_receive_data_len = 0
Apr 12 10:48:48 user nova-compute[71557]: iface.first_burst_len = 0
Apr 12 10:48:48 user nova-compute[71557]: iface.max_outstanding_r2t = 0
Apr 12 10:48:48 user nova-compute[71557]: iface.max_burst_len = 0
Apr 12 10:48:48 user nova-compute[71557]: iface.chap_auth = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.bidi_chap = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.strict_login_compliance = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.discovery_auth = <empty>
Apr 12 10:48:48 user nova-compute[71557]: iface.discovery_logout = <empty>
Apr 12 10:48:48 user nova-compute[71557]: node.discovery_address = <empty>
Apr 12 10:48:48 user nova-compute[71557]: node.discovery_port = 0
Apr 12 10:48:48 user nova-compute[71557]: node.discovery_type = static
Apr 12 10:48:48 user nova-compute[71557]: node.session.initial_cmdsn = 0
Apr 12 10:48:48 user nova-compute[71557]: node.session.initial_login_retry_max = 8
Apr 12 10:48:48 user nova-compute[71557]: node.session.xmit_thread_priority = -20
Apr 12 10:48:48 user nova-compute[71557]: node.session.cmds_max = 128
Apr 12 10:48:48 user nova-compute[71557]: node.session.queue_depth = 32
Apr 12 10:48:48 user nova-compute[71557]: node.session.nr_sessions = 1
Apr 12 10:48:48 user nova-compute[71557]: node.session.auth.authmethod = CHAP
Apr 12 10:48:48 user nova-compute[71557]: node.session.auth.username = WsBbchPQ
Apr 12 10:48:48 user nova-compute[71557]: node.session.auth.password = ***
Apr 12 10:48:48 user nova-compute[71557]: node.session.auth.username_in = <empty>
Apr 12 10:48:48 user nova-compute[71557]: node.session.auth.password_in = <empty>
Apr 12 10:48:48 user nova-compute[71557]: node.session.auth.chap_algs = MD5
Apr 12 10:48:48 user nova-compute[71557]: node.session.timeo.replacement_timeout = 120
Apr 12 10:48:48 user nova-compute[71557]: node.session.err_timeo.abort_timeout = 15
Apr 12 10:48:48 user nova-compute[71557]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 10:48:48 user nova-compute[71557]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 10:48:48 user nova-compute[71557]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 10:48:48 user nova-compute[71557]: node.session.iscsi.FastAbort = Yes
Apr 12 10:48:48 user nova-compute[71557]: node.session.iscsi.InitialR2T = No
Apr 12 10:48:48 user nova-compute[71557]: node.session.iscsi.ImmediateData = Yes
Apr 12 10:48:48 user nova-compute[71557]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 10:48:48 user nova-compute[71557]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 10:48:48 user nova-compute[71557]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 10:48:48 user nova-compute[71557]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 10:48:48 user nova-compute[71557]: node.session.iscsi.MaxConnections = 1
Apr 12 10:48:48 user nova-compute[71557]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 10:48:48 user nova-compute[71557]: node.session.iscsi.ERL = 0
Apr 12 10:48:48 user nova-compute[71557]: node.session.scan = manual
Apr 12 10:48:48 user nova-compute[71557]: node.session.reopen_max = 0
Apr 12 10:48:48 user nova-compute[71557]: node.conn[0].address = 172.16.0.220
Apr 12 10:48:48 user nova-compute[71557]: node.conn[0].port = 3260
Apr 12 10:48:48 user nova-compute[71557]: node.conn[0].startup = manual
Apr 12 10:48:48 user nova-compute[71557]: node.conn[0].tcp.window_size = 524288
Apr 12 10:48:48 user nova-compute[71557]: node.conn[0].tcp.type_of_service = 0
Apr 12 10:48:48 user nova-compute[71557]: node.conn[0].timeo.logout_timeout = 15
Apr 12 10:48:48 user nova-compute[71557]: node.conn[0].timeo.login_timeout = 15
Apr 12 10:48:48 user nova-compute[71557]: node.conn[0].timeo.auth_timeout = 45
Apr 12 10:48:48 user nova-compute[71557]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 10:48:48 user nova-compute[71557]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 10:48:48 user nova-compute[71557]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 10:48:48 user nova-compute[71557]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 10:48:48 user nova-compute[71557]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 10:48:48 user nova-compute[71557]: node.conn[0].iscsi.DataDigest = None
Apr 12 10:48:48 user nova-compute[71557]: node.conn[0].iscsi.IFMarker = No
Apr 12 10:48:48 user nova-compute[71557]: node.conn[0].iscsi.OFMarker = No
Apr 12 10:48:48 user nova-compute[71557]: # END RECORD
Apr 12 10:48:48 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27d1a4d-db94-4290-a7f2-6b36a747bedd]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[725997f6-9f1b-47b0-b1c5-870397319fa4]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WsBbchPQ {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WsBbchPQ" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[881e4123-8302-44d2-92c5-508aeb668bb2]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WsBbchPQ'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b844705e-a08a-4d16-9bd8-7293efaf42bf]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0a4cb0-a93b-41e6-bef4-22e78d73f9e4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:48:48 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:48:48 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:48:48 user nova-compute[71557]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)
Apr 12 10:48:48 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:48:48 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:48:48 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:48:48 user nova-compute[71557]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)
Apr 12 10:48:48 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.136s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] HCTL ('39', '0', '0', 0) found on session 30 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4979a4-65b8-41c2-a89f-a707aa4c65b9]: (4, ('0 0 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Searching for a device in session 30 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WsBbchPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.160s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] <== connect_volume: return (161ms) {'type': 'block', 'scsi_wwn': '23439383130613864', 'path': '/dev/sdh'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439383130613864', 'path': '/dev/sdh'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-432183052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-432183052',id=30,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:47:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3789b59ccc704f86afac83af21fd84f9',ramdisk_id='',reservation_id='r-rqnoyn8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:47:12Z,user_data=None,user_id='ba49b947c74e48f3b161b6f9fce8b1c5',uuid=7ba7c401-554c-4610-b8a3-8cf7e62f8cfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "address": "fa:16:3e:74:b6:77", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "vif_mac": "fa:16:3e:74:b6:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ecbe51-c1", "ovs_interfaceid": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converting VIF {"id": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "address": "fa:16:3e:74:b6:77", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "vif_mac": "fa:16:3e:74:b6:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ecbe51-c1", "ovs_interfaceid": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:b6:77,bridge_name='br-int',has_traffic_filtering=True,id=48ecbe51-c168-45fd-9029-d5cfa270e5c5,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ecbe51-c1') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:48:48 user nova-compute[71557]:   <uuid>7ba7c401-554c-4610-b8a3-8cf7e62f8cfa</uuid>
Apr 12 10:48:48 user nova-compute[71557]:   <name>instance-0000001e</name>
Apr 12 10:48:48 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:48:48 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:48:48 user nova-compute[71557]:   <metadata>
Apr 12 10:48:48 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:48:48 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:48:48 user nova-compute[71557]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-432183052</nova:name>
Apr 12 10:48:48 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:48:48</nova:creationTime>
Apr 12 10:48:48 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:48:48 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:48:48 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:48:48 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:48:48 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:48:48 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:48:48 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:48:48 user nova-compute[71557]:       <nova:owner>
Apr 12 10:48:48 user nova-compute[71557]:         <nova:user uuid="ba49b947c74e48f3b161b6f9fce8b1c5">tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member</nova:user>
Apr 12 10:48:48 user nova-compute[71557]:         <nova:project uuid="3789b59ccc704f86afac83af21fd84f9">tempest-ServerBootFromVolumeStableRescueTest-1826285115</nova:project>
Apr 12 10:48:48 user nova-compute[71557]:       </nova:owner>
Apr 12 10:48:48 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:48:48 user nova-compute[71557]:       <nova:ports>
Apr 12 10:48:48 user nova-compute[71557]:         <nova:port uuid="48ecbe51-c168-45fd-9029-d5cfa270e5c5">
Apr 12 10:48:48 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 10:48:48 user nova-compute[71557]:         </nova:port>
Apr 12 10:48:48 user nova-compute[71557]:       </nova:ports>
Apr 12 10:48:48 user nova-compute[71557]:     </nova:instance>
Apr 12 10:48:48 user nova-compute[71557]:   </metadata>
Apr 12 10:48:48 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:48:48 user nova-compute[71557]:     <system>
Apr 12 10:48:48 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:48:48 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:48:48 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:48:48 user nova-compute[71557]:       <entry name="serial">7ba7c401-554c-4610-b8a3-8cf7e62f8cfa</entry>
Apr 12 10:48:48 user nova-compute[71557]:       <entry name="uuid">7ba7c401-554c-4610-b8a3-8cf7e62f8cfa</entry>
Apr 12 10:48:48 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:48:48 user nova-compute[71557]:     </system>
Apr 12 10:48:48 user nova-compute[71557]:   </sysinfo>
Apr 12 10:48:48 user nova-compute[71557]:   <os>
Apr 12 10:48:48 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:48:48 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:48:48 user nova-compute[71557]:   </os>
Apr 12 10:48:48 user nova-compute[71557]:   <features>
Apr 12 10:48:48 user nova-compute[71557]:     <acpi/>
Apr 12 10:48:48 user nova-compute[71557]:     <apic/>
Apr 12 10:48:48 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:48:48 user nova-compute[71557]:   </features>
Apr 12 10:48:48 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:48:48 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:48:48 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:48:48 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:48:48 user nova-compute[71557]:   </clock>
Apr 12 10:48:48 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:48:48 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:48:48 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:48:48 user nova-compute[71557]:   </cpu>
Apr 12 10:48:48 user nova-compute[71557]:   <devices>
Apr 12 10:48:48 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:48:48 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:48:48 user nova-compute[71557]:       <source dev="/dev/sdh"/>
Apr 12 10:48:48 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:48:48 user nova-compute[71557]:       <serial>54a3fe1e-1437-4c58-8c76-d506fbf77a36</serial>
Apr 12 10:48:48 user nova-compute[71557]:     </disk>
Apr 12 10:48:48 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:48:48 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:48:48 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa/disk.rescue"/>
Apr 12 10:48:48 user nova-compute[71557]:       <target dev="vdb" bus="virtio"/>
Apr 12 10:48:48 user nova-compute[71557]:       <boot order="1"/>
Apr 12 10:48:48 user nova-compute[71557]:     </disk>
Apr 12 10:48:48 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:48:48 user nova-compute[71557]:       <mac address="fa:16:3e:74:b6:77"/>
Apr 12 10:48:48 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:48:48 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:48:48 user nova-compute[71557]:       <target dev="tap48ecbe51-c1"/>
Apr 12 10:48:48 user nova-compute[71557]:     </interface>
Apr 12 10:48:48 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:48:48 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa/console.log" append="off"/>
Apr 12 10:48:48 user nova-compute[71557]:     </serial>
Apr 12 10:48:48 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:48:48 user nova-compute[71557]:     <video>
Apr 12 10:48:48 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:48:48 user nova-compute[71557]:     </video>
Apr 12 10:48:48 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:48:48 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:48:48 user nova-compute[71557]:     </rng>
Apr 12 10:48:48 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:48:48 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:48:48 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:48:48 user nova-compute[71557]:     </memballoon>
Apr 12 10:48:48 user nova-compute[71557]:   </devices>
Apr 12 10:48:48 user nova-compute[71557]: </domain>
Apr 12 10:48:48 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:48:48 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Instance destroyed successfully.
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] No VIF found with MAC fa:16:3e:74:b6:77, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:48:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:50 user nova-compute[71557]: DEBUG nova.compute.manager [req-8e47dabe-bdbd-4a65-b47a-1cc8df86390c req-978ca4b6-babe-46a6-87df-589e3931ed1f service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received event network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:48:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8e47dabe-bdbd-4a65-b47a-1cc8df86390c req-978ca4b6-babe-46a6-87df-589e3931ed1f service nova] Acquiring lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:48:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8e47dabe-bdbd-4a65-b47a-1cc8df86390c req-978ca4b6-babe-46a6-87df-589e3931ed1f service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:48:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8e47dabe-bdbd-4a65-b47a-1cc8df86390c req-978ca4b6-babe-46a6-87df-589e3931ed1f service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:48:50 user nova-compute[71557]: DEBUG nova.compute.manager [req-8e47dabe-bdbd-4a65-b47a-1cc8df86390c req-978ca4b6-babe-46a6-87df-589e3931ed1f service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] No waiting events found dispatching network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:48:50 user nova-compute[71557]: WARNING nova.compute.manager [req-8e47dabe-bdbd-4a65-b47a-1cc8df86390c req-978ca4b6-babe-46a6-87df-589e3931ed1f service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received unexpected event network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance with vm_state active and task_state rescuing.
Apr 12 10:48:50 user nova-compute[71557]: DEBUG nova.compute.manager [req-8e47dabe-bdbd-4a65-b47a-1cc8df86390c req-978ca4b6-babe-46a6-87df-589e3931ed1f service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received event network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:48:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8e47dabe-bdbd-4a65-b47a-1cc8df86390c req-978ca4b6-babe-46a6-87df-589e3931ed1f service nova] Acquiring lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:48:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8e47dabe-bdbd-4a65-b47a-1cc8df86390c req-978ca4b6-babe-46a6-87df-589e3931ed1f service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:48:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8e47dabe-bdbd-4a65-b47a-1cc8df86390c req-978ca4b6-babe-46a6-87df-589e3931ed1f service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:48:50 user nova-compute[71557]: DEBUG nova.compute.manager [req-8e47dabe-bdbd-4a65-b47a-1cc8df86390c req-978ca4b6-babe-46a6-87df-589e3931ed1f service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] No waiting events found dispatching network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:48:50 user nova-compute[71557]: WARNING nova.compute.manager [req-8e47dabe-bdbd-4a65-b47a-1cc8df86390c req-978ca4b6-babe-46a6-87df-589e3931ed1f service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received unexpected event network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance with vm_state active and task_state rescuing.
Apr 12 10:48:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Removed pending event for 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa due to event {{(pid=71557) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 10:48:51 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296531.8796134, 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:48:51 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] VM Resumed (Lifecycle Event)
Apr 12 10:48:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-a07d2bfa-cc93-4428-89f2-a27c354fb23b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:48:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:48:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:48:51 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 10:48:51 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296531.8816814, 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:48:51 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] VM Started (Lifecycle Event)
Apr 12 10:48:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:48:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:48:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:48:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:48:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 10:48:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:48:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:48:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:48:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:48:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:48:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:48:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:48:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:48:59 user nova-compute[71557]: INFO nova.compute.manager [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Terminating instance
Apr 12 10:48:59 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-19455340-1390-4862-84b7-bf58843ba362 req-b0819254-e3aa-4f7c-b00e-cdf6c6dc3cc4 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-vif-unplugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-19455340-1390-4862-84b7-bf58843ba362 req-b0819254-e3aa-4f7c-b00e-cdf6c6dc3cc4 service nova] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-19455340-1390-4862-84b7-bf58843ba362 req-b0819254-e3aa-4f7c-b00e-cdf6c6dc3cc4 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-19455340-1390-4862-84b7-bf58843ba362 req-b0819254-e3aa-4f7c-b00e-cdf6c6dc3cc4 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-19455340-1390-4862-84b7-bf58843ba362 req-b0819254-e3aa-4f7c-b00e-cdf6c6dc3cc4 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] No waiting events found dispatching network-vif-unplugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-19455340-1390-4862-84b7-bf58843ba362 req-b0819254-e3aa-4f7c-b00e-cdf6c6dc3cc4 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-vif-unplugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:00 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Instance destroyed successfully.
Apr 12 10:49:00 user nova-compute[71557]: DEBUG nova.objects.instance [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'resources' on Instance uuid bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T10:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1895953867',display_name='tempest-ServerActionsTestJSON-server-1970085629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1895953867',id=4,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSPzZAK4K6WfKgZv6ul+nJ2Lzppw5IMfK0+f9KuGByC6XjA59WQJmgMTCh01/yWlwW8qMjnx6gjYen9tQKzYmdVo3Z1KGqS/wGYHKKDRVeNNONzm9HfPYp2EDH6xyugDA==',key_name='tempest-keypair-1241183546',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:46:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32235c67d269474b879a58269c1bfb28',ramdisk_id='',reservation_id='r-m0f2y2eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2042231427',owner_user_name='tempest-ServerActionsTestJSON-2042231427-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:46:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0059d31539304ffcb5214b408751cd4f',uuid=bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converting VIF {"id": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "address": "fa:16:3e:fe:65:45", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa1878d2-9c", "ovs_interfaceid": "fa1878d2-9c1a-4fda-bdbf-b226839d56c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG os_vif [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa1878d2-9c, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:49:00 user nova-compute[71557]: INFO os_vif [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:65:45,bridge_name='br-int',has_traffic_filtering=True,id=fa1878d2-9c1a-4fda-bdbf-b226839d56c4,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa1878d2-9c')
Apr 12 10:49:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNTjbEai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:49:00 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:49:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbb9def-9060-4b35-b40d-5d75f38f1fbc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:49:00 user nova-compute[71557]: No targets found.
Apr 12 10:49:00 user nova-compute[71557]: iSNS:
Apr 12 10:49:00 user nova-compute[71557]: No targets found.
Apr 12 10:49:00 user nova-compute[71557]: STATIC:
Apr 12 10:49:00 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:49:00 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:49:00 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:49:00 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226
Apr 12 10:49:00 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:49:00 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:49:00 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36
Apr 12 10:49:00 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:49:00 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:49:00 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61
Apr 12 10:49:00 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:49:00 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:49:00 user nova-compute[71557]: FIRMWARE:
Apr 12 10:49:00 user nova-compute[71557]: No targets found.
Apr 12 10:49:00 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:49:00 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:49:00 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a35fce-fc2f-46d9-bbe0-e254e21a3399]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4460686-a1f9-42ae-9372-6a59af086bcc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:49:00 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:49:00 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:49:00 user nova-compute[71557]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)
Apr 12 10:49:00 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:49:00 user nova-compute[71557]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 (non-flash)
Apr 12 10:49:00 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:49:00 user nova-compute[71557]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)
Apr 12 10:49:00 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd4657ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61'): ({'sdc'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Removing single pathed devices sdc {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82268e1-acad-4863-bbb2-19917d14d395]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d49fe5-4da1-4a09-9c97-73b7e7b659c9]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flushing IO for device /dev/sdc {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc559fce-6f61-4cdc-87c1-d915cef05ea9]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:49:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd4d30d-1870-4282-934c-e678a2b19e8e]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] SCSI volumes sdc have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c534c699-af91-4f64-853e-8a54c35acb7e]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31f129d-7d83-41f1-afa4-16aac3f7d6e6]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260]
Apr 12 10:49:01 user nova-compute[71557]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61, portal: 172.16.0.220,3260] successful.
Apr 12 10:49:01 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e79e7d-5eb0-4960-b9ba-ff1afd54aa61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce0ec9f-692f-4699-937e-d90ee7c9d2f7]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] <== disconnect_volume: return (355ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:49:01 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Deleting instance files /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b_del
Apr 12 10:49:01 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Deletion of /opt/stack/data/nova/instances/bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b_del complete
Apr 12 10:49:01 user nova-compute[71557]: INFO nova.compute.manager [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Took 1.25 seconds to destroy the instance on the hypervisor.
Apr 12 10:49:01 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:01 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:49:01 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Took 0.74 seconds to deallocate network for instance.
Apr 12 10:49:01 user nova-compute[71557]: DEBUG nova.compute.manager [req-7353fc6c-3595-4794-baeb-5361af9b0881 req-9f701759-81bf-4d76-8c82-f4a362c1db36 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-vif-deleted-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:49:02 user nova-compute[71557]: DEBUG nova.compute.manager [req-d73b4d2f-86b8-4d76-ae10-df3ce20ada99 req-491fd0f7-aad6-4ddc-8c86-c8454e078963 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:49:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d73b4d2f-86b8-4d76-ae10-df3ce20ada99 req-491fd0f7-aad6-4ddc-8c86-c8454e078963 service nova] Acquiring lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d73b4d2f-86b8-4d76-ae10-df3ce20ada99 req-491fd0f7-aad6-4ddc-8c86-c8454e078963 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d73b4d2f-86b8-4d76-ae10-df3ce20ada99 req-491fd0f7-aad6-4ddc-8c86-c8454e078963 service nova] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:02 user nova-compute[71557]: DEBUG nova.compute.manager [req-d73b4d2f-86b8-4d76-ae10-df3ce20ada99 req-491fd0f7-aad6-4ddc-8c86-c8454e078963 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] No waiting events found dispatching network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:49:02 user nova-compute[71557]: WARNING nova.compute.manager [req-d73b4d2f-86b8-4d76-ae10-df3ce20ada99 req-491fd0f7-aad6-4ddc-8c86-c8454e078963 service nova] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Received unexpected event network-vif-plugged-fa1878d2-9c1a-4fda-bdbf-b226839d56c4 for instance with vm_state active and task_state deleting.
Apr 12 10:49:02 user nova-compute[71557]: INFO nova.compute.manager [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Took 0.81 seconds to detach 1 volumes for instance.
Apr 12 10:49:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:03 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:49:03 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:49:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:03 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Deleted allocations for instance bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b
Apr 12 10:49:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0b804f24-49fb-4c2e-ba5f-6ddd385f3836 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.276s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "6b99fe06-9139-4475-aa72-2968a59df0bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "6b99fe06-9139-4475-aa72-2968a59df0bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:49:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:49:12 user nova-compute[71557]: INFO nova.compute.claims [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Claim successful on node user
Apr 12 10:49:13 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:49:13 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:49:13 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:49:13 user nova-compute[71557]: INFO nova.virt.block_device [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Booting with volume 87ef4ba7-ac18-4477-a31f-f433c041fda8 at /dev/vda
Apr 12 10:49:13 user nova-compute[71557]: DEBUG nova.policy [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG os_brick.utils [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c08128-69da-431c-af05-b76dc54cbef2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[185ff932-7ce9-4e90-9273-335463f9fdab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c244cf65-124d-41e9-bd23-954da74ec64c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f42fd8-645a-4063-81a4-fcfb33c47e4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:49:13 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:49:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f294e279-6668-41d2-b8cd-f56b3c98e1d8]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG os_brick.utils [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Updating existing volume attachment record: 1378a1ca-8e12-4d15-bc27-7a16b202b947 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Successfully created port: d728429a-36b4-4d31-abe3-ef0cd1154866 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:49:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:14 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Successfully updated port: d728429a-36b4-4d31-abe3-ef0cd1154866 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:49:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "refresh_cache-6b99fe06-9139-4475-aa72-2968a59df0bd" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:49:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquired lock "refresh_cache-6b99fe06-9139-4475-aa72-2968a59df0bd" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:49:14 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:49:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-19aba34c-4a67-4ff0-be4b-8a7cf0973dec req-b792422b-44ae-4e7f-8886-db23991e7568 service nova] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Received event network-changed-d728429a-36b4-4d31-abe3-ef0cd1154866 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:49:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-19aba34c-4a67-4ff0-be4b-8a7cf0973dec req-b792422b-44ae-4e7f-8886-db23991e7568 service nova] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Refreshing instance network info cache due to event network-changed-d728429a-36b4-4d31-abe3-ef0cd1154866. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:49:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-19aba34c-4a67-4ff0-be4b-8a7cf0973dec req-b792422b-44ae-4e7f-8886-db23991e7568 service nova] Acquiring lock "refresh_cache-6b99fe06-9139-4475-aa72-2968a59df0bd" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:49:14 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:49:15 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Updating instance_info_cache with network_info: [{"id": "d728429a-36b4-4d31-abe3-ef0cd1154866", "address": "fa:16:3e:c7:82:3c", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd728429a-36", "ovs_interfaceid": "d728429a-36b4-4d31-abe3-ef0cd1154866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:49:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Releasing lock "refresh_cache-6b99fe06-9139-4475-aa72-2968a59df0bd" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:49:15 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Instance network_info: |[{"id": "d728429a-36b4-4d31-abe3-ef0cd1154866", "address": "fa:16:3e:c7:82:3c", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd728429a-36", "ovs_interfaceid": "d728429a-36b4-4d31-abe3-ef0cd1154866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:49:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-19aba34c-4a67-4ff0-be4b-8a7cf0973dec req-b792422b-44ae-4e7f-8886-db23991e7568 service nova] Acquired lock "refresh_cache-6b99fe06-9139-4475-aa72-2968a59df0bd" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:49:15 user nova-compute[71557]: DEBUG nova.network.neutron [req-19aba34c-4a67-4ff0-be4b-8a7cf0973dec req-b792422b-44ae-4e7f-8886-db23991e7568 service nova] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Refreshing network info cache for port d728429a-36b4-4d31-abe3-ef0cd1154866 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:49:15 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296540.7272782, bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:49:15 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] VM Stopped (Lifecycle Event)
Apr 12 10:49:15 user nova-compute[71557]: DEBUG nova.compute.manager [None req-42bba340-b0fc-4d13-804e-51a069da60a0 None None] [instance: bb4ebc11-ce84-43b1-a3ab-73e12b08ce0b] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:49:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:16 user nova-compute[71557]: DEBUG nova.network.neutron [req-19aba34c-4a67-4ff0-be4b-8a7cf0973dec req-b792422b-44ae-4e7f-8886-db23991e7568 service nova] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Updated VIF entry in instance network info cache for port d728429a-36b4-4d31-abe3-ef0cd1154866. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:49:16 user nova-compute[71557]: DEBUG nova.network.neutron [req-19aba34c-4a67-4ff0-be4b-8a7cf0973dec req-b792422b-44ae-4e7f-8886-db23991e7568 service nova] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Updating instance_info_cache with network_info: [{"id": "d728429a-36b4-4d31-abe3-ef0cd1154866", "address": "fa:16:3e:c7:82:3c", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd728429a-36", "ovs_interfaceid": "d728429a-36b4-4d31-abe3-ef0cd1154866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:49:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-19aba34c-4a67-4ff0-be4b-8a7cf0973dec req-b792422b-44ae-4e7f-8886-db23991e7568 service nova] Releasing lock "refresh_cache-6b99fe06-9139-4475-aa72-2968a59df0bd" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.compute.manager [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:49:17 user nova-compute[71557]: INFO nova.compute.claims [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Claim successful on node user
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.compute.manager [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.compute.manager [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.network.neutron [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:49:17 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.compute.manager [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.compute.manager [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:49:17 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Creating image(s)
Apr 12 10:49:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "/opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "/opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "/opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:49:17 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Creating image(s)
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Did not create local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Ensure instance console log exists: /opt/stack/data/nova/instances/6b99fe06-9139-4475-aa72-2968a59df0bd/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Start _get_guest_xml network_info=[{"id": "d728429a-36b4-4d31-abe3-ef0cd1154866", "address": "fa:16:3e:c7:82:3c", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd728429a-36", "ovs_interfaceid": "d728429a-36b4-4d31-abe3-ef0cd1154866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': '1378a1ca-8e12-4d15-bc27-7a16b202b947', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MUuHKaQB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b99fe06-9139-4475-aa72-2968a59df0bd', 'attached_at': '', 'detached_at': '', 'volume_id': '87ef4ba7-ac18-4477-a31f-f433c041fda8', 'serial': '87ef4ba7-ac18-4477-a31f-f433c041fda8'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.policy [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ec47d3cdacb45e5a39509e76b546e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cecbfbfd5f42dbb663367f6fbdf3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:17 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:49:17 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:49:17 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MUuHKaQB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:49:18 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:49:18 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:49:18 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a3370e-824e-48f9-9691-cadc96bfb533]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:49:18 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[27078627-a9b1-4a86-8c38-abfbc4987464]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8] added
Apr 12 10:49:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.139s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aedce85-e5b7-4e59-bbe1-b04726f49a7d]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8aa45a3-3668-4126-8a2e-43cc33ab183a]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MUuHKaQB {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MUuHKaQB" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a6a10a-f0b2-430d-acda-7f4be2abd55c]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MUuHKaQB'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0f9592-188e-4af1-8b62-d58ac5033b9c]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[656bff44-109c-4063-b8f4-2b8162b304f8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:49:18 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:49:18 user nova-compute[71557]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)
Apr 12 10:49:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:49:18 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:49:18 user nova-compute[71557]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)
Apr 12 10:49:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.139s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/disk 1073741824" returned: 0 in 0.051s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3fee21-29fe-48f2-b9b2-c058bd8e8895]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8, portal: 172.16.0.220,3260]
Apr 12 10:49:18 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8, portal: 172.16.0.220,3260] successful.
Apr 12 10:49:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1985253a-d94d-4e02-8fca-596a7e09342a]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca506f00-22ea-48c6-b983-42707e54ffd0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:49:18 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:49:18 user nova-compute[71557]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)
Apr 12 10:49:18 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:49:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:49:18 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:49:18 user nova-compute[71557]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)
Apr 12 10:49:18 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:49:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e50cda2-75f8-4dee-83c0-54f3def7e497]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MUuHKaQB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.140s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Checking if we can resize image /opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Cannot resize image /opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG nova.objects.instance [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'migration_context' on Instance uuid 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Ensure instance console log exists: /opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG nova.network.neutron [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Successfully created port: a41db5a9-2805-455d-b27e-72e11d4f1012 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:49:18 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26536333035313365', 'path': '/dev/sdc'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536333035313365', 'path': '/dev/sdc'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:49:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-236384963',display_name='tempest-TestVolumeBootPattern-volume-backed-server-236384963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-236384963',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a67f3d23b8f74a9496d445c7fc75717e',ramdisk_id='',reservation_id='r-moek7icn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-638607559',owner_user_name='tempest-TestVolumeBootPattern-638607559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:49:13Z,user_data=None,user_id='b914d7ca786f455baf120f98816abffd',uuid=6b99fe06-9139-4475-aa72-2968a59df0bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d728429a-36b4-4d31-abe3-ef0cd1154866", "address": "fa:16:3e:c7:82:3c", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd728429a-36", "ovs_interfaceid": "d728429a-36b4-4d31-abe3-ef0cd1154866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converting VIF {"id": "d728429a-36b4-4d31-abe3-ef0cd1154866", "address": "fa:16:3e:c7:82:3c", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd728429a-36", "ovs_interfaceid": "d728429a-36b4-4d31-abe3-ef0cd1154866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:82:3c,bridge_name='br-int',has_traffic_filtering=True,id=d728429a-36b4-4d31-abe3-ef0cd1154866,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd728429a-36') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG nova.objects.instance [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b99fe06-9139-4475-aa72-2968a59df0bd {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:49:19 user nova-compute[71557]:   <uuid>6b99fe06-9139-4475-aa72-2968a59df0bd</uuid>
Apr 12 10:49:19 user nova-compute[71557]:   <name>instance-0000001f</name>
Apr 12 10:49:19 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:49:19 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:49:19 user nova-compute[71557]:   <metadata>
Apr 12 10:49:19 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:49:19 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:49:19 user nova-compute[71557]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-236384963</nova:name>
Apr 12 10:49:19 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:49:17</nova:creationTime>
Apr 12 10:49:19 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:49:19 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:49:19 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:49:19 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:49:19 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:49:19 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:49:19 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:49:19 user nova-compute[71557]:       <nova:owner>
Apr 12 10:49:19 user nova-compute[71557]:         <nova:user uuid="b914d7ca786f455baf120f98816abffd">tempest-TestVolumeBootPattern-638607559-project-member</nova:user>
Apr 12 10:49:19 user nova-compute[71557]:         <nova:project uuid="a67f3d23b8f74a9496d445c7fc75717e">tempest-TestVolumeBootPattern-638607559</nova:project>
Apr 12 10:49:19 user nova-compute[71557]:       </nova:owner>
Apr 12 10:49:19 user nova-compute[71557]:       <nova:ports>
Apr 12 10:49:19 user nova-compute[71557]:         <nova:port uuid="d728429a-36b4-4d31-abe3-ef0cd1154866">
Apr 12 10:49:19 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 10:49:19 user nova-compute[71557]:         </nova:port>
Apr 12 10:49:19 user nova-compute[71557]:       </nova:ports>
Apr 12 10:49:19 user nova-compute[71557]:     </nova:instance>
Apr 12 10:49:19 user nova-compute[71557]:   </metadata>
Apr 12 10:49:19 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:49:19 user nova-compute[71557]:     <system>
Apr 12 10:49:19 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:49:19 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:49:19 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:49:19 user nova-compute[71557]:       <entry name="serial">6b99fe06-9139-4475-aa72-2968a59df0bd</entry>
Apr 12 10:49:19 user nova-compute[71557]:       <entry name="uuid">6b99fe06-9139-4475-aa72-2968a59df0bd</entry>
Apr 12 10:49:19 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:49:19 user nova-compute[71557]:     </system>
Apr 12 10:49:19 user nova-compute[71557]:   </sysinfo>
Apr 12 10:49:19 user nova-compute[71557]:   <os>
Apr 12 10:49:19 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:49:19 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:49:19 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:49:19 user nova-compute[71557]:   </os>
Apr 12 10:49:19 user nova-compute[71557]:   <features>
Apr 12 10:49:19 user nova-compute[71557]:     <acpi/>
Apr 12 10:49:19 user nova-compute[71557]:     <apic/>
Apr 12 10:49:19 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:49:19 user nova-compute[71557]:   </features>
Apr 12 10:49:19 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:49:19 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:49:19 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:49:19 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:49:19 user nova-compute[71557]:   </clock>
Apr 12 10:49:19 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:49:19 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:49:19 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:49:19 user nova-compute[71557]:   </cpu>
Apr 12 10:49:19 user nova-compute[71557]:   <devices>
Apr 12 10:49:19 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:49:19 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:49:19 user nova-compute[71557]:       <source dev="/dev/sdc"/>
Apr 12 10:49:19 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:49:19 user nova-compute[71557]:       <serial>87ef4ba7-ac18-4477-a31f-f433c041fda8</serial>
Apr 12 10:49:19 user nova-compute[71557]:     </disk>
Apr 12 10:49:19 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:49:19 user nova-compute[71557]:       <mac address="fa:16:3e:c7:82:3c"/>
Apr 12 10:49:19 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:49:19 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:49:19 user nova-compute[71557]:       <target dev="tapd728429a-36"/>
Apr 12 10:49:19 user nova-compute[71557]:     </interface>
Apr 12 10:49:19 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:49:19 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/6b99fe06-9139-4475-aa72-2968a59df0bd/console.log" append="off"/>
Apr 12 10:49:19 user nova-compute[71557]:     </serial>
Apr 12 10:49:19 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:49:19 user nova-compute[71557]:     <video>
Apr 12 10:49:19 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:49:19 user nova-compute[71557]:     </video>
Apr 12 10:49:19 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:49:19 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:49:19 user nova-compute[71557]:     </rng>
Apr 12 10:49:19 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:49:19 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:49:19 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:49:19 user nova-compute[71557]:     </memballoon>
Apr 12 10:49:19 user nova-compute[71557]:   </devices>
Apr 12 10:49:19 user nova-compute[71557]: </domain>
Apr 12 10:49:19 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:49:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-236384963',display_name='tempest-TestVolumeBootPattern-volume-backed-server-236384963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-236384963',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a67f3d23b8f74a9496d445c7fc75717e',ramdisk_id='',reservation_id='r-moek7icn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-638607559',owner_user_name='tempest-TestVolumeBootPattern-638607559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:49:13Z,user_data=None,user_id='b914d7ca786f455baf120f98816abffd',uuid=6b99fe06-9139-4475-aa72-2968a59df0bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d728429a-36b4-4d31-abe3-ef0cd1154866", "address": "fa:16:3e:c7:82:3c", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd728429a-36", "ovs_interfaceid": "d728429a-36b4-4d31-abe3-ef0cd1154866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converting VIF {"id": "d728429a-36b4-4d31-abe3-ef0cd1154866", "address": "fa:16:3e:c7:82:3c", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd728429a-36", "ovs_interfaceid": "d728429a-36b4-4d31-abe3-ef0cd1154866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:82:3c,bridge_name='br-int',has_traffic_filtering=True,id=d728429a-36b4-4d31-abe3-ef0cd1154866,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd728429a-36') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG os_vif [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:82:3c,bridge_name='br-int',has_traffic_filtering=True,id=d728429a-36b4-4d31-abe3-ef0cd1154866,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd728429a-36') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd728429a-36, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd728429a-36, col_values=(('external_ids', {'iface-id': 'd728429a-36b4-4d31-abe3-ef0cd1154866', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:82:3c', 'vm-uuid': '6b99fe06-9139-4475-aa72-2968a59df0bd'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:19 user nova-compute[71557]: INFO os_vif [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:82:3c,bridge_name='br-int',has_traffic_filtering=True,id=d728429a-36b4-4d31-abe3-ef0cd1154866,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd728429a-36')
Apr 12 10:49:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] No VIF found with MAC fa:16:3e:c7:82:3c, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG nova.network.neutron [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Successfully updated port: a41db5a9-2805-455d-b27e-72e11d4f1012 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "refresh_cache-82ea43d4-f2b9-4665-b1c9-412367e2b4d7" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquired lock "refresh_cache-82ea43d4-f2b9-4665-b1c9-412367e2b4d7" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG nova.network.neutron [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG nova.compute.manager [req-458b8237-2783-443f-8d0f-b975d34de5e2 req-d740d459-cbe8-4d47-8df4-2a78a9e10a5e service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Received event network-changed-a41db5a9-2805-455d-b27e-72e11d4f1012 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG nova.compute.manager [req-458b8237-2783-443f-8d0f-b975d34de5e2 req-d740d459-cbe8-4d47-8df4-2a78a9e10a5e service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Refreshing instance network info cache due to event network-changed-a41db5a9-2805-455d-b27e-72e11d4f1012. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:49:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-458b8237-2783-443f-8d0f-b975d34de5e2 req-d740d459-cbe8-4d47-8df4-2a78a9e10a5e service nova] Acquiring lock "refresh_cache-82ea43d4-f2b9-4665-b1c9-412367e2b4d7" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.network.neutron [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.network.neutron [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Updating instance_info_cache with network_info: [{"id": "a41db5a9-2805-455d-b27e-72e11d4f1012", "address": "fa:16:3e:48:a4:2f", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41db5a9-28", "ovs_interfaceid": "a41db5a9-2805-455d-b27e-72e11d4f1012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Releasing lock "refresh_cache-82ea43d4-f2b9-4665-b1c9-412367e2b4d7" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.compute.manager [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Instance network_info: |[{"id": "a41db5a9-2805-455d-b27e-72e11d4f1012", "address": "fa:16:3e:48:a4:2f", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41db5a9-28", "ovs_interfaceid": "a41db5a9-2805-455d-b27e-72e11d4f1012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-458b8237-2783-443f-8d0f-b975d34de5e2 req-d740d459-cbe8-4d47-8df4-2a78a9e10a5e service nova] Acquired lock "refresh_cache-82ea43d4-f2b9-4665-b1c9-412367e2b4d7" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.network.neutron [req-458b8237-2783-443f-8d0f-b975d34de5e2 req-d740d459-cbe8-4d47-8df4-2a78a9e10a5e service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Refreshing network info cache for port a41db5a9-2805-455d-b27e-72e11d4f1012 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Start _get_guest_xml network_info=[{"id": "a41db5a9-2805-455d-b27e-72e11d4f1012", "address": "fa:16:3e:48:a4:2f", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41db5a9-28", "ovs_interfaceid": "a41db5a9-2805-455d-b27e-72e11d4f1012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:49:20 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:49:20 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1221075217',display_name='tempest-AttachVolumeNegativeTest-server-1221075217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1221075217',id=32,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKipfguSd7dc4NJvRPPLP31VOCFOeuF+i2FQp2cShiAg0zxOf24SVoQFQ6OqdsaipYiEQ740XRMxTEXtPJg+qH5uXiKhPPFP26qGzR66QmlrdD5/yTInH56PsjbJixwOyA==',key_name='tempest-keypair-2069030893',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3cecbfbfd5f42dbb663367f6fbdf3b0',ramdisk_id='',reservation_id='r-d4wcoxo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-249658876',owner_user_name='tempest-AttachVolumeNegativeTest-249658876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:49:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ec47d3cdacb45e5a39509e76b546e34',uuid=82ea43d4-f2b9-4665-b1c9-412367e2b4d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a41db5a9-2805-455d-b27e-72e11d4f1012", "address": "fa:16:3e:48:a4:2f", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41db5a9-28", "ovs_interfaceid": "a41db5a9-2805-455d-b27e-72e11d4f1012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converting VIF {"id": "a41db5a9-2805-455d-b27e-72e11d4f1012", "address": "fa:16:3e:48:a4:2f", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41db5a9-28", "ovs_interfaceid": "a41db5a9-2805-455d-b27e-72e11d4f1012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:a4:2f,bridge_name='br-int',has_traffic_filtering=True,id=a41db5a9-2805-455d-b27e-72e11d4f1012,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa41db5a9-28') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.objects.instance [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'pci_devices' on Instance uuid 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:49:20 user nova-compute[71557]:   <uuid>82ea43d4-f2b9-4665-b1c9-412367e2b4d7</uuid>
Apr 12 10:49:20 user nova-compute[71557]:   <name>instance-00000020</name>
Apr 12 10:49:20 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:49:20 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:49:20 user nova-compute[71557]:   <metadata>
Apr 12 10:49:20 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:49:20 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:49:20 user nova-compute[71557]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1221075217</nova:name>
Apr 12 10:49:20 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:49:20</nova:creationTime>
Apr 12 10:49:20 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:49:20 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:49:20 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:49:20 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:49:20 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:49:20 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:49:20 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:49:20 user nova-compute[71557]:       <nova:owner>
Apr 12 10:49:20 user nova-compute[71557]:         <nova:user uuid="7ec47d3cdacb45e5a39509e76b546e34">tempest-AttachVolumeNegativeTest-249658876-project-member</nova:user>
Apr 12 10:49:20 user nova-compute[71557]:         <nova:project uuid="c3cecbfbfd5f42dbb663367f6fbdf3b0">tempest-AttachVolumeNegativeTest-249658876</nova:project>
Apr 12 10:49:20 user nova-compute[71557]:       </nova:owner>
Apr 12 10:49:20 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:49:20 user nova-compute[71557]:       <nova:ports>
Apr 12 10:49:20 user nova-compute[71557]:         <nova:port uuid="a41db5a9-2805-455d-b27e-72e11d4f1012">
Apr 12 10:49:20 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 10:49:20 user nova-compute[71557]:         </nova:port>
Apr 12 10:49:20 user nova-compute[71557]:       </nova:ports>
Apr 12 10:49:20 user nova-compute[71557]:     </nova:instance>
Apr 12 10:49:20 user nova-compute[71557]:   </metadata>
Apr 12 10:49:20 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:49:20 user nova-compute[71557]:     <system>
Apr 12 10:49:20 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:49:20 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:49:20 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:49:20 user nova-compute[71557]:       <entry name="serial">82ea43d4-f2b9-4665-b1c9-412367e2b4d7</entry>
Apr 12 10:49:20 user nova-compute[71557]:       <entry name="uuid">82ea43d4-f2b9-4665-b1c9-412367e2b4d7</entry>
Apr 12 10:49:20 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:49:20 user nova-compute[71557]:     </system>
Apr 12 10:49:20 user nova-compute[71557]:   </sysinfo>
Apr 12 10:49:20 user nova-compute[71557]:   <os>
Apr 12 10:49:20 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:49:20 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:49:20 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:49:20 user nova-compute[71557]:   </os>
Apr 12 10:49:20 user nova-compute[71557]:   <features>
Apr 12 10:49:20 user nova-compute[71557]:     <acpi/>
Apr 12 10:49:20 user nova-compute[71557]:     <apic/>
Apr 12 10:49:20 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:49:20 user nova-compute[71557]:   </features>
Apr 12 10:49:20 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:49:20 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:49:20 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:49:20 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:49:20 user nova-compute[71557]:   </clock>
Apr 12 10:49:20 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:49:20 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:49:20 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:49:20 user nova-compute[71557]:   </cpu>
Apr 12 10:49:20 user nova-compute[71557]:   <devices>
Apr 12 10:49:20 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:49:20 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:49:20 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/disk"/>
Apr 12 10:49:20 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:49:20 user nova-compute[71557]:     </disk>
Apr 12 10:49:20 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:49:20 user nova-compute[71557]:       <mac address="fa:16:3e:48:a4:2f"/>
Apr 12 10:49:20 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:49:20 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:49:20 user nova-compute[71557]:       <target dev="tapa41db5a9-28"/>
Apr 12 10:49:20 user nova-compute[71557]:     </interface>
Apr 12 10:49:20 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:49:20 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/console.log" append="off"/>
Apr 12 10:49:20 user nova-compute[71557]:     </serial>
Apr 12 10:49:20 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:49:20 user nova-compute[71557]:     <video>
Apr 12 10:49:20 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:49:20 user nova-compute[71557]:     </video>
Apr 12 10:49:20 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:49:20 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:49:20 user nova-compute[71557]:     </rng>
Apr 12 10:49:20 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:49:20 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:49:20 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:49:20 user nova-compute[71557]:     </memballoon>
Apr 12 10:49:20 user nova-compute[71557]:   </devices>
Apr 12 10:49:20 user nova-compute[71557]: </domain>
Apr 12 10:49:20 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1221075217',display_name='tempest-AttachVolumeNegativeTest-server-1221075217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1221075217',id=32,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKipfguSd7dc4NJvRPPLP31VOCFOeuF+i2FQp2cShiAg0zxOf24SVoQFQ6OqdsaipYiEQ740XRMxTEXtPJg+qH5uXiKhPPFP26qGzR66QmlrdD5/yTInH56PsjbJixwOyA==',key_name='tempest-keypair-2069030893',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3cecbfbfd5f42dbb663367f6fbdf3b0',ramdisk_id='',reservation_id='r-d4wcoxo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-249658876',owner_user_name='tempest-AttachVolumeNegativeTest-249658876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:49:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ec47d3cdacb45e5a39509e76b546e34',uuid=82ea43d4-f2b9-4665-b1c9-412367e2b4d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a41db5a9-2805-455d-b27e-72e11d4f1012", "address": "fa:16:3e:48:a4:2f", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41db5a9-28", "ovs_interfaceid": "a41db5a9-2805-455d-b27e-72e11d4f1012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converting VIF {"id": "a41db5a9-2805-455d-b27e-72e11d4f1012", "address": "fa:16:3e:48:a4:2f", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41db5a9-28", "ovs_interfaceid": "a41db5a9-2805-455d-b27e-72e11d4f1012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:a4:2f,bridge_name='br-int',has_traffic_filtering=True,id=a41db5a9-2805-455d-b27e-72e11d4f1012,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa41db5a9-28') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG os_vif [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:a4:2f,bridge_name='br-int',has_traffic_filtering=True,id=a41db5a9-2805-455d-b27e-72e11d4f1012,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa41db5a9-28') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa41db5a9-28, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa41db5a9-28, col_values=(('external_ids', {'iface-id': 'a41db5a9-2805-455d-b27e-72e11d4f1012', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:a4:2f', 'vm-uuid': '82ea43d4-f2b9-4665-b1c9-412367e2b4d7'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:20 user nova-compute[71557]: INFO os_vif [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:a4:2f,bridge_name='br-int',has_traffic_filtering=True,id=a41db5a9-2805-455d-b27e-72e11d4f1012,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa41db5a9-28')
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] No VIF found with MAC fa:16:3e:48:a4:2f, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.network.neutron [req-458b8237-2783-443f-8d0f-b975d34de5e2 req-d740d459-cbe8-4d47-8df4-2a78a9e10a5e service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Updated VIF entry in instance network info cache for port a41db5a9-2805-455d-b27e-72e11d4f1012. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG nova.network.neutron [req-458b8237-2783-443f-8d0f-b975d34de5e2 req-d740d459-cbe8-4d47-8df4-2a78a9e10a5e service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Updating instance_info_cache with network_info: [{"id": "a41db5a9-2805-455d-b27e-72e11d4f1012", "address": "fa:16:3e:48:a4:2f", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41db5a9-28", "ovs_interfaceid": "a41db5a9-2805-455d-b27e-72e11d4f1012", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:49:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-458b8237-2783-443f-8d0f-b975d34de5e2 req-d740d459-cbe8-4d47-8df4-2a78a9e10a5e service nova] Releasing lock "refresh_cache-82ea43d4-f2b9-4665-b1c9-412367e2b4d7" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-ab9e04ee-c0b7-48d1-a7a2-6d326d530b78 req-1093d879-3b07-4a94-bfa5-e1d6b8142a9a service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Received event network-changed-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-ab9e04ee-c0b7-48d1-a7a2-6d326d530b78 req-1093d879-3b07-4a94-bfa5-e1d6b8142a9a service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Refreshing instance network info cache due to event network-changed-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ab9e04ee-c0b7-48d1-a7a2-6d326d530b78 req-1093d879-3b07-4a94-bfa5-e1d6b8142a9a service nova] Acquiring lock "refresh_cache-d687131b-6853-4d65-b8f7-ecef019ae9f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ab9e04ee-c0b7-48d1-a7a2-6d326d530b78 req-1093d879-3b07-4a94-bfa5-e1d6b8142a9a service nova] Acquired lock "refresh_cache-d687131b-6853-4d65-b8f7-ecef019ae9f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG nova.network.neutron [req-ab9e04ee-c0b7-48d1-a7a2-6d326d530b78 req-1093d879-3b07-4a94-bfa5-e1d6b8142a9a service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Refreshing network info cache for port 04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-a5c9ecee-e070-49cb-b21b-80e48d80358e req-8c6daa14-8c8a-488b-8daf-57d116430a04 service nova] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Received event network-vif-plugged-d728429a-36b4-4d31-abe3-ef0cd1154866 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a5c9ecee-e070-49cb-b21b-80e48d80358e req-8c6daa14-8c8a-488b-8daf-57d116430a04 service nova] Acquiring lock "6b99fe06-9139-4475-aa72-2968a59df0bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a5c9ecee-e070-49cb-b21b-80e48d80358e req-8c6daa14-8c8a-488b-8daf-57d116430a04 service nova] Lock "6b99fe06-9139-4475-aa72-2968a59df0bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a5c9ecee-e070-49cb-b21b-80e48d80358e req-8c6daa14-8c8a-488b-8daf-57d116430a04 service nova] Lock "6b99fe06-9139-4475-aa72-2968a59df0bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-a5c9ecee-e070-49cb-b21b-80e48d80358e req-8c6daa14-8c8a-488b-8daf-57d116430a04 service nova] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] No waiting events found dispatching network-vif-plugged-d728429a-36b4-4d31-abe3-ef0cd1154866 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:49:21 user nova-compute[71557]: WARNING nova.compute.manager [req-a5c9ecee-e070-49cb-b21b-80e48d80358e req-8c6daa14-8c8a-488b-8daf-57d116430a04 service nova] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Received unexpected event network-vif-plugged-d728429a-36b4-4d31-abe3-ef0cd1154866 for instance with vm_state building and task_state spawning.
Apr 12 10:49:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "d687131b-6853-4d65-b8f7-ecef019ae9f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:21 user nova-compute[71557]: INFO nova.compute.manager [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Detaching volume 28d188bd-314c-45f4-b762-cb2b3be5b226
Apr 12 10:49:21 user nova-compute[71557]: INFO nova.virt.block_device [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Attempting to driver detach volume 28d188bd-314c-45f4-b762-cb2b3be5b226 from mountpoint /dev/vdb
Apr 12 10:49:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Attempting to detach device vdb from instance d687131b-6853-4d65-b8f7-ecef019ae9f3 from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:49:21 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:49:21 user nova-compute[71557]:   <source dev="/dev/sde"/>
Apr 12 10:49:21 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:49:21 user nova-compute[71557]:   <serial>28d188bd-314c-45f4-b762-cb2b3be5b226</serial>
Apr 12 10:49:21 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 10:49:21 user nova-compute[71557]: </disk>
Apr 12 10:49:21 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:21 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Successfully detached device vdb from instance d687131b-6853-4d65-b8f7-ecef019ae9f3 from the persistent domain config.
Apr 12 10:49:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d687131b-6853-4d65-b8f7-ecef019ae9f3 from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:49:21 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:49:21 user nova-compute[71557]:   <source dev="/dev/sde"/>
Apr 12 10:49:21 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:49:21 user nova-compute[71557]:   <serial>28d188bd-314c-45f4-b762-cb2b3be5b226</serial>
Apr 12 10:49:21 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 10:49:21 user nova-compute[71557]: </disk>
Apr 12 10:49:21 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG nova.network.neutron [req-ab9e04ee-c0b7-48d1-a7a2-6d326d530b78 req-1093d879-3b07-4a94-bfa5-e1d6b8142a9a service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Updated VIF entry in instance network info cache for port 04a9fb9a-518e-4c3c-bf70-d2a7cff04e43. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG nova.network.neutron [req-ab9e04ee-c0b7-48d1-a7a2-6d326d530b78 req-1093d879-3b07-4a94-bfa5-e1d6b8142a9a service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Updating instance_info_cache with network_info: [{"id": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "address": "fa:16:3e:f4:d5:7d", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9fb9a-51", "ovs_interfaceid": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ab9e04ee-c0b7-48d1-a7a2-6d326d530b78 req-1093d879-3b07-4a94-bfa5-e1d6b8142a9a service nova] Releasing lock "refresh_cache-d687131b-6853-4d65-b8f7-ecef019ae9f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-dede1d62-7b8c-4168-94e6-d9b049f544af req-c3aed4e2-0395-4d00-b392-cbc679fc8911 service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Received event network-changed-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-dede1d62-7b8c-4168-94e6-d9b049f544af req-c3aed4e2-0395-4d00-b392-cbc679fc8911 service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Refreshing instance network info cache due to event network-changed-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-dede1d62-7b8c-4168-94e6-d9b049f544af req-c3aed4e2-0395-4d00-b392-cbc679fc8911 service nova] Acquiring lock "refresh_cache-d687131b-6853-4d65-b8f7-ecef019ae9f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-dede1d62-7b8c-4168-94e6-d9b049f544af req-c3aed4e2-0395-4d00-b392-cbc679fc8911 service nova] Acquired lock "refresh_cache-d687131b-6853-4d65-b8f7-ecef019ae9f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG nova.network.neutron [req-dede1d62-7b8c-4168-94e6-d9b049f544af req-c3aed4e2-0395-4d00-b392-cbc679fc8911 service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Refreshing network info cache for port 04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681296561.9805508, d687131b-6853-4d65-b8f7-ecef019ae9f3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 10:49:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d687131b-6853-4d65-b8f7-ecef019ae9f3 {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 10:49:21 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Successfully detached device vdb from instance d687131b-6853-4d65-b8f7-ecef019ae9f3 from the live domain config.
Apr 12 10:49:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMuCsHqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:49:22 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:49:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1e31e3-98bd-4c04-89e2-b5927eb6b320]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:49:22 user nova-compute[71557]: No targets found.
Apr 12 10:49:22 user nova-compute[71557]: iSNS:
Apr 12 10:49:22 user nova-compute[71557]: No targets found.
Apr 12 10:49:22 user nova-compute[71557]: STATIC:
Apr 12 10:49:22 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:49:22 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:49:22 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:49:22 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226
Apr 12 10:49:22 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:49:22 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:49:22 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8
Apr 12 10:49:22 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:49:22 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:49:22 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36
Apr 12 10:49:22 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:49:22 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:49:22 user nova-compute[71557]: FIRMWARE:
Apr 12 10:49:22 user nova-compute[71557]: No targets found.
Apr 12 10:49:22 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:49:22 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:49:22 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[192a7be0-bfbe-44f4-a973-ad9ae588c4d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6d1c4b-2ea3-4900-aa3c-7277f517c95c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:49:22 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:49:22 user nova-compute[71557]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)
Apr 12 10:49:22 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:49:22 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:49:22 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:49:22 user nova-compute[71557]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 (non-flash)
Apr 12 10:49:22 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:49:22 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fe12db250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226'): ({'sde'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Removing single pathed devices sde {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d4c0d7-6ed3-44f7-9669-27dd0ea5f689]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3d7da7-191d-417c-9451-5b27e4f1e5ba]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Flushing IO for device /dev/sde {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3ddca1-6c7c-44fc-a68c-38f098ccae02]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e39e814-ce56-4ea9-9d2f-4e17e8e122d1]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] SCSI volumes sde have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c30ec43-a609-4647-9990-7ebd8e6ca6f5]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a239301-70ce-4e77-a1e7-af12489d8337]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226, portal: 172.16.0.220,3260]
Apr 12 10:49:22 user nova-compute[71557]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226, portal: 172.16.0.220,3260] successful.
Apr 12 10:49:22 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28d188bd-314c-45f4-b762-cb2b3be5b226 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7567491-7b7d-43df-acda-055aed697e4f]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] <== disconnect_volume: return (312ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG nova.network.neutron [req-dede1d62-7b8c-4168-94e6-d9b049f544af req-c3aed4e2-0395-4d00-b392-cbc679fc8911 service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Updated VIF entry in instance network info cache for port 04a9fb9a-518e-4c3c-bf70-d2a7cff04e43. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG nova.network.neutron [req-dede1d62-7b8c-4168-94e6-d9b049f544af req-c3aed4e2-0395-4d00-b392-cbc679fc8911 service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Updating instance_info_cache with network_info: [{"id": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "address": "fa:16:3e:f4:d5:7d", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9fb9a-51", "ovs_interfaceid": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-dede1d62-7b8c-4168-94e6-d9b049f544af req-c3aed4e2-0395-4d00-b392-cbc679fc8911 service nova] Releasing lock "refresh_cache-d687131b-6853-4d65-b8f7-ecef019ae9f3" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-a165ee11-e829-4954-9b2c-2f6af481bf21 req-c5244f4c-ed8b-4795-b552-c7cb45b23f86 service nova] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Received event network-vif-plugged-d728429a-36b4-4d31-abe3-ef0cd1154866 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:49:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a165ee11-e829-4954-9b2c-2f6af481bf21 req-c5244f4c-ed8b-4795-b552-c7cb45b23f86 service nova] Acquiring lock "6b99fe06-9139-4475-aa72-2968a59df0bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a165ee11-e829-4954-9b2c-2f6af481bf21 req-c5244f4c-ed8b-4795-b552-c7cb45b23f86 service nova] Lock "6b99fe06-9139-4475-aa72-2968a59df0bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a165ee11-e829-4954-9b2c-2f6af481bf21 req-c5244f4c-ed8b-4795-b552-c7cb45b23f86 service nova] Lock "6b99fe06-9139-4475-aa72-2968a59df0bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-a165ee11-e829-4954-9b2c-2f6af481bf21 req-c5244f4c-ed8b-4795-b552-c7cb45b23f86 service nova] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] No waiting events found dispatching network-vif-plugged-d728429a-36b4-4d31-abe3-ef0cd1154866 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:49:23 user nova-compute[71557]: WARNING nova.compute.manager [req-a165ee11-e829-4954-9b2c-2f6af481bf21 req-c5244f4c-ed8b-4795-b552-c7cb45b23f86 service nova] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Received unexpected event network-vif-plugged-d728429a-36b4-4d31-abe3-ef0cd1154866 for instance with vm_state building and task_state spawning.
Apr 12 10:49:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-a165ee11-e829-4954-9b2c-2f6af481bf21 req-c5244f4c-ed8b-4795-b552-c7cb45b23f86 service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Received event network-vif-plugged-a41db5a9-2805-455d-b27e-72e11d4f1012 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:49:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a165ee11-e829-4954-9b2c-2f6af481bf21 req-c5244f4c-ed8b-4795-b552-c7cb45b23f86 service nova] Acquiring lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a165ee11-e829-4954-9b2c-2f6af481bf21 req-c5244f4c-ed8b-4795-b552-c7cb45b23f86 service nova] Lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a165ee11-e829-4954-9b2c-2f6af481bf21 req-c5244f4c-ed8b-4795-b552-c7cb45b23f86 service nova] Lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-a165ee11-e829-4954-9b2c-2f6af481bf21 req-c5244f4c-ed8b-4795-b552-c7cb45b23f86 service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] No waiting events found dispatching network-vif-plugged-a41db5a9-2805-455d-b27e-72e11d4f1012 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:49:23 user nova-compute[71557]: WARNING nova.compute.manager [req-a165ee11-e829-4954-9b2c-2f6af481bf21 req-c5244f4c-ed8b-4795-b552-c7cb45b23f86 service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Received unexpected event network-vif-plugged-a41db5a9-2805-455d-b27e-72e11d4f1012 for instance with vm_state building and task_state spawning.
Apr 12 10:49:23 user nova-compute[71557]: DEBUG nova.objects.instance [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lazy-loading 'flavor' on Instance uuid d687131b-6853-4d65-b8f7-ecef019ae9f3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:49:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f6d26d41-b040-43bf-b393-02f6cfee6355 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.950s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:23 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:49:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:49:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:24 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296564.3771565, 6b99fe06-9139-4475-aa72-2968a59df0bd => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:49:24 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] VM Resumed (Lifecycle Event)
Apr 12 10:49:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:49:24 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:49:24 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Instance spawned successfully.
Apr 12 10:49:24 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:49:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:49:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:49:24 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:49:24 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:49:24 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:49:24 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:49:24 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:49:24 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:49:24 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:49:24 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296564.3810043, 6b99fe06-9139-4475-aa72-2968a59df0bd => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:49:24 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] VM Started (Lifecycle Event)
Apr 12 10:49:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:49:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:49:24 user nova-compute[71557]: INFO nova.compute.manager [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Took 6.58 seconds to spawn the instance on the hypervisor.
Apr 12 10:49:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:49:24 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:49:24 user nova-compute[71557]: INFO nova.compute.manager [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Took 11.87 seconds to build instance.
Apr 12 10:49:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4ba5adec-ee21-4bf2-a208-def7d4322210 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "6b99fe06-9139-4475-aa72-2968a59df0bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.949s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:24 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296564.989633, 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:49:24 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] VM Resumed (Lifecycle Event)
Apr 12 10:49:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:49:24 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:49:25 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Instance spawned successfully.
Apr 12 10:49:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:49:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:49:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:49:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:49:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:49:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:49:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:49:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:49:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:49:25 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:49:25 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296564.9911077, 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:49:25 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] VM Started (Lifecycle Event)
Apr 12 10:49:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:49:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:49:25 user nova-compute[71557]: INFO nova.compute.manager [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Took 7.27 seconds to spawn the instance on the hypervisor.
Apr 12 10:49:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:49:25 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:49:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-7098a6c8-eb8e-471e-afa3-13367e9c537d req-93d6b6c3-6615-4fd6-b882-ff4e9d88030e service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Received event network-vif-plugged-a41db5a9-2805-455d-b27e-72e11d4f1012 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:49:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7098a6c8-eb8e-471e-afa3-13367e9c537d req-93d6b6c3-6615-4fd6-b882-ff4e9d88030e service nova] Acquiring lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7098a6c8-eb8e-471e-afa3-13367e9c537d req-93d6b6c3-6615-4fd6-b882-ff4e9d88030e service nova] Lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7098a6c8-eb8e-471e-afa3-13367e9c537d req-93d6b6c3-6615-4fd6-b882-ff4e9d88030e service nova] Lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-7098a6c8-eb8e-471e-afa3-13367e9c537d req-93d6b6c3-6615-4fd6-b882-ff4e9d88030e service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] No waiting events found dispatching network-vif-plugged-a41db5a9-2805-455d-b27e-72e11d4f1012 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:49:25 user nova-compute[71557]: WARNING nova.compute.manager [req-7098a6c8-eb8e-471e-afa3-13367e9c537d req-93d6b6c3-6615-4fd6-b882-ff4e9d88030e service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Received unexpected event network-vif-plugged-a41db5a9-2805-455d-b27e-72e11d4f1012 for instance with vm_state building and task_state spawning.
Apr 12 10:49:25 user nova-compute[71557]: INFO nova.compute.manager [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Took 8.05 seconds to build instance.
Apr 12 10:49:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-41d6d9da-a58a-4647-98d9-906fa75139ba tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.151s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:26 user nova-compute[71557]: INFO nova.compute.manager [None req-9c83c186-fe90-43da-a206-20e79f78f16d tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Unrescuing
Apr 12 10:49:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9c83c186-fe90-43da-a206-20e79f78f16d tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "refresh_cache-be3f67e5-420d-42a2-b68a-7cadff22fa48" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:49:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9c83c186-fe90-43da-a206-20e79f78f16d tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquired lock "refresh_cache-be3f67e5-420d-42a2-b68a-7cadff22fa48" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:49:26 user nova-compute[71557]: DEBUG nova.network.neutron [None req-9c83c186-fe90-43da-a206-20e79f78f16d tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:49:26 user nova-compute[71557]: DEBUG nova.network.neutron [None req-9c83c186-fe90-43da-a206-20e79f78f16d tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Updating instance_info_cache with network_info: [{"id": "943dbed4-3180-4221-b27c-710c0118b7cf", "address": "fa:16:3e:d5:a9:3b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap943dbed4-31", "ovs_interfaceid": "943dbed4-3180-4221-b27c-710c0118b7cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:49:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9c83c186-fe90-43da-a206-20e79f78f16d tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Releasing lock "refresh_cache-be3f67e5-420d-42a2-b68a-7cadff22fa48" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:49:26 user nova-compute[71557]: DEBUG nova.objects.instance [None req-9c83c186-fe90-43da-a206-20e79f78f16d tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'flavor' on Instance uuid be3f67e5-420d-42a2-b68a-7cadff22fa48 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:49:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:27 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:49:27 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:49:27 user nova-compute[71557]: DEBUG nova.compute.manager [req-35364e86-aee0-4445-8b97-2625a1b3944c req-02827fb2-d0d6-4281-b36c-726c6c8ef6bf service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received event network-vif-unplugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:49:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-35364e86-aee0-4445-8b97-2625a1b3944c req-02827fb2-d0d6-4281-b36c-726c6c8ef6bf service nova] Acquiring lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-35364e86-aee0-4445-8b97-2625a1b3944c req-02827fb2-d0d6-4281-b36c-726c6c8ef6bf service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-35364e86-aee0-4445-8b97-2625a1b3944c req-02827fb2-d0d6-4281-b36c-726c6c8ef6bf service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:27 user nova-compute[71557]: DEBUG nova.compute.manager [req-35364e86-aee0-4445-8b97-2625a1b3944c req-02827fb2-d0d6-4281-b36c-726c6c8ef6bf service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] No waiting events found dispatching network-vif-unplugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:49:27 user nova-compute[71557]: WARNING nova.compute.manager [req-35364e86-aee0-4445-8b97-2625a1b3944c req-02827fb2-d0d6-4281-b36c-726c6c8ef6bf service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received unexpected event network-vif-unplugged-943dbed4-3180-4221-b27c-710c0118b7cf for instance with vm_state rescued and task_state unrescuing.
Apr 12 10:49:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:27 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Instance destroyed successfully.
Apr 12 10:49:28 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:49:28 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:49:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-97bafe22-36bf-4939-baf8-9602551bad52" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:49:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-97bafe22-36bf-4939-baf8-9602551bad52" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:49:28 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:49:28 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Updating instance_info_cache with network_info: [{"id": "580ed46e-ff10-494f-b864-42eda726a7ff", "address": "fa:16:3e:a7:62:8b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580ed46e-ff", "ovs_interfaceid": "580ed46e-ff10-494f-b864-42eda726a7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:49:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-97bafe22-36bf-4939-baf8-9602551bad52" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:49:28 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:49:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG nova.compute.manager [req-8d2d412c-0ff2-479b-b1ba-642fb5db4602 req-7ebe8b68-c690-4abe-ae2e-fecf94b5fdc8 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received event network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8d2d412c-0ff2-479b-b1ba-642fb5db4602 req-7ebe8b68-c690-4abe-ae2e-fecf94b5fdc8 service nova] Acquiring lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8d2d412c-0ff2-479b-b1ba-642fb5db4602 req-7ebe8b68-c690-4abe-ae2e-fecf94b5fdc8 service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8d2d412c-0ff2-479b-b1ba-642fb5db4602 req-7ebe8b68-c690-4abe-ae2e-fecf94b5fdc8 service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG nova.compute.manager [req-8d2d412c-0ff2-479b-b1ba-642fb5db4602 req-7ebe8b68-c690-4abe-ae2e-fecf94b5fdc8 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] No waiting events found dispatching network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:49:29 user nova-compute[71557]: WARNING nova.compute.manager [req-8d2d412c-0ff2-479b-b1ba-642fb5db4602 req-7ebe8b68-c690-4abe-ae2e-fecf94b5fdc8 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received unexpected event network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf for instance with vm_state rescued and task_state unrescuing.
Apr 12 10:49:29 user nova-compute[71557]: DEBUG nova.compute.manager [req-8d2d412c-0ff2-479b-b1ba-642fb5db4602 req-7ebe8b68-c690-4abe-ae2e-fecf94b5fdc8 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received event network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8d2d412c-0ff2-479b-b1ba-642fb5db4602 req-7ebe8b68-c690-4abe-ae2e-fecf94b5fdc8 service nova] Acquiring lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8d2d412c-0ff2-479b-b1ba-642fb5db4602 req-7ebe8b68-c690-4abe-ae2e-fecf94b5fdc8 service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8d2d412c-0ff2-479b-b1ba-642fb5db4602 req-7ebe8b68-c690-4abe-ae2e-fecf94b5fdc8 service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG nova.compute.manager [req-8d2d412c-0ff2-479b-b1ba-642fb5db4602 req-7ebe8b68-c690-4abe-ae2e-fecf94b5fdc8 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] No waiting events found dispatching network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:49:29 user nova-compute[71557]: WARNING nova.compute.manager [req-8d2d412c-0ff2-479b-b1ba-642fb5db4602 req-7ebe8b68-c690-4abe-ae2e-fecf94b5fdc8 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received unexpected event network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf for instance with vm_state rescued and task_state unrescuing.
Apr 12 10:49:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:31 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Removed pending event for be3f67e5-420d-42a2-b68a-7cadff22fa48 due to event {{(pid=71557) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 10:49:31 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296571.3559606, be3f67e5-420d-42a2-b68a-7cadff22fa48 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:49:31 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] VM Resumed (Lifecycle Event)
Apr 12 10:49:31 user nova-compute[71557]: DEBUG nova.compute.manager [None req-9c83c186-fe90-43da-a206-20e79f78f16d tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:49:31 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:49:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:31 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:49:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:31 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 10:49:31 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296571.3563628, be3f67e5-420d-42a2-b68a-7cadff22fa48 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:49:31 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] VM Started (Lifecycle Event)
Apr 12 10:49:31 user nova-compute[71557]: DEBUG nova.compute.manager [req-261cce98-5a99-4fa1-a5f1-99828e0edb61 req-b1aabb62-5395-4e3a-9751-7fdd4988bed2 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received event network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:49:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-261cce98-5a99-4fa1-a5f1-99828e0edb61 req-b1aabb62-5395-4e3a-9751-7fdd4988bed2 service nova] Acquiring lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-261cce98-5a99-4fa1-a5f1-99828e0edb61 req-b1aabb62-5395-4e3a-9751-7fdd4988bed2 service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-261cce98-5a99-4fa1-a5f1-99828e0edb61 req-b1aabb62-5395-4e3a-9751-7fdd4988bed2 service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:31 user nova-compute[71557]: DEBUG nova.compute.manager [req-261cce98-5a99-4fa1-a5f1-99828e0edb61 req-b1aabb62-5395-4e3a-9751-7fdd4988bed2 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] No waiting events found dispatching network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:49:31 user nova-compute[71557]: WARNING nova.compute.manager [req-261cce98-5a99-4fa1-a5f1-99828e0edb61 req-b1aabb62-5395-4e3a-9751-7fdd4988bed2 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received unexpected event network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf for instance with vm_state rescued and task_state unrescuing.
Apr 12 10:49:31 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:49:31 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:49:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:49:32 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:49:32 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:49:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=8070MB free_disk=26.065776824951172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:49:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:49:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:49:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:49:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 97bafe22-36bf-4939-baf8-9602551bad52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:49:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:49:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance d687131b-6853-4d65-b8f7-ecef019ae9f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:49:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:49:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 6b99fe06-9139-4475-aa72-2968a59df0bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:49:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:49:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:49:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:49:33 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:49:33 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:49:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:49:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:34 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:49:34 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:49:34 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:49:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:49:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:49 user nova-compute[71557]: INFO nova.compute.manager [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Unshelving
Apr 12 10:49:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:49 user nova-compute[71557]: DEBUG nova.objects.instance [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'pci_requests' on Instance uuid 76758da6-ef8f-433f-b4e8-8d72f01b6b34 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:49:49 user nova-compute[71557]: DEBUG nova.objects.instance [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'numa_topology' on Instance uuid 76758da6-ef8f-433f-b4e8-8d72f01b6b34 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:49:49 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:49:49 user nova-compute[71557]: INFO nova.compute.claims [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Claim successful on node user
Apr 12 10:49:49 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:49:49 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:49:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:49 user nova-compute[71557]: INFO nova.network.neutron [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Updating port 65d96800-cdfa-49fe-a407-05d5b661f452 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 10:49:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "refresh_cache-76758da6-ef8f-433f-b4e8-8d72f01b6b34" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:49:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquired lock "refresh_cache-76758da6-ef8f-433f-b4e8-8d72f01b6b34" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:49:50 user nova-compute[71557]: DEBUG nova.network.neutron [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:49:50 user nova-compute[71557]: DEBUG nova.compute.manager [req-1ec650a8-5097-44ae-a864-578a4ebffebe req-2ed9792b-420f-479e-b9f3-5a8827ea6730 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Received event network-changed-65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:49:50 user nova-compute[71557]: DEBUG nova.compute.manager [req-1ec650a8-5097-44ae-a864-578a4ebffebe req-2ed9792b-420f-479e-b9f3-5a8827ea6730 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Refreshing instance network info cache due to event network-changed-65d96800-cdfa-49fe-a407-05d5b661f452. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:49:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-1ec650a8-5097-44ae-a864-578a4ebffebe req-2ed9792b-420f-479e-b9f3-5a8827ea6730 service nova] Acquiring lock "refresh_cache-76758da6-ef8f-433f-b4e8-8d72f01b6b34" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:49:51 user nova-compute[71557]: DEBUG nova.network.neutron [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Updating instance_info_cache with network_info: [{"id": "65d96800-cdfa-49fe-a407-05d5b661f452", "address": "fa:16:3e:29:b0:94", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d96800-cd", "ovs_interfaceid": "65d96800-cdfa-49fe-a407-05d5b661f452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:49:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Releasing lock "refresh_cache-76758da6-ef8f-433f-b4e8-8d72f01b6b34" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:49:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:49:51 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Creating image(s)
Apr 12 10:49:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "/opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "/opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "/opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:51 user nova-compute[71557]: DEBUG nova.objects.instance [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'trusted_certs' on Instance uuid 76758da6-ef8f-433f-b4e8-8d72f01b6b34 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:49:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-1ec650a8-5097-44ae-a864-578a4ebffebe req-2ed9792b-420f-479e-b9f3-5a8827ea6730 service nova] Acquired lock "refresh_cache-76758da6-ef8f-433f-b4e8-8d72f01b6b34" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:49:51 user nova-compute[71557]: DEBUG nova.network.neutron [req-1ec650a8-5097-44ae-a864-578a4ebffebe req-2ed9792b-420f-479e-b9f3-5a8827ea6730 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Refreshing network info cache for port 65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:49:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "28b8e177cbbada0dea72a5efff7b9b37f49611ee" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "28b8e177cbbada0dea72a5efff7b9b37f49611ee" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:49:52 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28b8e177cbbada0dea72a5efff7b9b37f49611ee.part --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:52 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:49:52 user nova-compute[71557]: INFO nova.compute.claims [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Claim successful on node user
Apr 12 10:49:52 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28b8e177cbbada0dea72a5efff7b9b37f49611ee.part --force-share --output=json" returned: 0 in 0.139s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:52 user nova-compute[71557]: DEBUG nova.virt.images [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] 8575029c-3469-4a97-844b-84ed215601e4 was qcow2, converting to raw {{(pid=71557) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 10:49:52 user nova-compute[71557]: DEBUG nova.privsep.utils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71557) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 10:49:52 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/28b8e177cbbada0dea72a5efff7b9b37f49611ee.part /opt/stack/data/nova/instances/_base/28b8e177cbbada0dea72a5efff7b9b37f49611ee.converted {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/28b8e177cbbada0dea72a5efff7b9b37f49611ee.part /opt/stack/data/nova/instances/_base/28b8e177cbbada0dea72a5efff7b9b37f49611ee.converted" returned: 0 in 0.329s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28b8e177cbbada0dea72a5efff7b9b37f49611ee.converted --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG nova.network.neutron [req-1ec650a8-5097-44ae-a864-578a4ebffebe req-2ed9792b-420f-479e-b9f3-5a8827ea6730 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Updated VIF entry in instance network info cache for port 65d96800-cdfa-49fe-a407-05d5b661f452. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG nova.network.neutron [req-1ec650a8-5097-44ae-a864-578a4ebffebe req-2ed9792b-420f-479e-b9f3-5a8827ea6730 service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Updating instance_info_cache with network_info: [{"id": "65d96800-cdfa-49fe-a407-05d5b661f452", "address": "fa:16:3e:29:b0:94", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d96800-cd", "ovs_interfaceid": "65d96800-cdfa-49fe-a407-05d5b661f452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-1ec650a8-5097-44ae-a864-578a4ebffebe req-2ed9792b-420f-479e-b9f3-5a8827ea6730 service nova] Releasing lock "refresh_cache-76758da6-ef8f-433f-b4e8-8d72f01b6b34" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28b8e177cbbada0dea72a5efff7b9b37f49611ee.converted --force-share --output=json" returned: 0 in 0.140s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "28b8e177cbbada0dea72a5efff7b9b37f49611ee" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.613s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28b8e177cbbada0dea72a5efff7b9b37f49611ee --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.686s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28b8e177cbbada0dea72a5efff7b9b37f49611ee --force-share --output=json" returned: 0 in 0.140s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "28b8e177cbbada0dea72a5efff7b9b37f49611ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "28b8e177cbbada0dea72a5efff7b9b37f49611ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28b8e177cbbada0dea72a5efff7b9b37f49611ee --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG nova.network.neutron [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:49:53 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:49:53 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28b8e177cbbada0dea72a5efff7b9b37f49611ee --force-share --output=json" returned: 0 in 0.143s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28b8e177cbbada0dea72a5efff7b9b37f49611ee,backing_fmt=raw /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG nova.policy [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28b8e177cbbada0dea72a5efff7b9b37f49611ee,backing_fmt=raw /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk 1073741824" returned: 0 in 0.064s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "28b8e177cbbada0dea72a5efff7b9b37f49611ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28b8e177cbbada0dea72a5efff7b9b37f49611ee --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:49:53 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Creating image(s)
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "/opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "/opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "/opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28b8e177cbbada0dea72a5efff7b9b37f49611ee --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG nova.objects.instance [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'migration_context' on Instance uuid 76758da6-ef8f-433f-b4e8-8d72f01b6b34 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:49:53 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Rebasing disk image.
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.142s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c -F raw /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk 1073741824" returned: 0 in 0.051s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:53 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.144s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:54 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:49:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:49:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:54 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Cannot resize image /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:49:54 user nova-compute[71557]: DEBUG nova.objects.instance [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'migration_context' on Instance uuid a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:49:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:49:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Ensure instance console log exists: /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:49:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:54 user nova-compute[71557]: DEBUG nova.network.neutron [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Successfully created port: 59e0f8a4-966b-46f3-921d-be0c6f15f281 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.network.neutron [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Successfully updated port: 59e0f8a4-966b-46f3-921d-be0c6f15f281 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "refresh_cache-a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquired lock "refresh_cache-a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.network.neutron [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.compute.manager [req-9edb00ca-20bb-4f63-86e5-e2dffe1f64db req-f0b4e539-808f-4622-a585-18cc5af6d61f service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Received event network-changed-59e0f8a4-966b-46f3-921d-be0c6f15f281 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.compute.manager [req-9edb00ca-20bb-4f63-86e5-e2dffe1f64db req-f0b4e539-808f-4622-a585-18cc5af6d61f service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Refreshing instance network info cache due to event network-changed-59e0f8a4-966b-46f3-921d-be0c6f15f281. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9edb00ca-20bb-4f63-86e5-e2dffe1f64db req-f0b4e539-808f-4622-a585-18cc5af6d61f service nova] Acquiring lock "refresh_cache-a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.network.neutron [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.network.neutron [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Updating instance_info_cache with network_info: [{"id": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "address": "fa:16:3e:98:5d:7d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e0f8a4-96", "ovs_interfaceid": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Releasing lock "refresh_cache-a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Instance network_info: |[{"id": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "address": "fa:16:3e:98:5d:7d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e0f8a4-96", "ovs_interfaceid": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9edb00ca-20bb-4f63-86e5-e2dffe1f64db req-f0b4e539-808f-4622-a585-18cc5af6d61f service nova] Acquired lock "refresh_cache-a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.network.neutron [req-9edb00ca-20bb-4f63-86e5-e2dffe1f64db req-f0b4e539-808f-4622-a585-18cc5af6d61f service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Refreshing network info cache for port 59e0f8a4-966b-46f3-921d-be0c6f15f281 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Start _get_guest_xml network_info=[{"id": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "address": "fa:16:3e:98:5d:7d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e0f8a4-96", "ovs_interfaceid": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:49:55 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:49:55 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2106762264',display_name='tempest-ServerActionsTestJSON-server-2106762264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2106762264',id=33,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSPzZAK4K6WfKgZv6ul+nJ2Lzppw5IMfK0+f9KuGByC6XjA59WQJmgMTCh01/yWlwW8qMjnx6gjYen9tQKzYmdVo3Z1KGqS/wGYHKKDRVeNNONzm9HfPYp2EDH6xyugDA==',key_name='tempest-keypair-1241183546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32235c67d269474b879a58269c1bfb28',ramdisk_id='',reservation_id='r-7fentnxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2042231427',owner_user_name='tempest-ServerActionsTestJSON-2042231427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:49:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0059d31539304ffcb5214b408751cd4f',uuid=a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "address": "fa:16:3e:98:5d:7d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e0f8a4-96", "ovs_interfaceid": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converting VIF {"id": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "address": "fa:16:3e:98:5d:7d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e0f8a4-96", "ovs_interfaceid": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:5d:7d,bridge_name='br-int',has_traffic_filtering=True,id=59e0f8a4-966b-46f3-921d-be0c6f15f281,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59e0f8a4-96') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.objects.instance [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'pci_devices' on Instance uuid a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:49:55 user nova-compute[71557]:   <uuid>a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23</uuid>
Apr 12 10:49:55 user nova-compute[71557]:   <name>instance-00000021</name>
Apr 12 10:49:55 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:49:55 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:49:55 user nova-compute[71557]:   <metadata>
Apr 12 10:49:55 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:49:55 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:49:55 user nova-compute[71557]:       <nova:name>tempest-ServerActionsTestJSON-server-2106762264</nova:name>
Apr 12 10:49:55 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:49:55</nova:creationTime>
Apr 12 10:49:55 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:49:55 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:49:55 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:49:55 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:49:55 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:49:55 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:49:55 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:49:55 user nova-compute[71557]:       <nova:owner>
Apr 12 10:49:55 user nova-compute[71557]:         <nova:user uuid="0059d31539304ffcb5214b408751cd4f">tempest-ServerActionsTestJSON-2042231427-project-member</nova:user>
Apr 12 10:49:55 user nova-compute[71557]:         <nova:project uuid="32235c67d269474b879a58269c1bfb28">tempest-ServerActionsTestJSON-2042231427</nova:project>
Apr 12 10:49:55 user nova-compute[71557]:       </nova:owner>
Apr 12 10:49:55 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:49:55 user nova-compute[71557]:       <nova:ports>
Apr 12 10:49:55 user nova-compute[71557]:         <nova:port uuid="59e0f8a4-966b-46f3-921d-be0c6f15f281">
Apr 12 10:49:55 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 10:49:55 user nova-compute[71557]:         </nova:port>
Apr 12 10:49:55 user nova-compute[71557]:       </nova:ports>
Apr 12 10:49:55 user nova-compute[71557]:     </nova:instance>
Apr 12 10:49:55 user nova-compute[71557]:   </metadata>
Apr 12 10:49:55 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:49:55 user nova-compute[71557]:     <system>
Apr 12 10:49:55 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:49:55 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:49:55 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:49:55 user nova-compute[71557]:       <entry name="serial">a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23</entry>
Apr 12 10:49:55 user nova-compute[71557]:       <entry name="uuid">a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23</entry>
Apr 12 10:49:55 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:49:55 user nova-compute[71557]:     </system>
Apr 12 10:49:55 user nova-compute[71557]:   </sysinfo>
Apr 12 10:49:55 user nova-compute[71557]:   <os>
Apr 12 10:49:55 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:49:55 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:49:55 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:49:55 user nova-compute[71557]:   </os>
Apr 12 10:49:55 user nova-compute[71557]:   <features>
Apr 12 10:49:55 user nova-compute[71557]:     <acpi/>
Apr 12 10:49:55 user nova-compute[71557]:     <apic/>
Apr 12 10:49:55 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:49:55 user nova-compute[71557]:   </features>
Apr 12 10:49:55 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:49:55 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:49:55 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:49:55 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:49:55 user nova-compute[71557]:   </clock>
Apr 12 10:49:55 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:49:55 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:49:55 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:49:55 user nova-compute[71557]:   </cpu>
Apr 12 10:49:55 user nova-compute[71557]:   <devices>
Apr 12 10:49:55 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:49:55 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:49:55 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk"/>
Apr 12 10:49:55 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:49:55 user nova-compute[71557]:     </disk>
Apr 12 10:49:55 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:49:55 user nova-compute[71557]:       <mac address="fa:16:3e:98:5d:7d"/>
Apr 12 10:49:55 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:49:55 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:49:55 user nova-compute[71557]:       <target dev="tap59e0f8a4-96"/>
Apr 12 10:49:55 user nova-compute[71557]:     </interface>
Apr 12 10:49:55 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:49:55 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/console.log" append="off"/>
Apr 12 10:49:55 user nova-compute[71557]:     </serial>
Apr 12 10:49:55 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:49:55 user nova-compute[71557]:     <video>
Apr 12 10:49:55 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:49:55 user nova-compute[71557]:     </video>
Apr 12 10:49:55 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:49:55 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:49:55 user nova-compute[71557]:     </rng>
Apr 12 10:49:55 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:49:55 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:49:55 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:49:55 user nova-compute[71557]:     </memballoon>
Apr 12 10:49:55 user nova-compute[71557]:   </devices>
Apr 12 10:49:55 user nova-compute[71557]: </domain>
Apr 12 10:49:55 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2106762264',display_name='tempest-ServerActionsTestJSON-server-2106762264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2106762264',id=33,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSPzZAK4K6WfKgZv6ul+nJ2Lzppw5IMfK0+f9KuGByC6XjA59WQJmgMTCh01/yWlwW8qMjnx6gjYen9tQKzYmdVo3Z1KGqS/wGYHKKDRVeNNONzm9HfPYp2EDH6xyugDA==',key_name='tempest-keypair-1241183546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32235c67d269474b879a58269c1bfb28',ramdisk_id='',reservation_id='r-7fentnxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2042231427',owner_user_name='tempest-ServerActionsTestJSON-2042231427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:49:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0059d31539304ffcb5214b408751cd4f',uuid=a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "address": "fa:16:3e:98:5d:7d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e0f8a4-96", "ovs_interfaceid": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converting VIF {"id": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "address": "fa:16:3e:98:5d:7d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e0f8a4-96", "ovs_interfaceid": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:5d:7d,bridge_name='br-int',has_traffic_filtering=True,id=59e0f8a4-966b-46f3-921d-be0c6f15f281,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59e0f8a4-96') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG os_vif [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:5d:7d,bridge_name='br-int',has_traffic_filtering=True,id=59e0f8a4-966b-46f3-921d-be0c6f15f281,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59e0f8a4-96') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59e0f8a4-96, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap59e0f8a4-96, col_values=(('external_ids', {'iface-id': '59e0f8a4-966b-46f3-921d-be0c6f15f281', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:5d:7d', 'vm-uuid': 'a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:55 user nova-compute[71557]: INFO os_vif [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:5d:7d,bridge_name='br-int',has_traffic_filtering=True,id=59e0f8a4-966b-46f3-921d-be0c6f15f281,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59e0f8a4-96')
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] No VIF found with MAC fa:16:3e:98:5d:7d, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c -F raw /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk" returned: 0 in 1.911s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Ensure instance console log exists: /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Start _get_guest_xml network_info=[{"id": "65d96800-cdfa-49fe-a407-05d5b661f452", "address": "fa:16:3e:29:b0:94", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d96800-cd", "ovs_interfaceid": "65d96800-cdfa-49fe-a407-05d5b661f452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='f7309692ad8ddbd1d4ca1482fd6eafb3',container_format='bare',created_at=2023-04-12T10:47:57Z,direct_url=<?>,disk_format='qcow2',id=8575029c-3469-4a97-844b-84ed215601e4,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-637881895-shelved',owner='af33ce0944194932b663c3b8aef9783d',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T10:48:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:49:55 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:49:55 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f7309692ad8ddbd1d4ca1482fd6eafb3',container_format='bare',created_at=2023-04-12T10:47:57Z,direct_url=<?>,disk_format='qcow2',id=8575029c-3469-4a97-844b-84ed215601e4,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-637881895-shelved',owner='af33ce0944194932b663c3b8aef9783d',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T10:48:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.objects.instance [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'vcpu_model' on Instance uuid 76758da6-ef8f-433f-b4e8-8d72f01b6b34 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T10:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-637881895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-637881895',id=28,image_ref='8575029c-3469-4a97-844b-84ed215601e4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-538398767',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:46:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='af33ce0944194932b663c3b8aef9783d',ramdisk_id='',reservation_id='r-g610bp0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-603525697',owner_user_name='tempest-AttachVolumeShelveTestJSON-603525697-project-member',shelved_at='2023-04-12T10:48:00.714395',shelved_host='user',shelved_image_id='8575029c-3469-4a97-844b-84ed215601e4'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:49:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d6279f1ce94008a2898ade6f730b40',uuid=76758da6-ef8f-433f-b4e8-8d72f01b6b34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "65d96800-cdfa-49fe-a407-05d5b661f452", "address": "fa:16:3e:29:b0:94", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d96800-cd", "ovs_interfaceid": "65d96800-cdfa-49fe-a407-05d5b661f452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converting VIF {"id": "65d96800-cdfa-49fe-a407-05d5b661f452", "address": "fa:16:3e:29:b0:94", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d96800-cd", "ovs_interfaceid": "65d96800-cdfa-49fe-a407-05d5b661f452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:b0:94,bridge_name='br-int',has_traffic_filtering=True,id=65d96800-cdfa-49fe-a407-05d5b661f452,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d96800-cd') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.objects.instance [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'pci_devices' on Instance uuid 76758da6-ef8f-433f-b4e8-8d72f01b6b34 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:49:55 user nova-compute[71557]:   <uuid>76758da6-ef8f-433f-b4e8-8d72f01b6b34</uuid>
Apr 12 10:49:55 user nova-compute[71557]:   <name>instance-0000001c</name>
Apr 12 10:49:55 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:49:55 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:49:55 user nova-compute[71557]:   <metadata>
Apr 12 10:49:55 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:49:55 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:49:55 user nova-compute[71557]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-637881895</nova:name>
Apr 12 10:49:55 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:49:55</nova:creationTime>
Apr 12 10:49:55 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:49:55 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:49:55 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:49:55 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:49:55 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:49:55 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:49:55 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:49:55 user nova-compute[71557]:       <nova:owner>
Apr 12 10:49:55 user nova-compute[71557]:         <nova:user uuid="47d6279f1ce94008a2898ade6f730b40">tempest-AttachVolumeShelveTestJSON-603525697-project-member</nova:user>
Apr 12 10:49:55 user nova-compute[71557]:         <nova:project uuid="af33ce0944194932b663c3b8aef9783d">tempest-AttachVolumeShelveTestJSON-603525697</nova:project>
Apr 12 10:49:55 user nova-compute[71557]:       </nova:owner>
Apr 12 10:49:55 user nova-compute[71557]:       <nova:root type="image" uuid="8575029c-3469-4a97-844b-84ed215601e4"/>
Apr 12 10:49:55 user nova-compute[71557]:       <nova:ports>
Apr 12 10:49:55 user nova-compute[71557]:         <nova:port uuid="65d96800-cdfa-49fe-a407-05d5b661f452">
Apr 12 10:49:55 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 10:49:55 user nova-compute[71557]:         </nova:port>
Apr 12 10:49:55 user nova-compute[71557]:       </nova:ports>
Apr 12 10:49:55 user nova-compute[71557]:     </nova:instance>
Apr 12 10:49:55 user nova-compute[71557]:   </metadata>
Apr 12 10:49:55 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:49:55 user nova-compute[71557]:     <system>
Apr 12 10:49:55 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:49:55 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:49:55 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:49:55 user nova-compute[71557]:       <entry name="serial">76758da6-ef8f-433f-b4e8-8d72f01b6b34</entry>
Apr 12 10:49:55 user nova-compute[71557]:       <entry name="uuid">76758da6-ef8f-433f-b4e8-8d72f01b6b34</entry>
Apr 12 10:49:55 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:49:55 user nova-compute[71557]:     </system>
Apr 12 10:49:55 user nova-compute[71557]:   </sysinfo>
Apr 12 10:49:55 user nova-compute[71557]:   <os>
Apr 12 10:49:55 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:49:55 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:49:55 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:49:55 user nova-compute[71557]:   </os>
Apr 12 10:49:55 user nova-compute[71557]:   <features>
Apr 12 10:49:55 user nova-compute[71557]:     <acpi/>
Apr 12 10:49:55 user nova-compute[71557]:     <apic/>
Apr 12 10:49:55 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:49:55 user nova-compute[71557]:   </features>
Apr 12 10:49:55 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:49:55 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:49:55 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:49:55 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:49:55 user nova-compute[71557]:   </clock>
Apr 12 10:49:55 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:49:55 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:49:55 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:49:55 user nova-compute[71557]:   </cpu>
Apr 12 10:49:55 user nova-compute[71557]:   <devices>
Apr 12 10:49:55 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:49:55 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:49:55 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk"/>
Apr 12 10:49:55 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:49:55 user nova-compute[71557]:     </disk>
Apr 12 10:49:55 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:49:55 user nova-compute[71557]:       <mac address="fa:16:3e:29:b0:94"/>
Apr 12 10:49:55 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:49:55 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:49:55 user nova-compute[71557]:       <target dev="tap65d96800-cd"/>
Apr 12 10:49:55 user nova-compute[71557]:     </interface>
Apr 12 10:49:55 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:49:55 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/console.log" append="off"/>
Apr 12 10:49:55 user nova-compute[71557]:     </serial>
Apr 12 10:49:55 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:49:55 user nova-compute[71557]:     <video>
Apr 12 10:49:55 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:49:55 user nova-compute[71557]:     </video>
Apr 12 10:49:55 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:49:55 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:49:55 user nova-compute[71557]:     </rng>
Apr 12 10:49:55 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:49:55 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:49:55 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:49:55 user nova-compute[71557]:     </memballoon>
Apr 12 10:49:55 user nova-compute[71557]:   </devices>
Apr 12 10:49:55 user nova-compute[71557]: </domain>
Apr 12 10:49:55 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T10:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-637881895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-637881895',id=28,image_ref='8575029c-3469-4a97-844b-84ed215601e4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-538398767',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:46:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='af33ce0944194932b663c3b8aef9783d',ramdisk_id='',reservation_id='r-g610bp0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-603525697',owner_user_name='tempest-AttachVolumeShelveTestJSON-603525697-project-member',shelved_at='2023-04-12T10:48:00.714395',shelved_host='user',shelved_image_id='8575029c-3469-4a97-844b-84ed215601e4'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:49:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d6279f1ce94008a2898ade6f730b40',uuid=76758da6-ef8f-433f-b4e8-8d72f01b6b34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "65d96800-cdfa-49fe-a407-05d5b661f452", "address": "fa:16:3e:29:b0:94", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d96800-cd", "ovs_interfaceid": "65d96800-cdfa-49fe-a407-05d5b661f452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converting VIF {"id": "65d96800-cdfa-49fe-a407-05d5b661f452", "address": "fa:16:3e:29:b0:94", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d96800-cd", "ovs_interfaceid": "65d96800-cdfa-49fe-a407-05d5b661f452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:b0:94,bridge_name='br-int',has_traffic_filtering=True,id=65d96800-cdfa-49fe-a407-05d5b661f452,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d96800-cd') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG os_vif [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:b0:94,bridge_name='br-int',has_traffic_filtering=True,id=65d96800-cdfa-49fe-a407-05d5b661f452,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d96800-cd') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65d96800-cd, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap65d96800-cd, col_values=(('external_ids', {'iface-id': '65d96800-cdfa-49fe-a407-05d5b661f452', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:b0:94', 'vm-uuid': '76758da6-ef8f-433f-b4e8-8d72f01b6b34'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:55 user nova-compute[71557]: INFO os_vif [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:b0:94,bridge_name='br-int',has_traffic_filtering=True,id=65d96800-cdfa-49fe-a407-05d5b661f452,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d96800-cd')
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:49:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] No VIF found with MAC fa:16:3e:29:b0:94, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:49:56 user nova-compute[71557]: DEBUG nova.network.neutron [req-9edb00ca-20bb-4f63-86e5-e2dffe1f64db req-f0b4e539-808f-4622-a585-18cc5af6d61f service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Updated VIF entry in instance network info cache for port 59e0f8a4-966b-46f3-921d-be0c6f15f281. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:49:56 user nova-compute[71557]: DEBUG nova.network.neutron [req-9edb00ca-20bb-4f63-86e5-e2dffe1f64db req-f0b4e539-808f-4622-a585-18cc5af6d61f service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Updating instance_info_cache with network_info: [{"id": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "address": "fa:16:3e:98:5d:7d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e0f8a4-96", "ovs_interfaceid": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:49:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9edb00ca-20bb-4f63-86e5-e2dffe1f64db req-f0b4e539-808f-4622-a585-18cc5af6d61f service nova] Releasing lock "refresh_cache-a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:49:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:58 user nova-compute[71557]: DEBUG nova.compute.manager [req-7e829b76-2290-46d4-a58f-14f97a0bb806 req-4fa976cb-b427-4bdb-accd-8b7700f331fb service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Received event network-vif-plugged-65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:49:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7e829b76-2290-46d4-a58f-14f97a0bb806 req-4fa976cb-b427-4bdb-accd-8b7700f331fb service nova] Acquiring lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7e829b76-2290-46d4-a58f-14f97a0bb806 req-4fa976cb-b427-4bdb-accd-8b7700f331fb service nova] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7e829b76-2290-46d4-a58f-14f97a0bb806 req-4fa976cb-b427-4bdb-accd-8b7700f331fb service nova] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:58 user nova-compute[71557]: DEBUG nova.compute.manager [req-7e829b76-2290-46d4-a58f-14f97a0bb806 req-4fa976cb-b427-4bdb-accd-8b7700f331fb service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] No waiting events found dispatching network-vif-plugged-65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:49:58 user nova-compute[71557]: WARNING nova.compute.manager [req-7e829b76-2290-46d4-a58f-14f97a0bb806 req-4fa976cb-b427-4bdb-accd-8b7700f331fb service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Received unexpected event network-vif-plugged-65d96800-cdfa-49fe-a407-05d5b661f452 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 10:49:58 user nova-compute[71557]: DEBUG nova.compute.manager [req-50fae7b5-b948-439c-91ef-aa80d81c2a2c req-a1572dd1-951e-4782-8f5b-d1da79cb059f service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Received event network-vif-plugged-59e0f8a4-966b-46f3-921d-be0c6f15f281 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:49:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-50fae7b5-b948-439c-91ef-aa80d81c2a2c req-a1572dd1-951e-4782-8f5b-d1da79cb059f service nova] Acquiring lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:49:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-50fae7b5-b948-439c-91ef-aa80d81c2a2c req-a1572dd1-951e-4782-8f5b-d1da79cb059f service nova] Lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:49:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-50fae7b5-b948-439c-91ef-aa80d81c2a2c req-a1572dd1-951e-4782-8f5b-d1da79cb059f service nova] Lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:49:58 user nova-compute[71557]: DEBUG nova.compute.manager [req-50fae7b5-b948-439c-91ef-aa80d81c2a2c req-a1572dd1-951e-4782-8f5b-d1da79cb059f service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] No waiting events found dispatching network-vif-plugged-59e0f8a4-966b-46f3-921d-be0c6f15f281 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:49:58 user nova-compute[71557]: WARNING nova.compute.manager [req-50fae7b5-b948-439c-91ef-aa80d81c2a2c req-a1572dd1-951e-4782-8f5b-d1da79cb059f service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Received unexpected event network-vif-plugged-59e0f8a4-966b-46f3-921d-be0c6f15f281 for instance with vm_state building and task_state spawning.
Apr 12 10:49:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:49:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-cd017638-accd-486e-a97e-c21b4da49a3f req-d38c08c3-8c2f-434a-8e5a-c39b397c2efa service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Received event network-vif-plugged-65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:50:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cd017638-accd-486e-a97e-c21b4da49a3f req-d38c08c3-8c2f-434a-8e5a-c39b397c2efa service nova] Acquiring lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:50:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cd017638-accd-486e-a97e-c21b4da49a3f req-d38c08c3-8c2f-434a-8e5a-c39b397c2efa service nova] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:50:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cd017638-accd-486e-a97e-c21b4da49a3f req-d38c08c3-8c2f-434a-8e5a-c39b397c2efa service nova] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:50:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-cd017638-accd-486e-a97e-c21b4da49a3f req-d38c08c3-8c2f-434a-8e5a-c39b397c2efa service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] No waiting events found dispatching network-vif-plugged-65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:50:00 user nova-compute[71557]: WARNING nova.compute.manager [req-cd017638-accd-486e-a97e-c21b4da49a3f req-d38c08c3-8c2f-434a-8e5a-c39b397c2efa service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Received unexpected event network-vif-plugged-65d96800-cdfa-49fe-a407-05d5b661f452 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 10:50:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-9f48afed-4966-4f14-8956-63b10750fd3c req-ca2da6df-0dfb-488c-8f27-fcde93ffcd13 service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Received event network-vif-plugged-59e0f8a4-966b-46f3-921d-be0c6f15f281 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:50:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9f48afed-4966-4f14-8956-63b10750fd3c req-ca2da6df-0dfb-488c-8f27-fcde93ffcd13 service nova] Acquiring lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:50:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9f48afed-4966-4f14-8956-63b10750fd3c req-ca2da6df-0dfb-488c-8f27-fcde93ffcd13 service nova] Lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:50:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9f48afed-4966-4f14-8956-63b10750fd3c req-ca2da6df-0dfb-488c-8f27-fcde93ffcd13 service nova] Lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:50:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-9f48afed-4966-4f14-8956-63b10750fd3c req-ca2da6df-0dfb-488c-8f27-fcde93ffcd13 service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] No waiting events found dispatching network-vif-plugged-59e0f8a4-966b-46f3-921d-be0c6f15f281 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:50:00 user nova-compute[71557]: WARNING nova.compute.manager [req-9f48afed-4966-4f14-8956-63b10750fd3c req-ca2da6df-0dfb-488c-8f27-fcde93ffcd13 service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Received unexpected event network-vif-plugged-59e0f8a4-966b-46f3-921d-be0c6f15f281 for instance with vm_state building and task_state spawning.
Apr 12 10:50:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:00 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296600.944317, 76758da6-ef8f-433f-b4e8-8d72f01b6b34 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:50:00 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] VM Resumed (Lifecycle Event)
Apr 12 10:50:00 user nova-compute[71557]: DEBUG nova.compute.manager [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:50:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:50:00 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Instance spawned successfully.
Apr 12 10:50:00 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:50:00 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:50:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:50:00 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:50:00 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Instance spawned successfully.
Apr 12 10:50:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:50:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:50:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:50:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:50:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:50:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:50:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:50:01 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:50:01 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296600.9474401, 76758da6-ef8f-433f-b4e8-8d72f01b6b34 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:50:01 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] VM Started (Lifecycle Event)
Apr 12 10:50:01 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:50:01 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:50:01 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:50:01 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296600.96294, a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:50:01 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] VM Resumed (Lifecycle Event)
Apr 12 10:50:01 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:50:01 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:50:01 user nova-compute[71557]: INFO nova.compute.manager [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Took 7.49 seconds to spawn the instance on the hypervisor.
Apr 12 10:50:01 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:50:01 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:50:01 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296600.9659383, a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:50:01 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] VM Started (Lifecycle Event)
Apr 12 10:50:01 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:50:01 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:50:01 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:50:01 user nova-compute[71557]: INFO nova.compute.manager [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Took 8.58 seconds to build instance.
Apr 12 10:50:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2e364092-f437-4f9c-8e82-5b840fde1e04 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.573s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:50:01 user nova-compute[71557]: DEBUG nova.compute.manager [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:50:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3e57001b-6272-400b-bdc4-d35f6588972a tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.987s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:50:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "d687131b-6853-4d65-b8f7-ecef019ae9f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:50:15 user nova-compute[71557]: INFO nova.compute.manager [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Terminating instance
Apr 12 10:50:15 user nova-compute[71557]: DEBUG nova.compute.manager [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-865c6b25-b216-479d-a354-671bbc8c1bab req-1ec79450-cff3-4e70-9b99-2befa0ed94ff service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Received event network-vif-unplugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-865c6b25-b216-479d-a354-671bbc8c1bab req-1ec79450-cff3-4e70-9b99-2befa0ed94ff service nova] Acquiring lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-865c6b25-b216-479d-a354-671bbc8c1bab req-1ec79450-cff3-4e70-9b99-2befa0ed94ff service nova] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-865c6b25-b216-479d-a354-671bbc8c1bab req-1ec79450-cff3-4e70-9b99-2befa0ed94ff service nova] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-865c6b25-b216-479d-a354-671bbc8c1bab req-1ec79450-cff3-4e70-9b99-2befa0ed94ff service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] No waiting events found dispatching network-vif-unplugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-865c6b25-b216-479d-a354-671bbc8c1bab req-1ec79450-cff3-4e70-9b99-2befa0ed94ff service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Received event network-vif-unplugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:15 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Instance destroyed successfully.
Apr 12 10:50:15 user nova-compute[71557]: DEBUG nova.objects.instance [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lazy-loading 'resources' on Instance uuid d687131b-6853-4d65-b8f7-ecef019ae9f3 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-158631664',display_name='tempest-TestMinimumBasicScenario-server-158631664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-158631664',id=27,image_ref='5bdef35f-97c6-4c63-9b32-a181693bd012',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2R09lY3z1ofkLd/mex8UHM7qHU7uJkgT1OJi5eN5mVbcu+cTMWeldTRYda5cvD2AEA6DLVvL+HztqfG6Bz3W8LigkJXzJuoHTW2uKsH+Ju0S6/fUn1Cb36RGt8Yf4qPQ==',key_name='tempest-TestMinimumBasicScenario-2015119923',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:45:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b467fac451ee466fb93cec3d3aa3b408',ramdisk_id='',reservation_id='r-93l3f400',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5bdef35f-97c6-4c63-9b32-a181693bd012',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2095634766',owner_user_name='tempest-TestMinimumBasicScenario-2095634766-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:47:37Z,user_data=None,user_id='a633ec4046a9467683cbfd2ebe59600f',uuid=d687131b-6853-4d65-b8f7-ecef019ae9f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "address": "fa:16:3e:f4:d5:7d", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9fb9a-51", "ovs_interfaceid": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Converting VIF {"id": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "address": "fa:16:3e:f4:d5:7d", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9fb9a-51", "ovs_interfaceid": "04a9fb9a-518e-4c3c-bf70-d2a7cff04e43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:d5:7d,bridge_name='br-int',has_traffic_filtering=True,id=04a9fb9a-518e-4c3c-bf70-d2a7cff04e43,network=Network(d284a588-7406-446d-af3c-874a119b7536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04a9fb9a-51') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG os_vif [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:d5:7d,bridge_name='br-int',has_traffic_filtering=True,id=04a9fb9a-518e-4c3c-bf70-d2a7cff04e43,network=Network(d284a588-7406-446d-af3c-874a119b7536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04a9fb9a-51') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04a9fb9a-51, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:50:15 user nova-compute[71557]: INFO os_vif [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:d5:7d,bridge_name='br-int',has_traffic_filtering=True,id=04a9fb9a-518e-4c3c-bf70-d2a7cff04e43,network=Network(d284a588-7406-446d-af3c-874a119b7536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04a9fb9a-51')
Apr 12 10:50:15 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Deleting instance files /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3_del
Apr 12 10:50:15 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Deletion of /opt/stack/data/nova/instances/d687131b-6853-4d65-b8f7-ecef019ae9f3_del complete
Apr 12 10:50:15 user nova-compute[71557]: INFO nova.compute.manager [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 12 10:50:15 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:50:15 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:50:16 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:50:16 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Took 0.45 seconds to deallocate network for instance.
Apr 12 10:50:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-ad45c2e9-2cb5-464c-b6cb-7ba9e495ad99 req-32a267bc-7a61-4623-a383-f3a273483436 service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Received event network-vif-deleted-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:50:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:50:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:50:16 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:50:16 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:50:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:50:16 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Deleted allocations for instance d687131b-6853-4d65-b8f7-ecef019ae9f3
Apr 12 10:50:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e44d0528-4d8e-468f-9f68-d061f71e8764 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.815s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:50:17 user nova-compute[71557]: DEBUG nova.compute.manager [req-17245c46-2b49-424e-b3ea-a7b5c0c89206 req-d568adaa-15b3-4c72-9d09-98dab3f9700b service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Received event network-vif-plugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:50:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-17245c46-2b49-424e-b3ea-a7b5c0c89206 req-d568adaa-15b3-4c72-9d09-98dab3f9700b service nova] Acquiring lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:50:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-17245c46-2b49-424e-b3ea-a7b5c0c89206 req-d568adaa-15b3-4c72-9d09-98dab3f9700b service nova] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:50:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-17245c46-2b49-424e-b3ea-a7b5c0c89206 req-d568adaa-15b3-4c72-9d09-98dab3f9700b service nova] Lock "d687131b-6853-4d65-b8f7-ecef019ae9f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:50:17 user nova-compute[71557]: DEBUG nova.compute.manager [req-17245c46-2b49-424e-b3ea-a7b5c0c89206 req-d568adaa-15b3-4c72-9d09-98dab3f9700b service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] No waiting events found dispatching network-vif-plugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:50:17 user nova-compute[71557]: WARNING nova.compute.manager [req-17245c46-2b49-424e-b3ea-a7b5c0c89206 req-d568adaa-15b3-4c72-9d09-98dab3f9700b service nova] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Received unexpected event network-vif-plugged-04a9fb9a-518e-4c3c-bf70-d2a7cff04e43 for instance with vm_state deleted and task_state None.
Apr 12 10:50:18 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:25 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:50:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:50:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:29 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:50:29 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:50:29 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:50:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:50:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:50:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:50:29 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:50:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:50:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:50:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:50:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:50:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:50:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:50:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:50:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:50:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:50:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:50:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:50:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:50:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:50:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:50:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:50:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:50:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:50:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:50:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:50:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:50:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:50:30 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296615.8718877, d687131b-6853-4d65-b8f7-ecef019ae9f3 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:50:30 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] VM Stopped (Lifecycle Event)
Apr 12 10:50:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0f4f1d0f-aab8-41d3-90d1-f2f00a3aed5d None None] [instance: d687131b-6853-4d65-b8f7-ecef019ae9f3] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:50:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:50:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:50:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:50:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:50:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:50:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:50:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:50:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:50:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:50:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:50:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:50:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:50:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:50:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:50:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:50:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:50:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:50:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:50:32 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:50:32 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:50:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=7727MB free_disk=26.044605255126953GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:50:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:50:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:50:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:50:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:50:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:50:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 97bafe22-36bf-4939-baf8-9602551bad52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:50:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:50:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:50:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 6b99fe06-9139-4475-aa72-2968a59df0bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:50:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:50:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:50:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:50:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:50:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:50:32 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:50:32 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:50:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:50:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:50:34 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:50:34 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:50:34 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Rebuilding the list of instances to heal {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 10:50:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-0f55cab4-8530-4be0-a91d-65671f0dccd9" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:50:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-0f55cab4-8530-4be0-a91d-65671f0dccd9" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:50:34 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:50:34 user nova-compute[71557]: DEBUG nova.objects.instance [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lazy-loading 'info_cache' on Instance uuid 0f55cab4-8530-4be0-a91d-65671f0dccd9 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:50:34 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Updating instance_info_cache with network_info: [{"id": "e1506948-cd44-4d78-a019-853199016229", "address": "fa:16:3e:a5:75:17", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1506948-cd", "ovs_interfaceid": "e1506948-cd44-4d78-a019-853199016229", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:50:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-0f55cab4-8530-4be0-a91d-65671f0dccd9" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:50:34 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:50:34 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:50:34 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:50:34 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:50:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:36 user nova-compute[71557]: INFO nova.compute.manager [None req-1786357b-cb4f-4314-b206-d21377cd3fdd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Unrescuing
Apr 12 10:50:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1786357b-cb4f-4314-b206-d21377cd3fdd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "refresh_cache-7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:50:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1786357b-cb4f-4314-b206-d21377cd3fdd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquired lock "refresh_cache-7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:50:36 user nova-compute[71557]: DEBUG nova.network.neutron [None req-1786357b-cb4f-4314-b206-d21377cd3fdd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:50:36 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:50:36 user nova-compute[71557]: DEBUG nova.network.neutron [None req-1786357b-cb4f-4314-b206-d21377cd3fdd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Updating instance_info_cache with network_info: [{"id": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "address": "fa:16:3e:74:b6:77", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ecbe51-c1", "ovs_interfaceid": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:50:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1786357b-cb4f-4314-b206-d21377cd3fdd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Releasing lock "refresh_cache-7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:50:36 user nova-compute[71557]: DEBUG nova.objects.instance [None req-1786357b-cb4f-4314-b206-d21377cd3fdd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'flavor' on Instance uuid 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:50:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-01e42d6c-29ea-4b43-a042-99d383b20b5e req-f8016e9a-d22f-4146-8679-b701e371e8aa service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received event network-vif-unplugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:50:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-01e42d6c-29ea-4b43-a042-99d383b20b5e req-f8016e9a-d22f-4146-8679-b701e371e8aa service nova] Acquiring lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:50:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-01e42d6c-29ea-4b43-a042-99d383b20b5e req-f8016e9a-d22f-4146-8679-b701e371e8aa service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:50:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-01e42d6c-29ea-4b43-a042-99d383b20b5e req-f8016e9a-d22f-4146-8679-b701e371e8aa service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:50:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-01e42d6c-29ea-4b43-a042-99d383b20b5e req-f8016e9a-d22f-4146-8679-b701e371e8aa service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] No waiting events found dispatching network-vif-unplugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:50:36 user nova-compute[71557]: WARNING nova.compute.manager [req-01e42d6c-29ea-4b43-a042-99d383b20b5e req-f8016e9a-d22f-4146-8679-b701e371e8aa service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received unexpected event network-vif-unplugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance with vm_state rescued and task_state unrescuing.
Apr 12 10:50:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:37 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Instance destroyed successfully.
Apr 12 10:50:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-e6dd7a33-dafe-4dfe-8552-50048e8b3dbd req-497c9d5a-7c40-4161-96fd-7cc56fde180b service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received event network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:50:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e6dd7a33-dafe-4dfe-8552-50048e8b3dbd req-497c9d5a-7c40-4161-96fd-7cc56fde180b service nova] Acquiring lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:50:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e6dd7a33-dafe-4dfe-8552-50048e8b3dbd req-497c9d5a-7c40-4161-96fd-7cc56fde180b service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:50:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e6dd7a33-dafe-4dfe-8552-50048e8b3dbd req-497c9d5a-7c40-4161-96fd-7cc56fde180b service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:50:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-e6dd7a33-dafe-4dfe-8552-50048e8b3dbd req-497c9d5a-7c40-4161-96fd-7cc56fde180b service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] No waiting events found dispatching network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:50:39 user nova-compute[71557]: WARNING nova.compute.manager [req-e6dd7a33-dafe-4dfe-8552-50048e8b3dbd req-497c9d5a-7c40-4161-96fd-7cc56fde180b service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received unexpected event network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance with vm_state rescued and task_state unrescuing.
Apr 12 10:50:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-e6dd7a33-dafe-4dfe-8552-50048e8b3dbd req-497c9d5a-7c40-4161-96fd-7cc56fde180b service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received event network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:50:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e6dd7a33-dafe-4dfe-8552-50048e8b3dbd req-497c9d5a-7c40-4161-96fd-7cc56fde180b service nova] Acquiring lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:50:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e6dd7a33-dafe-4dfe-8552-50048e8b3dbd req-497c9d5a-7c40-4161-96fd-7cc56fde180b service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:50:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e6dd7a33-dafe-4dfe-8552-50048e8b3dbd req-497c9d5a-7c40-4161-96fd-7cc56fde180b service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:50:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-e6dd7a33-dafe-4dfe-8552-50048e8b3dbd req-497c9d5a-7c40-4161-96fd-7cc56fde180b service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] No waiting events found dispatching network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:50:39 user nova-compute[71557]: WARNING nova.compute.manager [req-e6dd7a33-dafe-4dfe-8552-50048e8b3dbd req-497c9d5a-7c40-4161-96fd-7cc56fde180b service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received unexpected event network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance with vm_state rescued and task_state unrescuing.
Apr 12 10:50:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Removed pending event for 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa due to event {{(pid=71557) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 10:50:40 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296640.723953, 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:50:40 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] VM Resumed (Lifecycle Event)
Apr 12 10:50:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-1786357b-cb4f-4314-b206-d21377cd3fdd tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:50:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:50:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:50:40 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 10:50:40 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296640.7249787, 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:50:40 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] VM Started (Lifecycle Event)
Apr 12 10:50:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:50:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:50:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-fb237e29-3d1f-49c9-bdf0-b62fbca5e1c5 req-99d85af1-0d38-4b1b-b3fc-95d1c8020e22 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received event network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:50:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fb237e29-3d1f-49c9-bdf0-b62fbca5e1c5 req-99d85af1-0d38-4b1b-b3fc-95d1c8020e22 service nova] Acquiring lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:50:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fb237e29-3d1f-49c9-bdf0-b62fbca5e1c5 req-99d85af1-0d38-4b1b-b3fc-95d1c8020e22 service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:50:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fb237e29-3d1f-49c9-bdf0-b62fbca5e1c5 req-99d85af1-0d38-4b1b-b3fc-95d1c8020e22 service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:50:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-fb237e29-3d1f-49c9-bdf0-b62fbca5e1c5 req-99d85af1-0d38-4b1b-b3fc-95d1c8020e22 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] No waiting events found dispatching network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:50:41 user nova-compute[71557]: WARNING nova.compute.manager [req-fb237e29-3d1f-49c9-bdf0-b62fbca5e1c5 req-99d85af1-0d38-4b1b-b3fc-95d1c8020e22 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received unexpected event network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance with vm_state active and task_state None.
Apr 12 10:50:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:50:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:06 user nova-compute[71557]: DEBUG nova.compute.manager [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:51:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:51:06 user nova-compute[71557]: INFO nova.compute.claims [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Claim successful on node user
Apr 12 10:51:07 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:51:07 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:51:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:07 user nova-compute[71557]: DEBUG nova.compute.manager [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:51:07 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:51:07 user nova-compute[71557]: DEBUG nova.compute.manager [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:51:07 user nova-compute[71557]: DEBUG nova.network.neutron [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:51:07 user nova-compute[71557]: DEBUG nova.compute.manager [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:51:07 user nova-compute[71557]: INFO nova.virt.block_device [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Booting with volume snapshot 35b42ae4-aa5d-430f-9501-d3d0ce6c5196 at /dev/vda
Apr 12 10:51:07 user nova-compute[71557]: DEBUG nova.policy [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:51:08 user nova-compute[71557]: DEBUG nova.compute.manager [req-c3cce680-33cf-42bc-9105-2d461a99118f req-aa9faa23-affb-4b37-a171-f229590ba985 service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Received event network-changed-a41db5a9-2805-455d-b27e-72e11d4f1012 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:51:08 user nova-compute[71557]: DEBUG nova.compute.manager [req-c3cce680-33cf-42bc-9105-2d461a99118f req-aa9faa23-affb-4b37-a171-f229590ba985 service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Refreshing instance network info cache due to event network-changed-a41db5a9-2805-455d-b27e-72e11d4f1012. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:51:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c3cce680-33cf-42bc-9105-2d461a99118f req-aa9faa23-affb-4b37-a171-f229590ba985 service nova] Acquiring lock "refresh_cache-82ea43d4-f2b9-4665-b1c9-412367e2b4d7" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:51:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c3cce680-33cf-42bc-9105-2d461a99118f req-aa9faa23-affb-4b37-a171-f229590ba985 service nova] Acquired lock "refresh_cache-82ea43d4-f2b9-4665-b1c9-412367e2b4d7" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:51:08 user nova-compute[71557]: DEBUG nova.network.neutron [req-c3cce680-33cf-42bc-9105-2d461a99118f req-aa9faa23-affb-4b37-a171-f229590ba985 service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Refreshing network info cache for port a41db5a9-2805-455d-b27e-72e11d4f1012 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:51:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:08 user nova-compute[71557]: DEBUG nova.network.neutron [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Successfully created port: 2c64da14-81c7-48d5-b272-2e09127f33fd {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:51:08 user nova-compute[71557]: DEBUG nova.network.neutron [req-c3cce680-33cf-42bc-9105-2d461a99118f req-aa9faa23-affb-4b37-a171-f229590ba985 service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Updated VIF entry in instance network info cache for port a41db5a9-2805-455d-b27e-72e11d4f1012. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:51:08 user nova-compute[71557]: DEBUG nova.network.neutron [req-c3cce680-33cf-42bc-9105-2d461a99118f req-aa9faa23-affb-4b37-a171-f229590ba985 service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Updating instance_info_cache with network_info: [{"id": "a41db5a9-2805-455d-b27e-72e11d4f1012", "address": "fa:16:3e:48:a4:2f", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41db5a9-28", "ovs_interfaceid": "a41db5a9-2805-455d-b27e-72e11d4f1012", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:51:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c3cce680-33cf-42bc-9105-2d461a99118f req-aa9faa23-affb-4b37-a171-f229590ba985 service nova] Releasing lock "refresh_cache-82ea43d4-f2b9-4665-b1c9-412367e2b4d7" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:51:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "cdc51c71-9d3b-4957-b912-0666c68b46fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:08 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:51:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:09 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:51:09 user nova-compute[71557]: INFO nova.compute.claims [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Claim successful on node user
Apr 12 10:51:09 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:51:09 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:51:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:09 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:51:09 user nova-compute[71557]: DEBUG nova.network.neutron [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Successfully updated port: 2c64da14-81c7-48d5-b272-2e09127f33fd {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:51:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "refresh_cache-468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:51:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquired lock "refresh_cache-468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:51:09 user nova-compute[71557]: DEBUG nova.network.neutron [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:51:09 user nova-compute[71557]: DEBUG nova.network.neutron [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:51:09 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:51:09 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:51:09 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:51:09 user nova-compute[71557]: DEBUG nova.compute.manager [req-8364c15f-d44e-424d-a79e-d810f8cade0d req-891c1fe3-84de-4eca-9e18-e42e3e1c2633 service nova] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Received event network-changed-2c64da14-81c7-48d5-b272-2e09127f33fd {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:51:09 user nova-compute[71557]: DEBUG nova.compute.manager [req-8364c15f-d44e-424d-a79e-d810f8cade0d req-891c1fe3-84de-4eca-9e18-e42e3e1c2633 service nova] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Refreshing instance network info cache due to event network-changed-2c64da14-81c7-48d5-b272-2e09127f33fd. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:51:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8364c15f-d44e-424d-a79e-d810f8cade0d req-891c1fe3-84de-4eca-9e18-e42e3e1c2633 service nova] Acquiring lock "refresh_cache-468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:51:09 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:51:09 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:51:09 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:51:09 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Creating image(s)
Apr 12 10:51:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "/opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "/opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "/opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "3eb5b7ba2b469313b571bfde5433a23b163e2caa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "3eb5b7ba2b469313b571bfde5433a23b163e2caa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eb5b7ba2b469313b571bfde5433a23b163e2caa.part --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:10 user nova-compute[71557]: DEBUG nova.policy [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a633ec4046a9467683cbfd2ebe59600f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b467fac451ee466fb93cec3d3aa3b408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:51:10 user nova-compute[71557]: DEBUG nova.network.neutron [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Updating instance_info_cache with network_info: [{"id": "2c64da14-81c7-48d5-b272-2e09127f33fd", "address": "fa:16:3e:17:f2:80", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c64da14-81", "ovs_interfaceid": "2c64da14-81c7-48d5-b272-2e09127f33fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:51:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Releasing lock "refresh_cache-468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:51:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Instance network_info: |[{"id": "2c64da14-81c7-48d5-b272-2e09127f33fd", "address": "fa:16:3e:17:f2:80", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c64da14-81", "ovs_interfaceid": "2c64da14-81c7-48d5-b272-2e09127f33fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:51:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8364c15f-d44e-424d-a79e-d810f8cade0d req-891c1fe3-84de-4eca-9e18-e42e3e1c2633 service nova] Acquired lock "refresh_cache-468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:51:10 user nova-compute[71557]: DEBUG nova.network.neutron [req-8364c15f-d44e-424d-a79e-d810f8cade0d req-891c1fe3-84de-4eca-9e18-e42e3e1c2633 service nova] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Refreshing network info cache for port 2c64da14-81c7-48d5-b272-2e09127f33fd {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:51:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eb5b7ba2b469313b571bfde5433a23b163e2caa.part --force-share --output=json" returned: 0 in 0.140s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:10 user nova-compute[71557]: DEBUG nova.virt.images [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 92fcccc4-57d4-4cb0-872e-507fce12c392 was qcow2, converting to raw {{(pid=71557) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 10:51:10 user nova-compute[71557]: DEBUG nova.privsep.utils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71557) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 10:51:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3eb5b7ba2b469313b571bfde5433a23b163e2caa.part /opt/stack/data/nova/instances/_base/3eb5b7ba2b469313b571bfde5433a23b163e2caa.converted {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3eb5b7ba2b469313b571bfde5433a23b163e2caa.part /opt/stack/data/nova/instances/_base/3eb5b7ba2b469313b571bfde5433a23b163e2caa.converted" returned: 0 in 0.277s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eb5b7ba2b469313b571bfde5433a23b163e2caa.converted --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eb5b7ba2b469313b571bfde5433a23b163e2caa.converted --force-share --output=json" returned: 0 in 0.166s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "3eb5b7ba2b469313b571bfde5433a23b163e2caa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.988s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eb5b7ba2b469313b571bfde5433a23b163e2caa --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:10 user nova-compute[71557]: DEBUG nova.objects.instance [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'flavor' on Instance uuid 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eb5b7ba2b469313b571bfde5433a23b163e2caa --force-share --output=json" returned: 0 in 0.173s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "3eb5b7ba2b469313b571bfde5433a23b163e2caa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "3eb5b7ba2b469313b571bfde5433a23b163e2caa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eb5b7ba2b469313b571bfde5433a23b163e2caa --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG nova.network.neutron [req-8364c15f-d44e-424d-a79e-d810f8cade0d req-891c1fe3-84de-4eca-9e18-e42e3e1c2633 service nova] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Updated VIF entry in instance network info cache for port 2c64da14-81c7-48d5-b272-2e09127f33fd. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG nova.network.neutron [req-8364c15f-d44e-424d-a79e-d810f8cade0d req-891c1fe3-84de-4eca-9e18-e42e3e1c2633 service nova] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Updating instance_info_cache with network_info: [{"id": "2c64da14-81c7-48d5-b272-2e09127f33fd", "address": "fa:16:3e:17:f2:80", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c64da14-81", "ovs_interfaceid": "2c64da14-81c7-48d5-b272-2e09127f33fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Successfully created port: 66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8364c15f-d44e-424d-a79e-d810f8cade0d req-891c1fe3-84de-4eca-9e18-e42e3e1c2633 service nova] Releasing lock "refresh_cache-468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eb5b7ba2b469313b571bfde5433a23b163e2caa --force-share --output=json" returned: 0 in 0.140s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eb5b7ba2b469313b571bfde5433a23b163e2caa,backing_fmt=raw /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eb5b7ba2b469313b571bfde5433a23b163e2caa,backing_fmt=raw /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk 1073741824" returned: 0 in 0.053s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "3eb5b7ba2b469313b571bfde5433a23b163e2caa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eb5b7ba2b469313b571bfde5433a23b163e2caa --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:11 user nova-compute[71557]: INFO nova.compute.manager [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Attaching volume 054aa7d1-a508-4c31-8332-900e26be41b0 to /dev/vdb
Apr 12 10:51:11 user nova-compute[71557]: DEBUG os_brick.utils [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bd5031-6ff2-4cea-940b-2572c48404e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eb5b7ba2b469313b571bfde5433a23b163e2caa --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[42175d94-a472-4ad3-b997-eefb1a8ede06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcdcfb3-f2cf-4fe2-9e08-0d244cb93594]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b3c5e1-6443-408c-aafd-b16a490f7fd8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:51:11 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4aee71c-aeeb-4f60-922e-b1182fd7ad34]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG os_brick.utils [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Updating existing volume attachment record: b6653cba-20fb-41c2-9086-20a14bf39d46 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Cannot resize image /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG nova.objects.instance [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lazy-loading 'migration_context' on Instance uuid cdc51c71-9d3b-4957-b912-0666c68b46fc {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Ensure instance console log exists: /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Successfully updated port: 66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "refresh_cache-cdc51c71-9d3b-4957-b912-0666c68b46fc" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquired lock "refresh_cache-cdc51c71-9d3b-4957-b912-0666c68b46fc" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG nova.compute.manager [req-57ac003a-7f42-4594-af05-8c7d435a7573 req-9e394fd6-f035-4324-b3f0-43cd4158130f service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Received event network-changed-66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG nova.compute.manager [req-57ac003a-7f42-4594-af05-8c7d435a7573 req-9e394fd6-f035-4324-b3f0-43cd4158130f service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Refreshing instance network info cache due to event network-changed-66db319f-02d8-4e75-b71a-2b2d136671a9. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:51:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-57ac003a-7f42-4594-af05-8c7d435a7573 req-9e394fd6-f035-4324-b3f0-43cd4158130f service nova] Acquiring lock "refresh_cache-cdc51c71-9d3b-4957-b912-0666c68b46fc" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Updating instance_info_cache with network_info: [{"id": "66db319f-02d8-4e75-b71a-2b2d136671a9", "address": "fa:16:3e:c3:0b:b8", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66db319f-02", "ovs_interfaceid": "66db319f-02d8-4e75-b71a-2b2d136671a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Releasing lock "refresh_cache-cdc51c71-9d3b-4957-b912-0666c68b46fc" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Instance network_info: |[{"id": "66db319f-02d8-4e75-b71a-2b2d136671a9", "address": "fa:16:3e:c3:0b:b8", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66db319f-02", "ovs_interfaceid": "66db319f-02d8-4e75-b71a-2b2d136671a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-57ac003a-7f42-4594-af05-8c7d435a7573 req-9e394fd6-f035-4324-b3f0-43cd4158130f service nova] Acquired lock "refresh_cache-cdc51c71-9d3b-4957-b912-0666c68b46fc" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.network.neutron [req-57ac003a-7f42-4594-af05-8c7d435a7573 req-9e394fd6-f035-4324-b3f0-43cd4158130f service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Refreshing network info cache for port 66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Start _get_guest_xml network_info=[{"id": "66db319f-02d8-4e75-b71a-2b2d136671a9", "address": "fa:16:3e:c3:0b:b8", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66db319f-02", "ovs_interfaceid": "66db319f-02d8-4e75-b71a-2b2d136671a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:51:06Z,direct_url=<?>,disk_format='qcow2',id=92fcccc4-57d4-4cb0-872e-507fce12c392,min_disk=0,min_ram=0,name='tempest-scenario-img--772076998',owner='b467fac451ee466fb93cec3d3aa3b408',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:51:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '92fcccc4-57d4-4cb0-872e-507fce12c392'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:51:12 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:51:12 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:51:06Z,direct_url=<?>,disk_format='qcow2',id=92fcccc4-57d4-4cb0-872e-507fce12c392,min_disk=0,min_ram=0,name='tempest-scenario-img--772076998',owner='b467fac451ee466fb93cec3d3aa3b408',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:51:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:51:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1484132394',display_name='tempest-TestMinimumBasicScenario-server-1484132394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1484132394',id=35,image_ref='92fcccc4-57d4-4cb0-872e-507fce12c392',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0xYo/U9olcXUxWVNjyonA9aJ0xsZ/BfTVAGlL1ocRIDzPvg0PLVDDRxGGzI3LZdJJOo5Z6xxzKLkV/HZdcy8X23bxA81QZoa7yGQZyd2sGv0R6G4fpT0+Ec3zh6AfZuQ==',key_name='tempest-TestMinimumBasicScenario-2078556363',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b467fac451ee466fb93cec3d3aa3b408',ramdisk_id='',reservation_id='r-wzir7w0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='92fcccc4-57d4-4cb0-872e-507fce12c392',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2095634766',owner_user_name='tempest-TestMinimumBasicScenario-2095634766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:51:10Z,user_data=None,user_id='a633ec4046a9467683cbfd2ebe59600f',uuid=cdc51c71-9d3b-4957-b912-0666c68b46fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66db319f-02d8-4e75-b71a-2b2d136671a9", "address": "fa:16:3e:c3:0b:b8", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66db319f-02", "ovs_interfaceid": "66db319f-02d8-4e75-b71a-2b2d136671a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Converting VIF {"id": "66db319f-02d8-4e75-b71a-2b2d136671a9", "address": "fa:16:3e:c3:0b:b8", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66db319f-02", "ovs_interfaceid": "66db319f-02d8-4e75-b71a-2b2d136671a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:0b:b8,bridge_name='br-int',has_traffic_filtering=True,id=66db319f-02d8-4e75-b71a-2b2d136671a9,network=Network(d284a588-7406-446d-af3c-874a119b7536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66db319f-02') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.objects.instance [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lazy-loading 'pci_devices' on Instance uuid cdc51c71-9d3b-4957-b912-0666c68b46fc {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:51:12 user nova-compute[71557]:   <uuid>cdc51c71-9d3b-4957-b912-0666c68b46fc</uuid>
Apr 12 10:51:12 user nova-compute[71557]:   <name>instance-00000023</name>
Apr 12 10:51:12 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:51:12 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:51:12 user nova-compute[71557]:   <metadata>
Apr 12 10:51:12 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:51:12 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:51:12 user nova-compute[71557]:       <nova:name>tempest-TestMinimumBasicScenario-server-1484132394</nova:name>
Apr 12 10:51:12 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:51:12</nova:creationTime>
Apr 12 10:51:12 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:51:12 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:51:12 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:51:12 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:51:12 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:51:12 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:51:12 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:51:12 user nova-compute[71557]:       <nova:owner>
Apr 12 10:51:12 user nova-compute[71557]:         <nova:user uuid="a633ec4046a9467683cbfd2ebe59600f">tempest-TestMinimumBasicScenario-2095634766-project-member</nova:user>
Apr 12 10:51:12 user nova-compute[71557]:         <nova:project uuid="b467fac451ee466fb93cec3d3aa3b408">tempest-TestMinimumBasicScenario-2095634766</nova:project>
Apr 12 10:51:12 user nova-compute[71557]:       </nova:owner>
Apr 12 10:51:12 user nova-compute[71557]:       <nova:root type="image" uuid="92fcccc4-57d4-4cb0-872e-507fce12c392"/>
Apr 12 10:51:12 user nova-compute[71557]:       <nova:ports>
Apr 12 10:51:12 user nova-compute[71557]:         <nova:port uuid="66db319f-02d8-4e75-b71a-2b2d136671a9">
Apr 12 10:51:12 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 10:51:12 user nova-compute[71557]:         </nova:port>
Apr 12 10:51:12 user nova-compute[71557]:       </nova:ports>
Apr 12 10:51:12 user nova-compute[71557]:     </nova:instance>
Apr 12 10:51:12 user nova-compute[71557]:   </metadata>
Apr 12 10:51:12 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:51:12 user nova-compute[71557]:     <system>
Apr 12 10:51:12 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:51:12 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:51:12 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:51:12 user nova-compute[71557]:       <entry name="serial">cdc51c71-9d3b-4957-b912-0666c68b46fc</entry>
Apr 12 10:51:12 user nova-compute[71557]:       <entry name="uuid">cdc51c71-9d3b-4957-b912-0666c68b46fc</entry>
Apr 12 10:51:12 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:51:12 user nova-compute[71557]:     </system>
Apr 12 10:51:12 user nova-compute[71557]:   </sysinfo>
Apr 12 10:51:12 user nova-compute[71557]:   <os>
Apr 12 10:51:12 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:51:12 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:51:12 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:51:12 user nova-compute[71557]:   </os>
Apr 12 10:51:12 user nova-compute[71557]:   <features>
Apr 12 10:51:12 user nova-compute[71557]:     <acpi/>
Apr 12 10:51:12 user nova-compute[71557]:     <apic/>
Apr 12 10:51:12 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:51:12 user nova-compute[71557]:   </features>
Apr 12 10:51:12 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:51:12 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:51:12 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:51:12 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:51:12 user nova-compute[71557]:   </clock>
Apr 12 10:51:12 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:51:12 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:51:12 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:51:12 user nova-compute[71557]:   </cpu>
Apr 12 10:51:12 user nova-compute[71557]:   <devices>
Apr 12 10:51:12 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:51:12 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:51:12 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk"/>
Apr 12 10:51:12 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:51:12 user nova-compute[71557]:     </disk>
Apr 12 10:51:12 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:51:12 user nova-compute[71557]:       <mac address="fa:16:3e:c3:0b:b8"/>
Apr 12 10:51:12 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:51:12 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:51:12 user nova-compute[71557]:       <target dev="tap66db319f-02"/>
Apr 12 10:51:12 user nova-compute[71557]:     </interface>
Apr 12 10:51:12 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:51:12 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/console.log" append="off"/>
Apr 12 10:51:12 user nova-compute[71557]:     </serial>
Apr 12 10:51:12 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:51:12 user nova-compute[71557]:     <video>
Apr 12 10:51:12 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:51:12 user nova-compute[71557]:     </video>
Apr 12 10:51:12 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:51:12 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:51:12 user nova-compute[71557]:     </rng>
Apr 12 10:51:12 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:51:12 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:51:12 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:51:12 user nova-compute[71557]:     </memballoon>
Apr 12 10:51:12 user nova-compute[71557]:   </devices>
Apr 12 10:51:12 user nova-compute[71557]: </domain>
Apr 12 10:51:12 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:51:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1484132394',display_name='tempest-TestMinimumBasicScenario-server-1484132394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1484132394',id=35,image_ref='92fcccc4-57d4-4cb0-872e-507fce12c392',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0xYo/U9olcXUxWVNjyonA9aJ0xsZ/BfTVAGlL1ocRIDzPvg0PLVDDRxGGzI3LZdJJOo5Z6xxzKLkV/HZdcy8X23bxA81QZoa7yGQZyd2sGv0R6G4fpT0+Ec3zh6AfZuQ==',key_name='tempest-TestMinimumBasicScenario-2078556363',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b467fac451ee466fb93cec3d3aa3b408',ramdisk_id='',reservation_id='r-wzir7w0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='92fcccc4-57d4-4cb0-872e-507fce12c392',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2095634766',owner_user_name='tempest-TestMinimumBasicScenario-2095634766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:51:10Z,user_data=None,user_id='a633ec4046a9467683cbfd2ebe59600f',uuid=cdc51c71-9d3b-4957-b912-0666c68b46fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66db319f-02d8-4e75-b71a-2b2d136671a9", "address": "fa:16:3e:c3:0b:b8", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66db319f-02", "ovs_interfaceid": "66db319f-02d8-4e75-b71a-2b2d136671a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Converting VIF {"id": "66db319f-02d8-4e75-b71a-2b2d136671a9", "address": "fa:16:3e:c3:0b:b8", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66db319f-02", "ovs_interfaceid": "66db319f-02d8-4e75-b71a-2b2d136671a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:0b:b8,bridge_name='br-int',has_traffic_filtering=True,id=66db319f-02d8-4e75-b71a-2b2d136671a9,network=Network(d284a588-7406-446d-af3c-874a119b7536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66db319f-02') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG os_vif [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:0b:b8,bridge_name='br-int',has_traffic_filtering=True,id=66db319f-02d8-4e75-b71a-2b2d136671a9,network=Network(d284a588-7406-446d-af3c-874a119b7536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66db319f-02') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66db319f-02, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap66db319f-02, col_values=(('external_ids', {'iface-id': '66db319f-02d8-4e75-b71a-2b2d136671a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:0b:b8', 'vm-uuid': 'cdc51c71-9d3b-4957-b912-0666c68b46fc'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:12 user nova-compute[71557]: INFO os_vif [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:0b:b8,bridge_name='br-int',has_traffic_filtering=True,id=66db319f-02d8-4e75-b71a-2b2d136671a9,network=Network(d284a588-7406-446d-af3c-874a119b7536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66db319f-02')
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] No VIF found with MAC fa:16:3e:c3:0b:b8, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.network.neutron [req-57ac003a-7f42-4594-af05-8c7d435a7573 req-9e394fd6-f035-4324-b3f0-43cd4158130f service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Updated VIF entry in instance network info cache for port 66db319f-02d8-4e75-b71a-2b2d136671a9. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG nova.network.neutron [req-57ac003a-7f42-4594-af05-8c7d435a7573 req-9e394fd6-f035-4324-b3f0-43cd4158130f service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Updating instance_info_cache with network_info: [{"id": "66db319f-02d8-4e75-b71a-2b2d136671a9", "address": "fa:16:3e:c3:0b:b8", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66db319f-02", "ovs_interfaceid": "66db319f-02d8-4e75-b71a-2b2d136671a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:51:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-57ac003a-7f42-4594-af05-8c7d435a7573 req-9e394fd6-f035-4324-b3f0-43cd4158130f service nova] Releasing lock "refresh_cache-cdc51c71-9d3b-4957-b912-0666c68b46fc" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG os_brick.utils [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f74f6b5-5ee7-4549-81a6-2ee3929b6de3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac13ab75-a87a-4d1c-b2c9-fe9ed4860f95]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6de174-6a9b-4a45-88cd-5655cb95a2db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f00c9b3-02f5-4b82-b81a-6f5be148f940]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:51:13 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:51:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd1c4d5-2d1f-4c3b-a28e-bf1f6bed6699]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG os_brick.utils [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Updating existing volume attachment record: 34b7b04c-de36-4577-93af-9e3887749bd6 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-f278b282-5aa9-44e8-86ee-2cd5c742ad90 req-23421021-21e4-4551-955b-727f30818c29 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Received event network-vif-plugged-66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f278b282-5aa9-44e8-86ee-2cd5c742ad90 req-23421021-21e4-4551-955b-727f30818c29 service nova] Acquiring lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f278b282-5aa9-44e8-86ee-2cd5c742ad90 req-23421021-21e4-4551-955b-727f30818c29 service nova] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f278b282-5aa9-44e8-86ee-2cd5c742ad90 req-23421021-21e4-4551-955b-727f30818c29 service nova] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-f278b282-5aa9-44e8-86ee-2cd5c742ad90 req-23421021-21e4-4551-955b-727f30818c29 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] No waiting events found dispatching network-vif-plugged-66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:51:13 user nova-compute[71557]: WARNING nova.compute.manager [req-f278b282-5aa9-44e8-86ee-2cd5c742ad90 req-23421021-21e4-4551-955b-727f30818c29 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Received unexpected event network-vif-plugged-66db319f-02d8-4e75-b71a-2b2d136671a9 for instance with vm_state building and task_state spawning.
Apr 12 10:51:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296675.7289753, cdc51c71-9d3b-4957-b912-0666c68b46fc => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:51:15 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] VM Resumed (Lifecycle Event)
Apr 12 10:51:15 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:51:15 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Instance spawned successfully.
Apr 12 10:51:15 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:51:15 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:51:15 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296675.7332313, cdc51c71-9d3b-4957-b912-0666c68b46fc => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:51:15 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] VM Started (Lifecycle Event)
Apr 12 10:51:15 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:51:15 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:51:15 user nova-compute[71557]: INFO nova.compute.manager [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Took 6.00 seconds to spawn the instance on the hypervisor.
Apr 12 10:51:15 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'suqmjSkf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:51:15 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:51:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:51:15 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:51:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:51:15 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:51:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-87d422e7-538d-470a-aa85-15a1ca67a530 req-99fd3e8e-8c7b-4d9c-aab5-9bfc8858aa47 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Received event network-vif-plugged-66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-87d422e7-538d-470a-aa85-15a1ca67a530 req-99fd3e8e-8c7b-4d9c-aab5-9bfc8858aa47 service nova] Acquiring lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-87d422e7-538d-470a-aa85-15a1ca67a530 req-99fd3e8e-8c7b-4d9c-aab5-9bfc8858aa47 service nova] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-87d422e7-538d-470a-aa85-15a1ca67a530 req-99fd3e8e-8c7b-4d9c-aab5-9bfc8858aa47 service nova] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-87d422e7-538d-470a-aa85-15a1ca67a530 req-99fd3e8e-8c7b-4d9c-aab5-9bfc8858aa47 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] No waiting events found dispatching network-vif-plugged-66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:51:15 user nova-compute[71557]: WARNING nova.compute.manager [req-87d422e7-538d-470a-aa85-15a1ca67a530 req-99fd3e8e-8c7b-4d9c-aab5-9bfc8858aa47 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Received unexpected event network-vif-plugged-66db319f-02d8-4e75-b71a-2b2d136671a9 for instance with vm_state building and task_state spawning.
Apr 12 10:51:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[097bb5f0-d472-4335-aa82-a615080b6392]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:51:15 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efc3ae0-0c63-4733-a43c-247cabddbf12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0] added
Apr 12 10:51:15 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:15 user nova-compute[71557]: INFO nova.compute.manager [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Took 6.88 seconds to build instance.
Apr 12 10:51:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f0a89f-e1f2-4fa1-8489-fc2ceb04ca1f]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fffaa38-2db0-4e41-8f47-4d3d13d782ce tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.986s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[89166be4-97cf-4c0f-bc76-5094a989e4fa]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v suqmjSkf {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v suqmjSkf" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1600a480-53d1-4e2f-89b8-741e6bda4652]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'suqmjSkf'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0ad824-e6d8-4ba4-8880-091095150db2]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca8e163-c52c-48da-a1d7-1dc681786aab]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:51:16 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:51:16 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:51:16 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:51:16 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:51:16 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:51:16 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda7004a-5902-4f71-b868-5e057a55aecd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0, portal: 172.16.0.220,3260]
Apr 12 10:51:16 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0, portal: 172.16.0.220,3260] successful.
Apr 12 10:51:16 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[427f6dd5-9870-41fa-b247-a4b65adec2bf]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e302909-deb1-4267-b7fa-9dc4904385b3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:51:16 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:51:16 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:51:16 user nova-compute[71557]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 (non-flash)
Apr 12 10:51:16 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:51:16 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:51:16 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:51:16 user nova-compute[71557]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 (non-flash)
Apr 12 10:51:16 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5851a00a-9aec-4567-86ce-65d45a8aed4a]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:51:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'suqmjSkf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:51:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:51:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23565363330313661', 'path': '/dev/sdd'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:51:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565363330313661', 'path': '/dev/sdd'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:51:17 user nova-compute[71557]: DEBUG nova.objects.instance [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'flavor' on Instance uuid 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:51:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 10:51:17 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:51:17 user nova-compute[71557]:   <source dev="/dev/sdd"/>
Apr 12 10:51:17 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:51:17 user nova-compute[71557]:   <serial>054aa7d1-a508-4c31-8332-900e26be41b0</serial>
Apr 12 10:51:17 user nova-compute[71557]: </disk>
Apr 12 10:51:17 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 10:51:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:51:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:51:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] No VIF found with MAC fa:16:3e:48:a4:2f, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:51:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ae49314b-720b-4467-8f4b-4da1b9339724 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.659s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG nova.compute.manager [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:51:18 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Creating image(s)
Apr 12 10:51:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Did not create local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Ensure instance console log exists: /opt/stack/data/nova/instances/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Start _get_guest_xml network_info=[{"id": "2c64da14-81c7-48d5-b272-2e09127f33fd", "address": "fa:16:3e:17:f2:80", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c64da14-81", "ovs_interfaceid": "2c64da14-81c7-48d5-b272-2e09127f33fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-12T10:51:04Z,direct_url=<?>,disk_format='qcow2',id=877d5436-0b95-4a8d-a3b4-2f4d4699201a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2071342215',owner='a67f3d23b8f74a9496d445c7fc75717e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-12T10:51:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': '34b7b04c-de36-4577-93af-9e3887749bd6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hAqzuHiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8', 'attached_at': '', 'detached_at': '', 'volume_id': '5e6dc66f-725e-412b-9d12-c4639c94341d', 'serial': '5e6dc66f-725e-412b-9d12-c4639c94341d'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:51:18 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:51:18 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:51:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-12T10:51:04Z,direct_url=<?>,disk_format='qcow2',id=877d5436-0b95-4a8d-a3b4-2f4d4699201a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2071342215',owner='a67f3d23b8f74a9496d445c7fc75717e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-12T10:51:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hAqzuHiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:51:18 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:51:18 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:51:18 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba14c8b-5fc8-4cb4-b369-103e38bfb1b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:51:18 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbe0830-b94c-425d-983d-59faf31e3feb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d] added
Apr 12 10:51:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[71adb4ff-2345-4e49-adde-dbe9104d6a25]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[97148ea1-53c1-4bf3-805d-54a389ec040f]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hAqzuHiv {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hAqzuHiv" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f19b9d-5771-4b44-bde8-a17c05cdbaef]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hAqzuHiv'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[697cec96-e30f-4327-8cf0-127e6c46ef8a]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf8a00c-6f41-4908-bdee-490d4073fb3f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:51:18 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:51:18 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:51:18 user nova-compute[71557]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 (non-flash)
Apr 12 10:51:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:51:18 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:51:18 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:51:18 user nova-compute[71557]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 (non-flash)
Apr 12 10:51:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[34874f2d-a2ab-4060-bc85-8a627cddee1d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d, portal: 172.16.0.220,3260]
Apr 12 10:51:18 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d, portal: 172.16.0.220,3260] successful.
Apr 12 10:51:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60d351e-6eeb-4842-8890-71f04dd017ba]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[987f2698-7028-4682-bc7c-234e000322de]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:51:18 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:51:18 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:51:18 user nova-compute[71557]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 (non-flash)
Apr 12 10:51:18 user nova-compute[71557]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d (non-flash)
Apr 12 10:51:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:51:18 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:51:18 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:51:18 user nova-compute[71557]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 (non-flash)
Apr 12 10:51:18 user nova-compute[71557]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d (non-flash)
Apr 12 10:51:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c945418b-16f0-4a40-b39a-4481bad1a3f5]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:51:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hAqzuHiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:19 user nova-compute[71557]: INFO nova.compute.manager [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Detaching volume 054aa7d1-a508-4c31-8332-900e26be41b0
Apr 12 10:51:19 user nova-compute[71557]: INFO nova.virt.block_device [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Attempting to driver detach volume 054aa7d1-a508-4c31-8332-900e26be41b0 from mountpoint /dev/vdb
Apr 12 10:51:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Attempting to detach device vdb from instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:51:19 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:51:19 user nova-compute[71557]:   <source dev="/dev/sdd"/>
Apr 12 10:51:19 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:51:19 user nova-compute[71557]:   <serial>054aa7d1-a508-4c31-8332-900e26be41b0</serial>
Apr 12 10:51:19 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:51:19 user nova-compute[71557]: </disk>
Apr 12 10:51:19 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:51:19 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Successfully detached device vdb from instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 from the persistent domain config.
Apr 12 10:51:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:51:19 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:51:19 user nova-compute[71557]:   <source dev="/dev/sdd"/>
Apr 12 10:51:19 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:51:19 user nova-compute[71557]:   <serial>054aa7d1-a508-4c31-8332-900e26be41b0</serial>
Apr 12 10:51:19 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:51:19 user nova-compute[71557]: </disk>
Apr 12 10:51:19 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23164623261336237', 'path': '/dev/sde'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164623261336237', 'path': '/dev/sde'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:51:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1490063816',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1490063816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1490063816',id=34,image_ref='877d5436-0b95-4a8d-a3b4-2f4d4699201a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a67f3d23b8f74a9496d445c7fc75717e',ramdisk_id='',reservation_id='r-a57zktid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-638607559',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-638607559-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-638607559',owner_user_name='tempest-TestVolumeBootPattern-638607559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:51:08Z,user_data=None,user_id='b914d7ca786f455baf120f98816abffd',uuid=468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c64da14-81c7-48d5-b272-2e09127f33fd", "address": "fa:16:3e:17:f2:80", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c64da14-81", "ovs_interfaceid": "2c64da14-81c7-48d5-b272-2e09127f33fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converting VIF {"id": "2c64da14-81c7-48d5-b272-2e09127f33fd", "address": "fa:16:3e:17:f2:80", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c64da14-81", "ovs_interfaceid": "2c64da14-81c7-48d5-b272-2e09127f33fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:f2:80,bridge_name='br-int',has_traffic_filtering=True,id=2c64da14-81c7-48d5-b272-2e09127f33fd,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c64da14-81') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG nova.objects.instance [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lazy-loading 'pci_devices' on Instance uuid 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:51:19 user nova-compute[71557]:   <uuid>468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8</uuid>
Apr 12 10:51:19 user nova-compute[71557]:   <name>instance-00000022</name>
Apr 12 10:51:19 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:51:19 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:51:19 user nova-compute[71557]:   <metadata>
Apr 12 10:51:19 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:51:19 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:51:19 user nova-compute[71557]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1490063816</nova:name>
Apr 12 10:51:19 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:51:18</nova:creationTime>
Apr 12 10:51:19 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:51:19 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:51:19 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:51:19 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:51:19 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:51:19 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:51:19 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:51:19 user nova-compute[71557]:       <nova:owner>
Apr 12 10:51:19 user nova-compute[71557]:         <nova:user uuid="b914d7ca786f455baf120f98816abffd">tempest-TestVolumeBootPattern-638607559-project-member</nova:user>
Apr 12 10:51:19 user nova-compute[71557]:         <nova:project uuid="a67f3d23b8f74a9496d445c7fc75717e">tempest-TestVolumeBootPattern-638607559</nova:project>
Apr 12 10:51:19 user nova-compute[71557]:       </nova:owner>
Apr 12 10:51:19 user nova-compute[71557]:       <nova:root type="image" uuid="877d5436-0b95-4a8d-a3b4-2f4d4699201a"/>
Apr 12 10:51:19 user nova-compute[71557]:       <nova:ports>
Apr 12 10:51:19 user nova-compute[71557]:         <nova:port uuid="2c64da14-81c7-48d5-b272-2e09127f33fd">
Apr 12 10:51:19 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 10:51:19 user nova-compute[71557]:         </nova:port>
Apr 12 10:51:19 user nova-compute[71557]:       </nova:ports>
Apr 12 10:51:19 user nova-compute[71557]:     </nova:instance>
Apr 12 10:51:19 user nova-compute[71557]:   </metadata>
Apr 12 10:51:19 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:51:19 user nova-compute[71557]:     <system>
Apr 12 10:51:19 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:51:19 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:51:19 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:51:19 user nova-compute[71557]:       <entry name="serial">468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8</entry>
Apr 12 10:51:19 user nova-compute[71557]:       <entry name="uuid">468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8</entry>
Apr 12 10:51:19 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:51:19 user nova-compute[71557]:     </system>
Apr 12 10:51:19 user nova-compute[71557]:   </sysinfo>
Apr 12 10:51:19 user nova-compute[71557]:   <os>
Apr 12 10:51:19 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:51:19 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:51:19 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:51:19 user nova-compute[71557]:   </os>
Apr 12 10:51:19 user nova-compute[71557]:   <features>
Apr 12 10:51:19 user nova-compute[71557]:     <acpi/>
Apr 12 10:51:19 user nova-compute[71557]:     <apic/>
Apr 12 10:51:19 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:51:19 user nova-compute[71557]:   </features>
Apr 12 10:51:19 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:51:19 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:51:19 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:51:19 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:51:19 user nova-compute[71557]:   </clock>
Apr 12 10:51:19 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:51:19 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:51:19 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:51:19 user nova-compute[71557]:   </cpu>
Apr 12 10:51:19 user nova-compute[71557]:   <devices>
Apr 12 10:51:19 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:51:19 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:51:19 user nova-compute[71557]:       <source dev="/dev/sde"/>
Apr 12 10:51:19 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:51:19 user nova-compute[71557]:       <serial>5e6dc66f-725e-412b-9d12-c4639c94341d</serial>
Apr 12 10:51:19 user nova-compute[71557]:     </disk>
Apr 12 10:51:19 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:51:19 user nova-compute[71557]:       <mac address="fa:16:3e:17:f2:80"/>
Apr 12 10:51:19 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:51:19 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:51:19 user nova-compute[71557]:       <target dev="tap2c64da14-81"/>
Apr 12 10:51:19 user nova-compute[71557]:     </interface>
Apr 12 10:51:19 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:51:19 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8/console.log" append="off"/>
Apr 12 10:51:19 user nova-compute[71557]:     </serial>
Apr 12 10:51:19 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:51:19 user nova-compute[71557]:     <video>
Apr 12 10:51:19 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:51:19 user nova-compute[71557]:     </video>
Apr 12 10:51:19 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:51:19 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:51:19 user nova-compute[71557]:     </rng>
Apr 12 10:51:19 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:51:19 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:51:19 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:51:19 user nova-compute[71557]:     </memballoon>
Apr 12 10:51:19 user nova-compute[71557]:   </devices>
Apr 12 10:51:19 user nova-compute[71557]: </domain>
Apr 12 10:51:19 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:51:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1490063816',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1490063816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1490063816',id=34,image_ref='877d5436-0b95-4a8d-a3b4-2f4d4699201a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a67f3d23b8f74a9496d445c7fc75717e',ramdisk_id='',reservation_id='r-a57zktid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-638607559',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-638607559-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-638607559',owner_user_name='tempest-TestVolumeBootPattern-638607559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:51:08Z,user_data=None,user_id='b914d7ca786f455baf120f98816abffd',uuid=468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c64da14-81c7-48d5-b272-2e09127f33fd", "address": "fa:16:3e:17:f2:80", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c64da14-81", "ovs_interfaceid": "2c64da14-81c7-48d5-b272-2e09127f33fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converting VIF {"id": "2c64da14-81c7-48d5-b272-2e09127f33fd", "address": "fa:16:3e:17:f2:80", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c64da14-81", "ovs_interfaceid": "2c64da14-81c7-48d5-b272-2e09127f33fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:f2:80,bridge_name='br-int',has_traffic_filtering=True,id=2c64da14-81c7-48d5-b272-2e09127f33fd,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c64da14-81') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG os_vif [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:f2:80,bridge_name='br-int',has_traffic_filtering=True,id=2c64da14-81c7-48d5-b272-2e09127f33fd,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c64da14-81') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c64da14-81, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2c64da14-81, col_values=(('external_ids', {'iface-id': '2c64da14-81c7-48d5-b272-2e09127f33fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:f2:80', 'vm-uuid': '468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:19 user nova-compute[71557]: INFO os_vif [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:f2:80,bridge_name='br-int',has_traffic_filtering=True,id=2c64da14-81c7-48d5-b272-2e09127f33fd,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c64da14-81')
Apr 12 10:51:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681296679.8257678, 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 10:51:19 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Successfully detached device vdb from instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 from the live domain config.
Apr 12 10:51:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'suqmjSkf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:51:19 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:51:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] No VIF found with MAC fa:16:3e:17:f2:80, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fca9a17-57c6-466f-8d9a-1916f5cfbf54]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:51:19 user nova-compute[71557]: No targets found.
Apr 12 10:51:19 user nova-compute[71557]: iSNS:
Apr 12 10:51:19 user nova-compute[71557]: No targets found.
Apr 12 10:51:19 user nova-compute[71557]: STATIC:
Apr 12 10:51:19 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:51:19 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:51:19 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:51:19 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8
Apr 12 10:51:19 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:51:19 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:51:19 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36
Apr 12 10:51:19 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:51:19 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:51:19 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d
Apr 12 10:51:19 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:51:19 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:51:19 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0
Apr 12 10:51:19 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:51:19 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:51:19 user nova-compute[71557]: FIRMWARE:
Apr 12 10:51:19 user nova-compute[71557]: No targets found.
Apr 12 10:51:19 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:51:19 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:51:19 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e0afbb-a8e6-4259-8747-545517217069]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab6aaf3-cd93-4c06-a7c1-d3f930bde2c7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:51:19 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:51:19 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:51:19 user nova-compute[71557]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 (non-flash)
Apr 12 10:51:19 user nova-compute[71557]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d (non-flash)
Apr 12 10:51:19 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:51:19 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:51:19 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:51:19 user nova-compute[71557]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 (non-flash)
Apr 12 10:51:19 user nova-compute[71557]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d (non-flash)
Apr 12 10:51:19 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd40bfeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0'): ({'sdd'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Removing single pathed devices sdd {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a03ddc-c14e-412f-a5ba-167a210c5a44]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d1f8e9-1fb6-487a-9620-9cb5a0db0bdd]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Flushing IO for device /dev/sdd {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f209732-9f41-46d1-abfe-7167c608044f]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:51:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad054db-b30e-4057-a1ca-3c30a34df0e5]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] SCSI volumes sdd have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd4ffe4-75a7-486e-a390-35ec3b7492b4]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd189a4-5260-4b23-8115-45c8ffb8aead]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0, portal: 172.16.0.220,3260]
Apr 12 10:51:20 user nova-compute[71557]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0, portal: 172.16.0.220,3260] successful.
Apr 12 10:51:20 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:054aa7d1-a508-4c31-8332-900e26be41b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd121879-fa86-4c1b-b324-b7ebbedc144a]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] <== disconnect_volume: return (334ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "faa11b52-f2b6-45aa-937f-7468095ddb22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:20 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG nova.objects.instance [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'flavor' on Instance uuid 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:51:21 user nova-compute[71557]: INFO nova.compute.claims [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Claim successful on node user
Apr 12 10:51:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e05c0f38-f119-4d58-bc71-2ed8c0ba6e78 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.816s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-3a240ee4-8bda-4d72-9585-43ffa81fc8be req-40d04dde-026e-456a-8ea3-663dd6fcb584 service nova] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Received event network-vif-plugged-2c64da14-81c7-48d5-b272-2e09127f33fd {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3a240ee4-8bda-4d72-9585-43ffa81fc8be req-40d04dde-026e-456a-8ea3-663dd6fcb584 service nova] Acquiring lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3a240ee4-8bda-4d72-9585-43ffa81fc8be req-40d04dde-026e-456a-8ea3-663dd6fcb584 service nova] Lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3a240ee4-8bda-4d72-9585-43ffa81fc8be req-40d04dde-026e-456a-8ea3-663dd6fcb584 service nova] Lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-3a240ee4-8bda-4d72-9585-43ffa81fc8be req-40d04dde-026e-456a-8ea3-663dd6fcb584 service nova] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] No waiting events found dispatching network-vif-plugged-2c64da14-81c7-48d5-b272-2e09127f33fd {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:51:21 user nova-compute[71557]: WARNING nova.compute.manager [req-3a240ee4-8bda-4d72-9585-43ffa81fc8be req-40d04dde-026e-456a-8ea3-663dd6fcb584 service nova] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Received unexpected event network-vif-plugged-2c64da14-81c7-48d5-b272-2e09127f33fd for instance with vm_state building and task_state spawning.
Apr 12 10:51:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG nova.network.neutron [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:51:21 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:51:21 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG nova.policy [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abdf772f2c7341c29159b6f1f2ce7ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b39cd8e55b54a86a7784f2934273e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:51:21 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Creating image(s)
Apr 12 10:51:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "/opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "/opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "/opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.147s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk 1073741824" returned: 0 in 0.054s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.139s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:22 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Checking if we can resize image /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:51:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:22 user nova-compute[71557]: DEBUG nova.network.neutron [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Successfully created port: 46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:51:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:22 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Cannot resize image /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:51:22 user nova-compute[71557]: DEBUG nova.objects.instance [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'migration_context' on Instance uuid faa11b52-f2b6-45aa-937f-7468095ddb22 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:51:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:51:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Ensure instance console log exists: /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:51:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.network.neutron [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Successfully updated port: 46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "refresh_cache-faa11b52-f2b6-45aa-937f-7468095ddb22" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquired lock "refresh_cache-faa11b52-f2b6-45aa-937f-7468095ddb22" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.network.neutron [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-32bdab6d-ab23-46f8-95ac-8ce65e7e53d4 req-a7f310c9-cf56-45a1-9cef-5034d905eaa5 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received event network-changed-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-32bdab6d-ab23-46f8-95ac-8ce65e7e53d4 req-a7f310c9-cf56-45a1-9cef-5034d905eaa5 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Refreshing instance network info cache due to event network-changed-46213af2-2a93-4502-9f35-eda3d5b9f7fc. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-32bdab6d-ab23-46f8-95ac-8ce65e7e53d4 req-a7f310c9-cf56-45a1-9cef-5034d905eaa5 service nova] Acquiring lock "refresh_cache-faa11b52-f2b6-45aa-937f-7468095ddb22" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.network.neutron [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296683.4266567, 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:51:23 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] VM Resumed (Lifecycle Event)
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:51:23 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Instance spawned successfully.
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-d9e22ffe-a220-425c-826e-6887749316dd req-a3e86654-a933-4e0e-97c5-a9ad78fbfc69 service nova] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Received event network-vif-plugged-2c64da14-81c7-48d5-b272-2e09127f33fd {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d9e22ffe-a220-425c-826e-6887749316dd req-a3e86654-a933-4e0e-97c5-a9ad78fbfc69 service nova] Acquiring lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d9e22ffe-a220-425c-826e-6887749316dd req-a3e86654-a933-4e0e-97c5-a9ad78fbfc69 service nova] Lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d9e22ffe-a220-425c-826e-6887749316dd req-a3e86654-a933-4e0e-97c5-a9ad78fbfc69 service nova] Lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-d9e22ffe-a220-425c-826e-6887749316dd req-a3e86654-a933-4e0e-97c5-a9ad78fbfc69 service nova] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] No waiting events found dispatching network-vif-plugged-2c64da14-81c7-48d5-b272-2e09127f33fd {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:51:23 user nova-compute[71557]: WARNING nova.compute.manager [req-d9e22ffe-a220-425c-826e-6887749316dd req-a3e86654-a933-4e0e-97c5-a9ad78fbfc69 service nova] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Received unexpected event network-vif-plugged-2c64da14-81c7-48d5-b272-2e09127f33fd for instance with vm_state building and task_state spawning.
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:51:23 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296683.4282908, 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:51:23 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] VM Started (Lifecycle Event)
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:51:23 user nova-compute[71557]: INFO nova.compute.manager [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Took 5.23 seconds to spawn the instance on the hypervisor.
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:51:23 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.network.neutron [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Updating instance_info_cache with network_info: [{"id": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "address": "fa:16:3e:c9:da:1c", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46213af2-2a", "ovs_interfaceid": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:51:23 user nova-compute[71557]: INFO nova.compute.manager [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Took 16.76 seconds to build instance.
Apr 12 10:51:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Releasing lock "refresh_cache-faa11b52-f2b6-45aa-937f-7468095ddb22" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Instance network_info: |[{"id": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "address": "fa:16:3e:c9:da:1c", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46213af2-2a", "ovs_interfaceid": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-32bdab6d-ab23-46f8-95ac-8ce65e7e53d4 req-a7f310c9-cf56-45a1-9cef-5034d905eaa5 service nova] Acquired lock "refresh_cache-faa11b52-f2b6-45aa-937f-7468095ddb22" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.network.neutron [req-32bdab6d-ab23-46f8-95ac-8ce65e7e53d4 req-a7f310c9-cf56-45a1-9cef-5034d905eaa5 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Refreshing network info cache for port 46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Start _get_guest_xml network_info=[{"id": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "address": "fa:16:3e:c9:da:1c", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46213af2-2a", "ovs_interfaceid": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e59fae30-e5e0-4849-a58e-f858a95f801c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.850s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:23 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:51:23 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:51:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1704970245',display_name='tempest-ServerRescueNegativeTestJSON-server-1704970245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1704970245',id=36,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/YpGpY39pjPnnc5Woimceec0NAaa03OrDNhA1pvgsqwdaodbpAhPJh05gGMZMrWZbb/FVge7phkuwRvAKHKPJI+cKczayHgYAnGWdfu4mixptN5qgJSlvLfPCtJ2jZMw==',key_name='tempest-keypair-1748374270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b39cd8e55b54a86a7784f2934273e20',ramdisk_id='',reservation_id='r-9v4ub20y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1632398833',owner_user_name='tempest-ServerRescueNegativeTestJSON-1632398833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:51:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abdf772f2c7341c29159b6f1f2ce7ccb',uuid=faa11b52-f2b6-45aa-937f-7468095ddb22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "address": "fa:16:3e:c9:da:1c", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46213af2-2a", "ovs_interfaceid": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converting VIF {"id": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "address": "fa:16:3e:c9:da:1c", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46213af2-2a", "ovs_interfaceid": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:da:1c,bridge_name='br-int',has_traffic_filtering=True,id=46213af2-2a93-4502-9f35-eda3d5b9f7fc,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46213af2-2a') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.objects.instance [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'pci_devices' on Instance uuid faa11b52-f2b6-45aa-937f-7468095ddb22 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:51:23 user nova-compute[71557]:   <uuid>faa11b52-f2b6-45aa-937f-7468095ddb22</uuid>
Apr 12 10:51:23 user nova-compute[71557]:   <name>instance-00000024</name>
Apr 12 10:51:23 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:51:23 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:51:23 user nova-compute[71557]:   <metadata>
Apr 12 10:51:23 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:51:23 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:51:23 user nova-compute[71557]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1704970245</nova:name>
Apr 12 10:51:23 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:51:23</nova:creationTime>
Apr 12 10:51:23 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:51:23 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:51:23 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:51:23 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:51:23 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:51:23 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:51:23 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:51:23 user nova-compute[71557]:       <nova:owner>
Apr 12 10:51:23 user nova-compute[71557]:         <nova:user uuid="abdf772f2c7341c29159b6f1f2ce7ccb">tempest-ServerRescueNegativeTestJSON-1632398833-project-member</nova:user>
Apr 12 10:51:23 user nova-compute[71557]:         <nova:project uuid="2b39cd8e55b54a86a7784f2934273e20">tempest-ServerRescueNegativeTestJSON-1632398833</nova:project>
Apr 12 10:51:23 user nova-compute[71557]:       </nova:owner>
Apr 12 10:51:23 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:51:23 user nova-compute[71557]:       <nova:ports>
Apr 12 10:51:23 user nova-compute[71557]:         <nova:port uuid="46213af2-2a93-4502-9f35-eda3d5b9f7fc">
Apr 12 10:51:23 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 10:51:23 user nova-compute[71557]:         </nova:port>
Apr 12 10:51:23 user nova-compute[71557]:       </nova:ports>
Apr 12 10:51:23 user nova-compute[71557]:     </nova:instance>
Apr 12 10:51:23 user nova-compute[71557]:   </metadata>
Apr 12 10:51:23 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:51:23 user nova-compute[71557]:     <system>
Apr 12 10:51:23 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:51:23 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:51:23 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:51:23 user nova-compute[71557]:       <entry name="serial">faa11b52-f2b6-45aa-937f-7468095ddb22</entry>
Apr 12 10:51:23 user nova-compute[71557]:       <entry name="uuid">faa11b52-f2b6-45aa-937f-7468095ddb22</entry>
Apr 12 10:51:23 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:51:23 user nova-compute[71557]:     </system>
Apr 12 10:51:23 user nova-compute[71557]:   </sysinfo>
Apr 12 10:51:23 user nova-compute[71557]:   <os>
Apr 12 10:51:23 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:51:23 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:51:23 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:51:23 user nova-compute[71557]:   </os>
Apr 12 10:51:23 user nova-compute[71557]:   <features>
Apr 12 10:51:23 user nova-compute[71557]:     <acpi/>
Apr 12 10:51:23 user nova-compute[71557]:     <apic/>
Apr 12 10:51:23 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:51:23 user nova-compute[71557]:   </features>
Apr 12 10:51:23 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:51:23 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:51:23 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:51:23 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:51:23 user nova-compute[71557]:   </clock>
Apr 12 10:51:23 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:51:23 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:51:23 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:51:23 user nova-compute[71557]:   </cpu>
Apr 12 10:51:23 user nova-compute[71557]:   <devices>
Apr 12 10:51:23 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:51:23 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:51:23 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk"/>
Apr 12 10:51:23 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:51:23 user nova-compute[71557]:     </disk>
Apr 12 10:51:23 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:51:23 user nova-compute[71557]:       <mac address="fa:16:3e:c9:da:1c"/>
Apr 12 10:51:23 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:51:23 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:51:23 user nova-compute[71557]:       <target dev="tap46213af2-2a"/>
Apr 12 10:51:23 user nova-compute[71557]:     </interface>
Apr 12 10:51:23 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:51:23 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/console.log" append="off"/>
Apr 12 10:51:23 user nova-compute[71557]:     </serial>
Apr 12 10:51:23 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:51:23 user nova-compute[71557]:     <video>
Apr 12 10:51:23 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:51:23 user nova-compute[71557]:     </video>
Apr 12 10:51:23 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:51:23 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:51:23 user nova-compute[71557]:     </rng>
Apr 12 10:51:23 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:51:23 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:51:23 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:51:23 user nova-compute[71557]:     </memballoon>
Apr 12 10:51:23 user nova-compute[71557]:   </devices>
Apr 12 10:51:23 user nova-compute[71557]: </domain>
Apr 12 10:51:23 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:51:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1704970245',display_name='tempest-ServerRescueNegativeTestJSON-server-1704970245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1704970245',id=36,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/YpGpY39pjPnnc5Woimceec0NAaa03OrDNhA1pvgsqwdaodbpAhPJh05gGMZMrWZbb/FVge7phkuwRvAKHKPJI+cKczayHgYAnGWdfu4mixptN5qgJSlvLfPCtJ2jZMw==',key_name='tempest-keypair-1748374270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b39cd8e55b54a86a7784f2934273e20',ramdisk_id='',reservation_id='r-9v4ub20y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1632398833',owner_user_name='tempest-ServerRescueNegativeTestJSON-1632398833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:51:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abdf772f2c7341c29159b6f1f2ce7ccb',uuid=faa11b52-f2b6-45aa-937f-7468095ddb22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "address": "fa:16:3e:c9:da:1c", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46213af2-2a", "ovs_interfaceid": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converting VIF {"id": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "address": "fa:16:3e:c9:da:1c", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46213af2-2a", "ovs_interfaceid": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:da:1c,bridge_name='br-int',has_traffic_filtering=True,id=46213af2-2a93-4502-9f35-eda3d5b9f7fc,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46213af2-2a') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG os_vif [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:da:1c,bridge_name='br-int',has_traffic_filtering=True,id=46213af2-2a93-4502-9f35-eda3d5b9f7fc,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46213af2-2a') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46213af2-2a, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap46213af2-2a, col_values=(('external_ids', {'iface-id': '46213af2-2a93-4502-9f35-eda3d5b9f7fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:da:1c', 'vm-uuid': 'faa11b52-f2b6-45aa-937f-7468095ddb22'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:23 user nova-compute[71557]: INFO os_vif [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:da:1c,bridge_name='br-int',has_traffic_filtering=True,id=46213af2-2a93-4502-9f35-eda3d5b9f7fc,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46213af2-2a')
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:51:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] No VIF found with MAC fa:16:3e:c9:da:1c, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:51:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:24 user nova-compute[71557]: DEBUG nova.network.neutron [req-32bdab6d-ab23-46f8-95ac-8ce65e7e53d4 req-a7f310c9-cf56-45a1-9cef-5034d905eaa5 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Updated VIF entry in instance network info cache for port 46213af2-2a93-4502-9f35-eda3d5b9f7fc. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:51:24 user nova-compute[71557]: DEBUG nova.network.neutron [req-32bdab6d-ab23-46f8-95ac-8ce65e7e53d4 req-a7f310c9-cf56-45a1-9cef-5034d905eaa5 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Updating instance_info_cache with network_info: [{"id": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "address": "fa:16:3e:c9:da:1c", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46213af2-2a", "ovs_interfaceid": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:51:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-32bdab6d-ab23-46f8-95ac-8ce65e7e53d4 req-a7f310c9-cf56-45a1-9cef-5034d905eaa5 service nova] Releasing lock "refresh_cache-faa11b52-f2b6-45aa-937f-7468095ddb22" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:51:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-e3047c53-5cbd-4903-9696-58080875a0ae req-4243a6d1-0ac6-4a60-85b3-65fd879e9695 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received event network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:51:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e3047c53-5cbd-4903-9696-58080875a0ae req-4243a6d1-0ac6-4a60-85b3-65fd879e9695 service nova] Acquiring lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e3047c53-5cbd-4903-9696-58080875a0ae req-4243a6d1-0ac6-4a60-85b3-65fd879e9695 service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e3047c53-5cbd-4903-9696-58080875a0ae req-4243a6d1-0ac6-4a60-85b3-65fd879e9695 service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-e3047c53-5cbd-4903-9696-58080875a0ae req-4243a6d1-0ac6-4a60-85b3-65fd879e9695 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] No waiting events found dispatching network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:51:25 user nova-compute[71557]: WARNING nova.compute.manager [req-e3047c53-5cbd-4903-9696-58080875a0ae req-4243a6d1-0ac6-4a60-85b3-65fd879e9695 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received unexpected event network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance with vm_state building and task_state spawning.
Apr 12 10:51:27 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:51:27 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:51:27 user nova-compute[71557]: DEBUG nova.compute.manager [req-5334be81-4e05-4b3a-a59a-0d6721e3abd5 req-c4aa39c3-77c1-4f18-bf5f-421adc6ba18f service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received event network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:51:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5334be81-4e05-4b3a-a59a-0d6721e3abd5 req-c4aa39c3-77c1-4f18-bf5f-421adc6ba18f service nova] Acquiring lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5334be81-4e05-4b3a-a59a-0d6721e3abd5 req-c4aa39c3-77c1-4f18-bf5f-421adc6ba18f service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5334be81-4e05-4b3a-a59a-0d6721e3abd5 req-c4aa39c3-77c1-4f18-bf5f-421adc6ba18f service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:27 user nova-compute[71557]: DEBUG nova.compute.manager [req-5334be81-4e05-4b3a-a59a-0d6721e3abd5 req-c4aa39c3-77c1-4f18-bf5f-421adc6ba18f service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] No waiting events found dispatching network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:51:27 user nova-compute[71557]: WARNING nova.compute.manager [req-5334be81-4e05-4b3a-a59a-0d6721e3abd5 req-c4aa39c3-77c1-4f18-bf5f-421adc6ba18f service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received unexpected event network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance with vm_state building and task_state spawning.
Apr 12 10:51:27 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296687.814169, faa11b52-f2b6-45aa-937f-7468095ddb22 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:51:27 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] VM Resumed (Lifecycle Event)
Apr 12 10:51:27 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:51:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:51:27 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Instance spawned successfully.
Apr 12 10:51:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:51:27 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:51:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:51:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:51:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:51:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:51:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:51:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:51:27 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:51:28 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:51:28 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296687.8197675, faa11b52-f2b6-45aa-937f-7468095ddb22 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:51:28 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] VM Started (Lifecycle Event)
Apr 12 10:51:28 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:51:28 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:51:28 user nova-compute[71557]: INFO nova.compute.manager [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Took 6.26 seconds to spawn the instance on the hypervisor.
Apr 12 10:51:28 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:51:28 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:51:28 user nova-compute[71557]: INFO nova.compute.manager [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Took 7.20 seconds to build instance.
Apr 12 10:51:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c6f0a554-8f19-454d-afa9-e28006abeefa tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.315s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:29 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:51:30 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:51:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:51:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:51:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:51:30 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:51:30 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Updating instance_info_cache with network_info: [{"id": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "address": "fa:16:3e:e8:3f:f9", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e23fbbf-0b", "ovs_interfaceid": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:51:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:51:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:51:30 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:51:30 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:51:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:30 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:51:31 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:51:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:31 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:51:31 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:51:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:51:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:34 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:51:34 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:51:34 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=7592MB free_disk=25.995819091796875GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 97bafe22-36bf-4939-baf8-9602551bad52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 6b99fe06-9139-4475-aa72-2968a59df0bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance cdc51c71-9d3b-4957-b912-0666c68b46fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance faa11b52-f2b6-45aa-937f-7468095ddb22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=2176MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.593s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:51:34 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Cleaning up deleted instances with incomplete migration  {{(pid=71557) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 10:51:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:51:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:51:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:51:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:51:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:51:36 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:51:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:39 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:51:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Cleaning up deleted instances {{(pid=71557) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 10:51:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] There are 0 instances to clean {{(pid=71557) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 10:51:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:39 user nova-compute[71557]: INFO nova.compute.manager [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Terminating instance
Apr 12 10:51:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:51:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-fffea540-baff-4e2e-b774-52f0e89e164d req-d5bf5037-f01e-45f7-832d-06561959f58f service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Received event network-vif-unplugged-65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:51:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fffea540-baff-4e2e-b774-52f0e89e164d req-d5bf5037-f01e-45f7-832d-06561959f58f service nova] Acquiring lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fffea540-baff-4e2e-b774-52f0e89e164d req-d5bf5037-f01e-45f7-832d-06561959f58f service nova] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fffea540-baff-4e2e-b774-52f0e89e164d req-d5bf5037-f01e-45f7-832d-06561959f58f service nova] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-fffea540-baff-4e2e-b774-52f0e89e164d req-d5bf5037-f01e-45f7-832d-06561959f58f service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] No waiting events found dispatching network-vif-unplugged-65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:51:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-fffea540-baff-4e2e-b774-52f0e89e164d req-d5bf5037-f01e-45f7-832d-06561959f58f service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Received event network-vif-unplugged-65d96800-cdfa-49fe-a407-05d5b661f452 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:51:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:40 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Instance destroyed successfully.
Apr 12 10:51:40 user nova-compute[71557]: DEBUG nova.objects.instance [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lazy-loading 'resources' on Instance uuid 76758da6-ef8f-433f-b4e8-8d72f01b6b34 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:51:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T10:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-637881895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-637881895',id=28,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+kfG5JhTbXJvo4JchrKmOzn92ZUEmlrTD0glXq+axhyaimCqqgKU45MbV6YpEhNYXodiKBbWNpJwThQxwbW5Ag7tRarIRqtDBp4vnVNoqqjXoHeq8fGfxhehEge51e0Q==',key_name='tempest-keypair-538398767',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:50:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af33ce0944194932b663c3b8aef9783d',ramdisk_id='',reservation_id='r-g610bp0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-603525697',owner_user_name='tempest-AttachVolumeShelveTestJSON-603525697-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:50:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d6279f1ce94008a2898ade6f730b40',uuid=76758da6-ef8f-433f-b4e8-8d72f01b6b34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65d96800-cdfa-49fe-a407-05d5b661f452", "address": "fa:16:3e:29:b0:94", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d96800-cd", "ovs_interfaceid": "65d96800-cdfa-49fe-a407-05d5b661f452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:51:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converting VIF {"id": "65d96800-cdfa-49fe-a407-05d5b661f452", "address": "fa:16:3e:29:b0:94", "network": {"id": "aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-713327361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af33ce0944194932b663c3b8aef9783d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d96800-cd", "ovs_interfaceid": "65d96800-cdfa-49fe-a407-05d5b661f452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:51:40 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:b0:94,bridge_name='br-int',has_traffic_filtering=True,id=65d96800-cdfa-49fe-a407-05d5b661f452,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d96800-cd') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:51:40 user nova-compute[71557]: DEBUG os_vif [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:b0:94,bridge_name='br-int',has_traffic_filtering=True,id=65d96800-cdfa-49fe-a407-05d5b661f452,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d96800-cd') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:51:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65d96800-cd, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:51:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:40 user nova-compute[71557]: INFO os_vif [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:b0:94,bridge_name='br-int',has_traffic_filtering=True,id=65d96800-cdfa-49fe-a407-05d5b661f452,network=Network(aba8ebfd-b16e-4cb3-a6a7-d04cdd66ed18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d96800-cd')
Apr 12 10:51:40 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Deleting instance files /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34_del
Apr 12 10:51:40 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Deletion of /opt/stack/data/nova/instances/76758da6-ef8f-433f-b4e8-8d72f01b6b34_del complete
Apr 12 10:51:40 user nova-compute[71557]: INFO nova.compute.manager [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 12 10:51:40 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:51:40 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:51:40 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:51:41 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:51:41 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Took 0.81 seconds to deallocate network for instance.
Apr 12 10:51:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:41 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:51:41 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:51:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:41 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Deleted allocations for instance 76758da6-ef8f-433f-b4e8-8d72f01b6b34
Apr 12 10:51:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d63983e7-803b-418d-96b2-32392c893a48 tempest-AttachVolumeShelveTestJSON-603525697 tempest-AttachVolumeShelveTestJSON-603525697-project-member] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.218s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:42 user nova-compute[71557]: DEBUG nova.compute.manager [req-a18a0b93-d15f-4ec8-bce2-483dfe10dacb req-9c370b82-af66-4b72-98ca-c7896843cf4a service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Received event network-vif-plugged-65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:51:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a18a0b93-d15f-4ec8-bce2-483dfe10dacb req-9c370b82-af66-4b72-98ca-c7896843cf4a service nova] Acquiring lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a18a0b93-d15f-4ec8-bce2-483dfe10dacb req-9c370b82-af66-4b72-98ca-c7896843cf4a service nova] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a18a0b93-d15f-4ec8-bce2-483dfe10dacb req-9c370b82-af66-4b72-98ca-c7896843cf4a service nova] Lock "76758da6-ef8f-433f-b4e8-8d72f01b6b34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:42 user nova-compute[71557]: DEBUG nova.compute.manager [req-a18a0b93-d15f-4ec8-bce2-483dfe10dacb req-9c370b82-af66-4b72-98ca-c7896843cf4a service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] No waiting events found dispatching network-vif-plugged-65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:51:42 user nova-compute[71557]: WARNING nova.compute.manager [req-a18a0b93-d15f-4ec8-bce2-483dfe10dacb req-9c370b82-af66-4b72-98ca-c7896843cf4a service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Received unexpected event network-vif-plugged-65d96800-cdfa-49fe-a407-05d5b661f452 for instance with vm_state deleted and task_state None.
Apr 12 10:51:42 user nova-compute[71557]: DEBUG nova.compute.manager [req-a18a0b93-d15f-4ec8-bce2-483dfe10dacb req-9c370b82-af66-4b72-98ca-c7896843cf4a service nova] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Received event network-vif-deleted-65d96800-cdfa-49fe-a407-05d5b661f452 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:51:42 user nova-compute[71557]: DEBUG nova.compute.manager [req-0b0729b3-eaab-46a3-a756-e46f5a4a7353 req-e6476fcc-ad70-4174-aed9-35f060ba324d service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Received event network-changed-59e0f8a4-966b-46f3-921d-be0c6f15f281 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:51:42 user nova-compute[71557]: DEBUG nova.compute.manager [req-0b0729b3-eaab-46a3-a756-e46f5a4a7353 req-e6476fcc-ad70-4174-aed9-35f060ba324d service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Refreshing instance network info cache due to event network-changed-59e0f8a4-966b-46f3-921d-be0c6f15f281. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:51:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0b0729b3-eaab-46a3-a756-e46f5a4a7353 req-e6476fcc-ad70-4174-aed9-35f060ba324d service nova] Acquiring lock "refresh_cache-a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:51:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0b0729b3-eaab-46a3-a756-e46f5a4a7353 req-e6476fcc-ad70-4174-aed9-35f060ba324d service nova] Acquired lock "refresh_cache-a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:51:42 user nova-compute[71557]: DEBUG nova.network.neutron [req-0b0729b3-eaab-46a3-a756-e46f5a4a7353 req-e6476fcc-ad70-4174-aed9-35f060ba324d service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Refreshing network info cache for port 59e0f8a4-966b-46f3-921d-be0c6f15f281 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:51:43 user nova-compute[71557]: DEBUG nova.network.neutron [req-0b0729b3-eaab-46a3-a756-e46f5a4a7353 req-e6476fcc-ad70-4174-aed9-35f060ba324d service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Updated VIF entry in instance network info cache for port 59e0f8a4-966b-46f3-921d-be0c6f15f281. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:51:43 user nova-compute[71557]: DEBUG nova.network.neutron [req-0b0729b3-eaab-46a3-a756-e46f5a4a7353 req-e6476fcc-ad70-4174-aed9-35f060ba324d service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Updating instance_info_cache with network_info: [{"id": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "address": "fa:16:3e:98:5d:7d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e0f8a4-96", "ovs_interfaceid": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:51:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0b0729b3-eaab-46a3-a756-e46f5a4a7353 req-e6476fcc-ad70-4174-aed9-35f060ba324d service nova] Releasing lock "refresh_cache-a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:51:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "0cb22a78-94df-49fb-918c-32856e1b5136" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "0cb22a78-94df-49fb-918c-32856e1b5136" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:51:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:46 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:51:46 user nova-compute[71557]: INFO nova.compute.claims [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Claim successful on node user
Apr 12 10:51:46 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:51:46 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG nova.network.neutron [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:51:47 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:51:47 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:51:47 user nova-compute[71557]: INFO nova.virt.block_device [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Booting with volume aa22aac8-82c0-4487-bc15-af046a4aa2b4 at /dev/vda
Apr 12 10:51:47 user nova-compute[71557]: DEBUG nova.policy [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0059d31539304ffcb5214b408751cd4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32235c67d269474b879a58269c1bfb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG os_brick.utils [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0383ac45-a15d-45ac-b668-301c5015bce2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2f53b4-aed2-49f8-9637-50802abd41ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31ff3f3-f8d5-4dc3-b8aa-8bf747a21130]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ed45be-fa33-46dc-a59f-35ad6eaf4ca9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:51:47 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:51:47 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf2903c-1bf5-46c3-bf49-baff2e8c4a73]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG os_brick.utils [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Updating existing volume attachment record: 1fd95f11-8e2f-430d-8c13-816b59c1a9f4 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:51:47 user nova-compute[71557]: DEBUG nova.network.neutron [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Successfully created port: 225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_power_states {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:51:48 user nova-compute[71557]: WARNING nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] While synchronizing instance power states, found 13 instances in the database and 12 instances on the hypervisor.
Apr 12 10:51:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid 0f55cab4-8530-4be0-a91d-65671f0dccd9 {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid be3f67e5-420d-42a2-b68a-7cadff22fa48 {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid 97bafe22-36bf-4939-baf8-9602551bad52 {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid 6b99fe06-9139-4475-aa72-2968a59df0bd {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid cdc51c71-9d3b-4957-b912-0666c68b46fc {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid faa11b52-f2b6-45aa-937f-7468095ddb22 {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid 0cb22a78-94df-49fb-918c-32856e1b5136 {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "0f55cab4-8530-4be0-a91d-65671f0dccd9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "0f55cab4-8530-4be0-a91d-65671f0dccd9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "be3f67e5-420d-42a2-b68a-7cadff22fa48" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "97bafe22-36bf-4939-baf8-9602551bad52" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "97bafe22-36bf-4939-baf8-9602551bad52" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "6b99fe06-9139-4475-aa72-2968a59df0bd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "6b99fe06-9139-4475-aa72-2968a59df0bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "cdc51c71-9d3b-4957-b912-0666c68b46fc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "faa11b52-f2b6-45aa-937f-7468095ddb22" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "0cb22a78-94df-49fb-918c-32856e1b5136" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "0f55cab4-8530-4be0-a91d-65671f0dccd9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "97bafe22-36bf-4939-baf8-9602551bad52" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "6b99fe06-9139-4475-aa72-2968a59df0bd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG nova.network.neutron [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Successfully updated port: 225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "refresh_cache-0cb22a78-94df-49fb-918c-32856e1b5136" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquired lock "refresh_cache-0cb22a78-94df-49fb-918c-32856e1b5136" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG nova.network.neutron [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG nova.compute.manager [req-cc883d25-7540-4191-b29f-ded2da0ec14b req-fc145c34-183f-425f-b910-0a7bf5510219 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Received event network-changed-225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG nova.compute.manager [req-cc883d25-7540-4191-b29f-ded2da0ec14b req-fc145c34-183f-425f-b910-0a7bf5510219 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Refreshing instance network info cache due to event network-changed-225efc65-26fe-4d54-93aa-35298d6ddd3f. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cc883d25-7540-4191-b29f-ded2da0ec14b req-fc145c34-183f-425f-b910-0a7bf5510219 service nova] Acquiring lock "refresh_cache-0cb22a78-94df-49fb-918c-32856e1b5136" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:51:48 user nova-compute[71557]: DEBUG nova.network.neutron [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:51:49 user nova-compute[71557]: DEBUG nova.network.neutron [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Updating instance_info_cache with network_info: [{"id": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "address": "fa:16:3e:e3:f1:6d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225efc65-26", "ovs_interfaceid": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:51:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Releasing lock "refresh_cache-0cb22a78-94df-49fb-918c-32856e1b5136" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:51:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Instance network_info: |[{"id": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "address": "fa:16:3e:e3:f1:6d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225efc65-26", "ovs_interfaceid": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:51:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cc883d25-7540-4191-b29f-ded2da0ec14b req-fc145c34-183f-425f-b910-0a7bf5510219 service nova] Acquired lock "refresh_cache-0cb22a78-94df-49fb-918c-32856e1b5136" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:51:49 user nova-compute[71557]: DEBUG nova.network.neutron [req-cc883d25-7540-4191-b29f-ded2da0ec14b req-fc145c34-183f-425f-b910-0a7bf5510219 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Refreshing network info cache for port 225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:51:49 user nova-compute[71557]: DEBUG nova.network.neutron [req-cc883d25-7540-4191-b29f-ded2da0ec14b req-fc145c34-183f-425f-b910-0a7bf5510219 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Updated VIF entry in instance network info cache for port 225efc65-26fe-4d54-93aa-35298d6ddd3f. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:51:49 user nova-compute[71557]: DEBUG nova.network.neutron [req-cc883d25-7540-4191-b29f-ded2da0ec14b req-fc145c34-183f-425f-b910-0a7bf5510219 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Updating instance_info_cache with network_info: [{"id": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "address": "fa:16:3e:e3:f1:6d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225efc65-26", "ovs_interfaceid": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:51:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cc883d25-7540-4191-b29f-ded2da0ec14b req-fc145c34-183f-425f-b910-0a7bf5510219 service nova] Releasing lock "refresh_cache-0cb22a78-94df-49fb-918c-32856e1b5136" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:51:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:51:51 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Creating image(s)
Apr 12 10:51:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Did not create local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Ensure instance console log exists: /opt/stack/data/nova/instances/0cb22a78-94df-49fb-918c-32856e1b5136/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Start _get_guest_xml network_info=[{"id": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "address": "fa:16:3e:e3:f1:6d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225efc65-26", "ovs_interfaceid": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': '1fd95f11-8e2f-430d-8c13-816b59c1a9f4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlepnzcC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0cb22a78-94df-49fb-918c-32856e1b5136', 'attached_at': '', 'detached_at': '', 'volume_id': 'aa22aac8-82c0-4487-bc15-af046a4aa2b4', 'serial': 'aa22aac8-82c0-4487-bc15-af046a4aa2b4'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:51:51 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:51:51 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:51:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlepnzcC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:51:51 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:51:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:51:51 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:51:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:51:51 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[90501814-32e5-4262-a727-365ac5772206]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:51:51 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bf2fed-b193-4bd3-b5d6-3f430c6a4ae8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4] added
Apr 12 10:51:51 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[70010174-a2f2-46bb-97d1-a27658cac750]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7938e72c-f0ac-410f-b95d-cf070b57db4b]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QlepnzcC {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QlepnzcC" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5260e561-e86d-4803-b024-83feb142c4b6]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QlepnzcC'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8619a7d3-65b0-4e3e-90b3-38e50f4bbb1f]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d437ac0-89c4-49af-9c9e-bf066d747fa7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:51:51 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:51:51 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:51:51 user nova-compute[71557]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d (non-flash)
Apr 12 10:51:51 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:51:51 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:51:51 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:51:51 user nova-compute[71557]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d (non-flash)
Apr 12 10:51:51 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a063ac-9c83-4c60-966a-1bae13981b0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4, portal: 172.16.0.220,3260]
Apr 12 10:51:51 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4, portal: 172.16.0.220,3260] successful.
Apr 12 10:51:51 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff21e9fb-4535-4903-96a5-99c2f82c2bc5]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[34369d24-9260-4518-9a93-be74935165ef]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:51:51 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:51:51 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:51:51 user nova-compute[71557]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d (non-flash)
Apr 12 10:51:51 user nova-compute[71557]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:51:51 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:51:51 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:51:51 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:51:51 user nova-compute[71557]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d (non-flash)
Apr 12 10:51:51 user nova-compute[71557]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:51:51 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3a50c9-ced0-4aeb-86d4-1e27d88b79c7]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:51:51 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: None {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:51:52 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:51:52 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlepnzcC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:51:52 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:51:52 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23237393063323361', 'path': '/dev/sdd'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:51:52 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237393063323361', 'path': '/dev/sdd'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:51:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-465944081',display_name='tempest-ServerActionsTestJSON-server-465944081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-465944081',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSPzZAK4K6WfKgZv6ul+nJ2Lzppw5IMfK0+f9KuGByC6XjA59WQJmgMTCh01/yWlwW8qMjnx6gjYen9tQKzYmdVo3Z1KGqS/wGYHKKDRVeNNONzm9HfPYp2EDH6xyugDA==',key_name='tempest-keypair-1241183546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32235c67d269474b879a58269c1bfb28',ramdisk_id='',reservation_id='r-u95j204e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2042231427',owner_user_name='tempest-ServerActionsTestJSON-2042231427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:51:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0059d31539304ffcb5214b408751cd4f',uuid=0cb22a78-94df-49fb-918c-32856e1b5136,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "address": "fa:16:3e:e3:f1:6d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225efc65-26", "ovs_interfaceid": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:51:53 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converting VIF {"id": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "address": "fa:16:3e:e3:f1:6d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225efc65-26", "ovs_interfaceid": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:51:53 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:f1:6d,bridge_name='br-int',has_traffic_filtering=True,id=225efc65-26fe-4d54-93aa-35298d6ddd3f,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225efc65-26') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:51:53 user nova-compute[71557]: DEBUG nova.objects.instance [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'pci_devices' on Instance uuid 0cb22a78-94df-49fb-918c-32856e1b5136 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:51:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:51:53 user nova-compute[71557]:   <uuid>0cb22a78-94df-49fb-918c-32856e1b5136</uuid>
Apr 12 10:51:53 user nova-compute[71557]:   <name>instance-00000025</name>
Apr 12 10:51:53 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:51:53 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:51:53 user nova-compute[71557]:   <metadata>
Apr 12 10:51:53 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:51:53 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:51:53 user nova-compute[71557]:       <nova:name>tempest-ServerActionsTestJSON-server-465944081</nova:name>
Apr 12 10:51:53 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:51:51</nova:creationTime>
Apr 12 10:51:53 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:51:53 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:51:53 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:51:53 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:51:53 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:51:53 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:51:53 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:51:53 user nova-compute[71557]:       <nova:owner>
Apr 12 10:51:53 user nova-compute[71557]:         <nova:user uuid="0059d31539304ffcb5214b408751cd4f">tempest-ServerActionsTestJSON-2042231427-project-member</nova:user>
Apr 12 10:51:53 user nova-compute[71557]:         <nova:project uuid="32235c67d269474b879a58269c1bfb28">tempest-ServerActionsTestJSON-2042231427</nova:project>
Apr 12 10:51:53 user nova-compute[71557]:       </nova:owner>
Apr 12 10:51:53 user nova-compute[71557]:       <nova:ports>
Apr 12 10:51:53 user nova-compute[71557]:         <nova:port uuid="225efc65-26fe-4d54-93aa-35298d6ddd3f">
Apr 12 10:51:53 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 10:51:53 user nova-compute[71557]:         </nova:port>
Apr 12 10:51:53 user nova-compute[71557]:       </nova:ports>
Apr 12 10:51:53 user nova-compute[71557]:     </nova:instance>
Apr 12 10:51:53 user nova-compute[71557]:   </metadata>
Apr 12 10:51:53 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:51:53 user nova-compute[71557]:     <system>
Apr 12 10:51:53 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:51:53 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:51:53 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:51:53 user nova-compute[71557]:       <entry name="serial">0cb22a78-94df-49fb-918c-32856e1b5136</entry>
Apr 12 10:51:53 user nova-compute[71557]:       <entry name="uuid">0cb22a78-94df-49fb-918c-32856e1b5136</entry>
Apr 12 10:51:53 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:51:53 user nova-compute[71557]:     </system>
Apr 12 10:51:53 user nova-compute[71557]:   </sysinfo>
Apr 12 10:51:53 user nova-compute[71557]:   <os>
Apr 12 10:51:53 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:51:53 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:51:53 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:51:53 user nova-compute[71557]:   </os>
Apr 12 10:51:53 user nova-compute[71557]:   <features>
Apr 12 10:51:53 user nova-compute[71557]:     <acpi/>
Apr 12 10:51:53 user nova-compute[71557]:     <apic/>
Apr 12 10:51:53 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:51:53 user nova-compute[71557]:   </features>
Apr 12 10:51:53 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:51:53 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:51:53 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:51:53 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:51:53 user nova-compute[71557]:   </clock>
Apr 12 10:51:53 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:51:53 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:51:53 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:51:53 user nova-compute[71557]:   </cpu>
Apr 12 10:51:53 user nova-compute[71557]:   <devices>
Apr 12 10:51:53 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:51:53 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:51:53 user nova-compute[71557]:       <source dev="/dev/sdd"/>
Apr 12 10:51:53 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:51:53 user nova-compute[71557]:       <serial>aa22aac8-82c0-4487-bc15-af046a4aa2b4</serial>
Apr 12 10:51:53 user nova-compute[71557]:     </disk>
Apr 12 10:51:53 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:51:53 user nova-compute[71557]:       <mac address="fa:16:3e:e3:f1:6d"/>
Apr 12 10:51:53 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:51:53 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:51:53 user nova-compute[71557]:       <target dev="tap225efc65-26"/>
Apr 12 10:51:53 user nova-compute[71557]:     </interface>
Apr 12 10:51:53 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:51:53 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/0cb22a78-94df-49fb-918c-32856e1b5136/console.log" append="off"/>
Apr 12 10:51:53 user nova-compute[71557]:     </serial>
Apr 12 10:51:53 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:51:53 user nova-compute[71557]:     <video>
Apr 12 10:51:53 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:51:53 user nova-compute[71557]:     </video>
Apr 12 10:51:53 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:51:53 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:51:53 user nova-compute[71557]:     </rng>
Apr 12 10:51:53 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:51:53 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:51:53 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:51:53 user nova-compute[71557]:     </memballoon>
Apr 12 10:51:53 user nova-compute[71557]:   </devices>
Apr 12 10:51:53 user nova-compute[71557]: </domain>
Apr 12 10:51:53 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:51:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-465944081',display_name='tempest-ServerActionsTestJSON-server-465944081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-465944081',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSPzZAK4K6WfKgZv6ul+nJ2Lzppw5IMfK0+f9KuGByC6XjA59WQJmgMTCh01/yWlwW8qMjnx6gjYen9tQKzYmdVo3Z1KGqS/wGYHKKDRVeNNONzm9HfPYp2EDH6xyugDA==',key_name='tempest-keypair-1241183546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32235c67d269474b879a58269c1bfb28',ramdisk_id='',reservation_id='r-u95j204e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2042231427',owner_user_name='tempest-ServerActionsTestJSON-2042231427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:51:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0059d31539304ffcb5214b408751cd4f',uuid=0cb22a78-94df-49fb-918c-32856e1b5136,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "address": "fa:16:3e:e3:f1:6d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225efc65-26", "ovs_interfaceid": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:51:53 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converting VIF {"id": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "address": "fa:16:3e:e3:f1:6d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225efc65-26", "ovs_interfaceid": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:51:53 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:f1:6d,bridge_name='br-int',has_traffic_filtering=True,id=225efc65-26fe-4d54-93aa-35298d6ddd3f,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225efc65-26') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:51:53 user nova-compute[71557]: DEBUG os_vif [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:f1:6d,bridge_name='br-int',has_traffic_filtering=True,id=225efc65-26fe-4d54-93aa-35298d6ddd3f,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225efc65-26') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:51:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:51:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:51:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap225efc65-26, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:51:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap225efc65-26, col_values=(('external_ids', {'iface-id': '225efc65-26fe-4d54-93aa-35298d6ddd3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:f1:6d', 'vm-uuid': '0cb22a78-94df-49fb-918c-32856e1b5136'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:51:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:51:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:53 user nova-compute[71557]: INFO os_vif [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:f1:6d,bridge_name='br-int',has_traffic_filtering=True,id=225efc65-26fe-4d54-93aa-35298d6ddd3f,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225efc65-26')
Apr 12 10:51:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:51:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] No VIF found with MAC fa:16:3e:e3:f1:6d, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:51:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:54 user nova-compute[71557]: DEBUG nova.compute.manager [req-7489bf26-60fe-4139-8484-84ca06c43484 req-10eff2ab-0c28-4b84-9338-a0e859af7fea service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Received event network-vif-plugged-225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:51:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7489bf26-60fe-4139-8484-84ca06c43484 req-10eff2ab-0c28-4b84-9338-a0e859af7fea service nova] Acquiring lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7489bf26-60fe-4139-8484-84ca06c43484 req-10eff2ab-0c28-4b84-9338-a0e859af7fea service nova] Lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7489bf26-60fe-4139-8484-84ca06c43484 req-10eff2ab-0c28-4b84-9338-a0e859af7fea service nova] Lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:54 user nova-compute[71557]: DEBUG nova.compute.manager [req-7489bf26-60fe-4139-8484-84ca06c43484 req-10eff2ab-0c28-4b84-9338-a0e859af7fea service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] No waiting events found dispatching network-vif-plugged-225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:51:54 user nova-compute[71557]: WARNING nova.compute.manager [req-7489bf26-60fe-4139-8484-84ca06c43484 req-10eff2ab-0c28-4b84-9338-a0e859af7fea service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Received unexpected event network-vif-plugged-225efc65-26fe-4d54-93aa-35298d6ddd3f for instance with vm_state building and task_state spawning.
Apr 12 10:51:55 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296700.2884705, 76758da6-ef8f-433f-b4e8-8d72f01b6b34 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:51:55 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] VM Stopped (Lifecycle Event)
Apr 12 10:51:55 user nova-compute[71557]: DEBUG nova.compute.manager [None req-e3be5462-452e-4382-9d82-5d502e95649b None None] [instance: 76758da6-ef8f-433f-b4e8-8d72f01b6b34] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:51:56 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296716.500107, 0cb22a78-94df-49fb-918c-32856e1b5136 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:51:56 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] VM Resumed (Lifecycle Event)
Apr 12 10:51:56 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:51:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:51:56 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Instance spawned successfully.
Apr 12 10:51:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:51:56 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:51:56 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:51:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:51:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:51:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:51:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:51:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:51:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:51:56 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:51:56 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296716.5043175, 0cb22a78-94df-49fb-918c-32856e1b5136 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:51:56 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] VM Started (Lifecycle Event)
Apr 12 10:51:56 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:51:56 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:51:56 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:51:56 user nova-compute[71557]: INFO nova.compute.manager [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Took 5.02 seconds to spawn the instance on the hypervisor.
Apr 12 10:51:56 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:51:56 user nova-compute[71557]: INFO nova.compute.manager [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Took 10.15 seconds to build instance.
Apr 12 10:51:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2deffd64-d369-45f4-915a-7338d1ff5af8 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "0cb22a78-94df-49fb-918c-32856e1b5136" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.246s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "0cb22a78-94df-49fb-918c-32856e1b5136" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.199s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:56 user nova-compute[71557]: INFO nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Apr 12 10:51:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "0cb22a78-94df-49fb-918c-32856e1b5136" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:56 user nova-compute[71557]: DEBUG nova.compute.manager [req-cd171b96-10ab-4ef7-ad48-14821f6027bd req-45d7d739-71ea-4fd9-b804-08d7ee5de1c7 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Received event network-vif-plugged-225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:51:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cd171b96-10ab-4ef7-ad48-14821f6027bd req-45d7d739-71ea-4fd9-b804-08d7ee5de1c7 service nova] Acquiring lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:51:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cd171b96-10ab-4ef7-ad48-14821f6027bd req-45d7d739-71ea-4fd9-b804-08d7ee5de1c7 service nova] Lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:51:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cd171b96-10ab-4ef7-ad48-14821f6027bd req-45d7d739-71ea-4fd9-b804-08d7ee5de1c7 service nova] Lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:51:56 user nova-compute[71557]: DEBUG nova.compute.manager [req-cd171b96-10ab-4ef7-ad48-14821f6027bd req-45d7d739-71ea-4fd9-b804-08d7ee5de1c7 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] No waiting events found dispatching network-vif-plugged-225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:51:56 user nova-compute[71557]: WARNING nova.compute.manager [req-cd171b96-10ab-4ef7-ad48-14821f6027bd req-45d7d739-71ea-4fd9-b804-08d7ee5de1c7 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Received unexpected event network-vif-plugged-225efc65-26fe-4d54-93aa-35298d6ddd3f for instance with vm_state active and task_state None.
Apr 12 10:51:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:51:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:52:09 user nova-compute[71557]: INFO nova.compute.manager [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Terminating instance
Apr 12 10:52:09 user nova-compute[71557]: DEBUG nova.compute.manager [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:52:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:09 user nova-compute[71557]: DEBUG nova.compute.manager [req-e5a70629-b694-495d-8fe7-e453e34f6559 req-da6b59f3-f605-4653-b4d7-577e40f3d25d service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Received event network-vif-unplugged-a41db5a9-2805-455d-b27e-72e11d4f1012 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:52:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e5a70629-b694-495d-8fe7-e453e34f6559 req-da6b59f3-f605-4653-b4d7-577e40f3d25d service nova] Acquiring lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e5a70629-b694-495d-8fe7-e453e34f6559 req-da6b59f3-f605-4653-b4d7-577e40f3d25d service nova] Lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-e5a70629-b694-495d-8fe7-e453e34f6559 req-da6b59f3-f605-4653-b4d7-577e40f3d25d service nova] Lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:52:09 user nova-compute[71557]: DEBUG nova.compute.manager [req-e5a70629-b694-495d-8fe7-e453e34f6559 req-da6b59f3-f605-4653-b4d7-577e40f3d25d service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] No waiting events found dispatching network-vif-unplugged-a41db5a9-2805-455d-b27e-72e11d4f1012 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:52:09 user nova-compute[71557]: DEBUG nova.compute.manager [req-e5a70629-b694-495d-8fe7-e453e34f6559 req-da6b59f3-f605-4653-b4d7-577e40f3d25d service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Received event network-vif-unplugged-a41db5a9-2805-455d-b27e-72e11d4f1012 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:52:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:10 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Instance destroyed successfully.
Apr 12 10:52:10 user nova-compute[71557]: DEBUG nova.objects.instance [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'resources' on Instance uuid 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:52:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1221075217',display_name='tempest-AttachVolumeNegativeTest-server-1221075217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1221075217',id=32,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKipfguSd7dc4NJvRPPLP31VOCFOeuF+i2FQp2cShiAg0zxOf24SVoQFQ6OqdsaipYiEQ740XRMxTEXtPJg+qH5uXiKhPPFP26qGzR66QmlrdD5/yTInH56PsjbJixwOyA==',key_name='tempest-keypair-2069030893',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:49:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3cecbfbfd5f42dbb663367f6fbdf3b0',ramdisk_id='',reservation_id='r-d4wcoxo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-249658876',owner_user_name='tempest-AttachVolumeNegativeTest-249658876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:49:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ec47d3cdacb45e5a39509e76b546e34',uuid=82ea43d4-f2b9-4665-b1c9-412367e2b4d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a41db5a9-2805-455d-b27e-72e11d4f1012", "address": "fa:16:3e:48:a4:2f", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41db5a9-28", "ovs_interfaceid": "a41db5a9-2805-455d-b27e-72e11d4f1012", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:52:10 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converting VIF {"id": "a41db5a9-2805-455d-b27e-72e11d4f1012", "address": "fa:16:3e:48:a4:2f", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa41db5a9-28", "ovs_interfaceid": "a41db5a9-2805-455d-b27e-72e11d4f1012", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:52:10 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:a4:2f,bridge_name='br-int',has_traffic_filtering=True,id=a41db5a9-2805-455d-b27e-72e11d4f1012,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa41db5a9-28') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:52:10 user nova-compute[71557]: DEBUG os_vif [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:a4:2f,bridge_name='br-int',has_traffic_filtering=True,id=a41db5a9-2805-455d-b27e-72e11d4f1012,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa41db5a9-28') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:52:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa41db5a9-28, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:52:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:10 user nova-compute[71557]: INFO os_vif [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:a4:2f,bridge_name='br-int',has_traffic_filtering=True,id=a41db5a9-2805-455d-b27e-72e11d4f1012,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa41db5a9-28')
Apr 12 10:52:10 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Deleting instance files /opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7_del
Apr 12 10:52:10 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Deletion of /opt/stack/data/nova/instances/82ea43d4-f2b9-4665-b1c9-412367e2b4d7_del complete
Apr 12 10:52:10 user nova-compute[71557]: INFO nova.compute.manager [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 12 10:52:10 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:52:10 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:52:10 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:52:11 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:52:11 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Took 0.68 seconds to deallocate network for instance.
Apr 12 10:52:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:11 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:52:11 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:52:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:52:11 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Deleted allocations for instance 82ea43d4-f2b9-4665-b1c9-412367e2b4d7
Apr 12 10:52:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-12026dc6-0868-4362-bd3b-2db4fe17e37d tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.186s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:52:11 user nova-compute[71557]: DEBUG nova.compute.manager [req-f33dd160-18cd-4ea6-86df-e910fb380f87 req-4004428e-bd53-446a-ba4a-3ca956e303d7 service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Received event network-vif-plugged-a41db5a9-2805-455d-b27e-72e11d4f1012 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:52:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f33dd160-18cd-4ea6-86df-e910fb380f87 req-4004428e-bd53-446a-ba4a-3ca956e303d7 service nova] Acquiring lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f33dd160-18cd-4ea6-86df-e910fb380f87 req-4004428e-bd53-446a-ba4a-3ca956e303d7 service nova] Lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f33dd160-18cd-4ea6-86df-e910fb380f87 req-4004428e-bd53-446a-ba4a-3ca956e303d7 service nova] Lock "82ea43d4-f2b9-4665-b1c9-412367e2b4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:52:11 user nova-compute[71557]: DEBUG nova.compute.manager [req-f33dd160-18cd-4ea6-86df-e910fb380f87 req-4004428e-bd53-446a-ba4a-3ca956e303d7 service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] No waiting events found dispatching network-vif-plugged-a41db5a9-2805-455d-b27e-72e11d4f1012 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:52:11 user nova-compute[71557]: WARNING nova.compute.manager [req-f33dd160-18cd-4ea6-86df-e910fb380f87 req-4004428e-bd53-446a-ba4a-3ca956e303d7 service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Received unexpected event network-vif-plugged-a41db5a9-2805-455d-b27e-72e11d4f1012 for instance with vm_state deleted and task_state None.
Apr 12 10:52:11 user nova-compute[71557]: DEBUG nova.compute.manager [req-f33dd160-18cd-4ea6-86df-e910fb380f87 req-4004428e-bd53-446a-ba4a-3ca956e303d7 service nova] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Received event network-vif-deleted-a41db5a9-2805-455d-b27e-72e11d4f1012 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:52:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:25 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296730.4011145, 82ea43d4-f2b9-4665-b1c9-412367e2b4d7 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:52:25 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] VM Stopped (Lifecycle Event)
Apr 12 10:52:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ce43b70e-ef26-48d1-91a0-b454da95540a None None] [instance: 82ea43d4-f2b9-4665-b1c9-412367e2b4d7] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:52:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:52:27 user nova-compute[71557]: INFO nova.compute.manager [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Terminating instance
Apr 12 10:52:27 user nova-compute[71557]: DEBUG nova.compute.manager [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG nova.compute.manager [req-25bf1245-d337-4903-ab2f-af7dcf9b3adb req-04ffa8e4-8be5-4a00-8636-b93eae748009 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received event network-vif-unplugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-25bf1245-d337-4903-ab2f-af7dcf9b3adb req-04ffa8e4-8be5-4a00-8636-b93eae748009 service nova] Acquiring lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-25bf1245-d337-4903-ab2f-af7dcf9b3adb req-04ffa8e4-8be5-4a00-8636-b93eae748009 service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-25bf1245-d337-4903-ab2f-af7dcf9b3adb req-04ffa8e4-8be5-4a00-8636-b93eae748009 service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG nova.compute.manager [req-25bf1245-d337-4903-ab2f-af7dcf9b3adb req-04ffa8e4-8be5-4a00-8636-b93eae748009 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] No waiting events found dispatching network-vif-unplugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG nova.compute.manager [req-25bf1245-d337-4903-ab2f-af7dcf9b3adb req-04ffa8e4-8be5-4a00-8636-b93eae748009 service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received event network-vif-unplugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:27 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Instance destroyed successfully.
Apr 12 10:52:27 user nova-compute[71557]: DEBUG nova.objects.instance [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'resources' on Instance uuid 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-432183052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-432183052',id=30,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:48:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3789b59ccc704f86afac83af21fd84f9',ramdisk_id='',reservation_id='r-rqnoyn8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:50:41Z,user_data=None,user_id='ba49b947c74e48f3b161b6f9fce8b1c5',uuid=7ba7c401-554c-4610-b8a3-8cf7e62f8cfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "address": "fa:16:3e:74:b6:77", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ecbe51-c1", "ovs_interfaceid": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converting VIF {"id": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "address": "fa:16:3e:74:b6:77", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ecbe51-c1", "ovs_interfaceid": "48ecbe51-c168-45fd-9029-d5cfa270e5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:b6:77,bridge_name='br-int',has_traffic_filtering=True,id=48ecbe51-c168-45fd-9029-d5cfa270e5c5,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ecbe51-c1') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG os_vif [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:b6:77,bridge_name='br-int',has_traffic_filtering=True,id=48ecbe51-c168-45fd-9029-d5cfa270e5c5,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ecbe51-c1') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48ecbe51-c1, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:52:27 user nova-compute[71557]: INFO os_vif [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:b6:77,bridge_name='br-int',has_traffic_filtering=True,id=48ecbe51-c168-45fd-9029-d5cfa270e5c5,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ecbe51-c1')
Apr 12 10:52:27 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WsBbchPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:52:27 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:52:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[148aad30-4c5a-41be-9d78-4a2c25f5488a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:52:27 user nova-compute[71557]: No targets found.
Apr 12 10:52:27 user nova-compute[71557]: iSNS:
Apr 12 10:52:27 user nova-compute[71557]: No targets found.
Apr 12 10:52:27 user nova-compute[71557]: STATIC:
Apr 12 10:52:27 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:52:27 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:52:27 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:52:27 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8
Apr 12 10:52:27 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:52:27 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:52:27 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36
Apr 12 10:52:27 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:52:27 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:52:27 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d
Apr 12 10:52:27 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:52:27 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:52:27 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4
Apr 12 10:52:27 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:52:27 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:52:27 user nova-compute[71557]: FIRMWARE:
Apr 12 10:52:27 user nova-compute[71557]: No targets found.
Apr 12 10:52:27 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:52:27 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:52:27 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef587f6-99c1-4bcf-9b87-4b0916e7fa30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c6e8c2-54bd-44ea-b90f-ec589820e51b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:52:27 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:52:27 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:52:27 user nova-compute[71557]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d (non-flash)
Apr 12 10:52:27 user nova-compute[71557]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:52:27 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:52:27 user nova-compute[71557]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 (non-flash)
Apr 12 10:52:27 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:52:27 user nova-compute[71557]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d (non-flash)
Apr 12 10:52:27 user nova-compute[71557]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:52:27 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fa4592050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36'): ({'sdh'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Removing single pathed devices sdh {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e840d31-07d5-428b-854d-2c25948ec26a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:52:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a61a32-1b20-4ec0-a4ba-199d56a1cc80]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Flushing IO for device /dev/sdh {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2069fe3-05e4-4157-bf80-f1bd6a745a78]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.038s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a0e7c8-c5ef-40fe-9c18-442b7bcaa470]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] SCSI volumes sdh have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d71980-30cf-4695-8f45-6d644b5681ad]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a432e8-5933-42ee-a4e7-23ed1f892ad3]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36, portal: 172.16.0.220,3260]
Apr 12 10:52:28 user nova-compute[71557]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36, portal: 172.16.0.220,3260] successful.
Apr 12 10:52:28 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a3fe1e-1437-4c58-8c76-d506fbf77a36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[364a26af-3b7d-4322-94e4-83e71422b0d0]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] <== disconnect_volume: return (319ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:52:28 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Deleting instance files /opt/stack/data/nova/instances/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa_del
Apr 12 10:52:28 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Deletion of /opt/stack/data/nova/instances/7ba7c401-554c-4610-b8a3-8cf7e62f8cfa_del complete
Apr 12 10:52:28 user nova-compute[71557]: INFO nova.compute.manager [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 12 10:52:28 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:52:28 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:52:28 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Took 0.45 seconds to deallocate network for instance.
Apr 12 10:52:29 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:52:29 user nova-compute[71557]: DEBUG nova.compute.manager [req-948d322c-927a-4261-8794-71d807885c5d req-24376f0c-e836-47d6-80e0-fa39b8d66a7c service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received event network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:52:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-948d322c-927a-4261-8794-71d807885c5d req-24376f0c-e836-47d6-80e0-fa39b8d66a7c service nova] Acquiring lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-948d322c-927a-4261-8794-71d807885c5d req-24376f0c-e836-47d6-80e0-fa39b8d66a7c service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-948d322c-927a-4261-8794-71d807885c5d req-24376f0c-e836-47d6-80e0-fa39b8d66a7c service nova] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:52:29 user nova-compute[71557]: DEBUG nova.compute.manager [req-948d322c-927a-4261-8794-71d807885c5d req-24376f0c-e836-47d6-80e0-fa39b8d66a7c service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] No waiting events found dispatching network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:52:29 user nova-compute[71557]: WARNING nova.compute.manager [req-948d322c-927a-4261-8794-71d807885c5d req-24376f0c-e836-47d6-80e0-fa39b8d66a7c service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received unexpected event network-vif-plugged-48ecbe51-c168-45fd-9029-d5cfa270e5c5 for instance with vm_state active and task_state deleting.
Apr 12 10:52:29 user nova-compute[71557]: DEBUG nova.compute.manager [req-948d322c-927a-4261-8794-71d807885c5d req-24376f0c-e836-47d6-80e0-fa39b8d66a7c service nova] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Received event network-vif-deleted-48ecbe51-c168-45fd-9029-d5cfa270e5c5 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:52:29 user nova-compute[71557]: INFO nova.compute.manager [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Took 0.75 seconds to detach 1 volumes for instance.
Apr 12 10:52:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:29 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:52:29 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:52:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:52:29 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Deleted allocations for instance 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa
Apr 12 10:52:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6f2f4c91-b5a7-4f88-82f3-c07cf15e3208 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "7ba7c401-554c-4610-b8a3-8cf7e62f8cfa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.041s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:52:30 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:52:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:52:30 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:52:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:52:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:52:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:52:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:52:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:33 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:52:33 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:52:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=7668MB free_disk=26.012779235839844GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:52:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:52:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:52:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:52:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 97bafe22-36bf-4939-baf8-9602551bad52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:52:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:52:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 6b99fe06-9139-4475-aa72-2968a59df0bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:52:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:52:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:52:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance cdc51c71-9d3b-4957-b912-0666c68b46fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:52:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance faa11b52-f2b6-45aa-937f-7468095ddb22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:52:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0cb22a78-94df-49fb-918c-32856e1b5136 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:52:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:52:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:52:33 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Refreshing inventories for resource provider 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 10:52:33 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Updating ProviderTree inventory for provider 24299bcb-a671-492d-9d13-df83697a8f87 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 10:52:33 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Updating inventory in ProviderTree for provider 24299bcb-a671-492d-9d13-df83697a8f87 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 10:52:33 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Refreshing aggregate associations for resource provider 24299bcb-a671-492d-9d13-df83697a8f87, aggregates: None {{(pid=71557) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 10:52:33 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Refreshing trait associations for resource provider 24299bcb-a671-492d-9d13-df83697a8f87, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=71557) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 10:52:33 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:52:33 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:52:34 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:52:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.652s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:52:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:52:35 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:52:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-be3f67e5-420d-42a2-b68a-7cadff22fa48" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:52:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-be3f67e5-420d-42a2-b68a-7cadff22fa48" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:52:35 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:52:35 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Updating instance_info_cache with network_info: [{"id": "943dbed4-3180-4221-b27c-710c0118b7cf", "address": "fa:16:3e:d5:a9:3b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap943dbed4-31", "ovs_interfaceid": "943dbed4-3180-4221-b27c-710c0118b7cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:52:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-be3f67e5-420d-42a2-b68a-7cadff22fa48" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:52:35 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:52:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:52:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:52:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:52:36 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:52:36 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:52:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:52:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:42 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296747.8161986, 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:52:42 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] VM Stopped (Lifecycle Event)
Apr 12 10:52:42 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2d895f6b-dab0-48da-8e90-d98069520077 None None] [instance: 7ba7c401-554c-4610-b8a3-8cf7e62f8cfa] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:52:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:52:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:52:48 user nova-compute[71557]: INFO nova.compute.claims [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Claim successful on node user
Apr 12 10:52:48 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:52:48 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:52:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:52:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:52:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:52:48 user nova-compute[71557]: DEBUG nova.network.neutron [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:52:48 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:52:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:52:48 user nova-compute[71557]: DEBUG nova.policy [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6576467073e41e9b497097d5a8dfd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9878bfe34ceb4a6695b253ad161c4f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:52:49 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Creating image(s)
Apr 12 10:52:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "/opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "/opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "/opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.128s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk 1073741824" returned: 0 in 0.045s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.179s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG nova.network.neutron [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Successfully created port: 8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Cannot resize image /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG nova.objects.instance [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'migration_context' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Ensure instance console log exists: /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.network.neutron [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Successfully updated port: 8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "refresh_cache-2aef35e7-5daf-4d41-b91b-a7ff4a481644" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquired lock "refresh_cache-2aef35e7-5daf-4d41-b91b-a7ff4a481644" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.network.neutron [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.compute.manager [req-66d99d0a-1fe9-4454-81c7-cf9c6582ff92 req-9d137822-b8cb-49af-85b7-b877f59f628b service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received event network-changed-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.compute.manager [req-66d99d0a-1fe9-4454-81c7-cf9c6582ff92 req-9d137822-b8cb-49af-85b7-b877f59f628b service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Refreshing instance network info cache due to event network-changed-8786a087-f036-403b-9b82-c75fc6dbb110. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-66d99d0a-1fe9-4454-81c7-cf9c6582ff92 req-9d137822-b8cb-49af-85b7-b877f59f628b service nova] Acquiring lock "refresh_cache-2aef35e7-5daf-4d41-b91b-a7ff4a481644" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.network.neutron [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.network.neutron [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Updating instance_info_cache with network_info: [{"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Releasing lock "refresh_cache-2aef35e7-5daf-4d41-b91b-a7ff4a481644" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Instance network_info: |[{"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-66d99d0a-1fe9-4454-81c7-cf9c6582ff92 req-9d137822-b8cb-49af-85b7-b877f59f628b service nova] Acquired lock "refresh_cache-2aef35e7-5daf-4d41-b91b-a7ff4a481644" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.network.neutron [req-66d99d0a-1fe9-4454-81c7-cf9c6582ff92 req-9d137822-b8cb-49af-85b7-b877f59f628b service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Refreshing network info cache for port 8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Start _get_guest_xml network_info=[{"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:52:50 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:52:50 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:52:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1710761960',display_name='tempest-AttachVolumeTestJSON-server-1710761960',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1710761960',id=38,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQLwZrl3jPnPhohKnRnR2qfd8ly9sETNwW4CsnbJ63gmB7R0QElmNz5jXYfSBpJs0XqGEZmxFm/4XJScQktvDrpb6FHDkQYZ7pSrXVh9P+kxqpboxMoLpeKxHkx0WwNzw==',key_name='tempest-keypair-1222347782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9878bfe34ceb4a6695b253ad161c4f7b',ramdisk_id='',reservation_id='r-u8xhdlhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1953237893',owner_user_name='tempest-AttachVolumeTestJSON-1953237893-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:52:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6576467073e41e9b497097d5a8dfd3d',uuid=2aef35e7-5daf-4d41-b91b-a7ff4a481644,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converting VIF {"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=8786a087-f036-403b-9b82-c75fc6dbb110,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8786a087-f0') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.objects.instance [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'pci_devices' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:52:50 user nova-compute[71557]:   <uuid>2aef35e7-5daf-4d41-b91b-a7ff4a481644</uuid>
Apr 12 10:52:50 user nova-compute[71557]:   <name>instance-00000026</name>
Apr 12 10:52:50 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:52:50 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:52:50 user nova-compute[71557]:   <metadata>
Apr 12 10:52:50 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:52:50 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:52:50 user nova-compute[71557]:       <nova:name>tempest-AttachVolumeTestJSON-server-1710761960</nova:name>
Apr 12 10:52:50 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:52:50</nova:creationTime>
Apr 12 10:52:50 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:52:50 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:52:50 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:52:50 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:52:50 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:52:50 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:52:50 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:52:50 user nova-compute[71557]:       <nova:owner>
Apr 12 10:52:50 user nova-compute[71557]:         <nova:user uuid="f6576467073e41e9b497097d5a8dfd3d">tempest-AttachVolumeTestJSON-1953237893-project-member</nova:user>
Apr 12 10:52:50 user nova-compute[71557]:         <nova:project uuid="9878bfe34ceb4a6695b253ad161c4f7b">tempest-AttachVolumeTestJSON-1953237893</nova:project>
Apr 12 10:52:50 user nova-compute[71557]:       </nova:owner>
Apr 12 10:52:50 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:52:50 user nova-compute[71557]:       <nova:ports>
Apr 12 10:52:50 user nova-compute[71557]:         <nova:port uuid="8786a087-f036-403b-9b82-c75fc6dbb110">
Apr 12 10:52:50 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 10:52:50 user nova-compute[71557]:         </nova:port>
Apr 12 10:52:50 user nova-compute[71557]:       </nova:ports>
Apr 12 10:52:50 user nova-compute[71557]:     </nova:instance>
Apr 12 10:52:50 user nova-compute[71557]:   </metadata>
Apr 12 10:52:50 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:52:50 user nova-compute[71557]:     <system>
Apr 12 10:52:50 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:52:50 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:52:50 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:52:50 user nova-compute[71557]:       <entry name="serial">2aef35e7-5daf-4d41-b91b-a7ff4a481644</entry>
Apr 12 10:52:50 user nova-compute[71557]:       <entry name="uuid">2aef35e7-5daf-4d41-b91b-a7ff4a481644</entry>
Apr 12 10:52:50 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:52:50 user nova-compute[71557]:     </system>
Apr 12 10:52:50 user nova-compute[71557]:   </sysinfo>
Apr 12 10:52:50 user nova-compute[71557]:   <os>
Apr 12 10:52:50 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:52:50 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:52:50 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:52:50 user nova-compute[71557]:   </os>
Apr 12 10:52:50 user nova-compute[71557]:   <features>
Apr 12 10:52:50 user nova-compute[71557]:     <acpi/>
Apr 12 10:52:50 user nova-compute[71557]:     <apic/>
Apr 12 10:52:50 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:52:50 user nova-compute[71557]:   </features>
Apr 12 10:52:50 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:52:50 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:52:50 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:52:50 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:52:50 user nova-compute[71557]:   </clock>
Apr 12 10:52:50 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:52:50 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:52:50 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:52:50 user nova-compute[71557]:   </cpu>
Apr 12 10:52:50 user nova-compute[71557]:   <devices>
Apr 12 10:52:50 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:52:50 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:52:50 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk"/>
Apr 12 10:52:50 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:52:50 user nova-compute[71557]:     </disk>
Apr 12 10:52:50 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:52:50 user nova-compute[71557]:       <mac address="fa:16:3e:59:45:ef"/>
Apr 12 10:52:50 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:52:50 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:52:50 user nova-compute[71557]:       <target dev="tap8786a087-f0"/>
Apr 12 10:52:50 user nova-compute[71557]:     </interface>
Apr 12 10:52:50 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:52:50 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/console.log" append="off"/>
Apr 12 10:52:50 user nova-compute[71557]:     </serial>
Apr 12 10:52:50 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:52:50 user nova-compute[71557]:     <video>
Apr 12 10:52:50 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:52:50 user nova-compute[71557]:     </video>
Apr 12 10:52:50 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:52:50 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:52:50 user nova-compute[71557]:     </rng>
Apr 12 10:52:50 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:52:50 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:52:50 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:52:50 user nova-compute[71557]:     </memballoon>
Apr 12 10:52:50 user nova-compute[71557]:   </devices>
Apr 12 10:52:50 user nova-compute[71557]: </domain>
Apr 12 10:52:50 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:52:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1710761960',display_name='tempest-AttachVolumeTestJSON-server-1710761960',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1710761960',id=38,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQLwZrl3jPnPhohKnRnR2qfd8ly9sETNwW4CsnbJ63gmB7R0QElmNz5jXYfSBpJs0XqGEZmxFm/4XJScQktvDrpb6FHDkQYZ7pSrXVh9P+kxqpboxMoLpeKxHkx0WwNzw==',key_name='tempest-keypair-1222347782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9878bfe34ceb4a6695b253ad161c4f7b',ramdisk_id='',reservation_id='r-u8xhdlhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1953237893',owner_user_name='tempest-AttachVolumeTestJSON-1953237893-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:52:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6576467073e41e9b497097d5a8dfd3d',uuid=2aef35e7-5daf-4d41-b91b-a7ff4a481644,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converting VIF {"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=8786a087-f036-403b-9b82-c75fc6dbb110,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8786a087-f0') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG os_vif [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=8786a087-f036-403b-9b82-c75fc6dbb110,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8786a087-f0') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8786a087-f0, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8786a087-f0, col_values=(('external_ids', {'iface-id': '8786a087-f036-403b-9b82-c75fc6dbb110', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:45:ef', 'vm-uuid': '2aef35e7-5daf-4d41-b91b-a7ff4a481644'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:50 user nova-compute[71557]: INFO os_vif [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=8786a087-f036-403b-9b82-c75fc6dbb110,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8786a087-f0')
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:52:50 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] No VIF found with MAC fa:16:3e:59:45:ef, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:52:51 user nova-compute[71557]: DEBUG nova.network.neutron [req-66d99d0a-1fe9-4454-81c7-cf9c6582ff92 req-9d137822-b8cb-49af-85b7-b877f59f628b service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Updated VIF entry in instance network info cache for port 8786a087-f036-403b-9b82-c75fc6dbb110. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:52:51 user nova-compute[71557]: DEBUG nova.network.neutron [req-66d99d0a-1fe9-4454-81c7-cf9c6582ff92 req-9d137822-b8cb-49af-85b7-b877f59f628b service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Updating instance_info_cache with network_info: [{"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:52:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-66d99d0a-1fe9-4454-81c7-cf9c6582ff92 req-9d137822-b8cb-49af-85b7-b877f59f628b service nova] Releasing lock "refresh_cache-2aef35e7-5daf-4d41-b91b-a7ff4a481644" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:52:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:52 user nova-compute[71557]: DEBUG nova.compute.manager [req-1fd709b6-4407-49a8-a0ff-64d2d7d4a677 req-0f1cf755-aacb-499f-bdc7-3df356cc936a service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received event network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:52:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-1fd709b6-4407-49a8-a0ff-64d2d7d4a677 req-0f1cf755-aacb-499f-bdc7-3df356cc936a service nova] Acquiring lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-1fd709b6-4407-49a8-a0ff-64d2d7d4a677 req-0f1cf755-aacb-499f-bdc7-3df356cc936a service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-1fd709b6-4407-49a8-a0ff-64d2d7d4a677 req-0f1cf755-aacb-499f-bdc7-3df356cc936a service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:52:52 user nova-compute[71557]: DEBUG nova.compute.manager [req-1fd709b6-4407-49a8-a0ff-64d2d7d4a677 req-0f1cf755-aacb-499f-bdc7-3df356cc936a service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] No waiting events found dispatching network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:52:52 user nova-compute[71557]: WARNING nova.compute.manager [req-1fd709b6-4407-49a8-a0ff-64d2d7d4a677 req-0f1cf755-aacb-499f-bdc7-3df356cc936a service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received unexpected event network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 for instance with vm_state building and task_state spawning.
Apr 12 10:52:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:54 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296774.2639894, 2aef35e7-5daf-4d41-b91b-a7ff4a481644 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:52:54 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] VM Resumed (Lifecycle Event)
Apr 12 10:52:54 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:52:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:52:54 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Instance spawned successfully.
Apr 12 10:52:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:52:54 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:52:54 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:52:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:52:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:52:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:52:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:52:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:52:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:52:54 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:52:54 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296774.2655427, 2aef35e7-5daf-4d41-b91b-a7ff4a481644 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:52:54 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] VM Started (Lifecycle Event)
Apr 12 10:52:54 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:52:54 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:52:54 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:52:54 user nova-compute[71557]: INFO nova.compute.manager [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Took 5.38 seconds to spawn the instance on the hypervisor.
Apr 12 10:52:54 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:52:54 user nova-compute[71557]: DEBUG nova.compute.manager [req-6800f127-3053-4e8b-ac73-a9af75c5d2d1 req-35043720-8d0b-4bd5-89c1-e9bef7473d86 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received event network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:52:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6800f127-3053-4e8b-ac73-a9af75c5d2d1 req-35043720-8d0b-4bd5-89c1-e9bef7473d86 service nova] Acquiring lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6800f127-3053-4e8b-ac73-a9af75c5d2d1 req-35043720-8d0b-4bd5-89c1-e9bef7473d86 service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6800f127-3053-4e8b-ac73-a9af75c5d2d1 req-35043720-8d0b-4bd5-89c1-e9bef7473d86 service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:52:54 user nova-compute[71557]: DEBUG nova.compute.manager [req-6800f127-3053-4e8b-ac73-a9af75c5d2d1 req-35043720-8d0b-4bd5-89c1-e9bef7473d86 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] No waiting events found dispatching network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:52:54 user nova-compute[71557]: WARNING nova.compute.manager [req-6800f127-3053-4e8b-ac73-a9af75c5d2d1 req-35043720-8d0b-4bd5-89c1-e9bef7473d86 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received unexpected event network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 for instance with vm_state building and task_state spawning.
Apr 12 10:52:54 user nova-compute[71557]: INFO nova.compute.manager [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Took 6.12 seconds to build instance.
Apr 12 10:52:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c032ac01-fedf-4afd-8d0e-dbd9794c77c9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.209s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:52:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.007s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:52:56 user nova-compute[71557]: INFO nova.compute.manager [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Terminating instance
Apr 12 10:52:56 user nova-compute[71557]: DEBUG nova.compute.manager [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG nova.compute.manager [req-53f079cf-a552-427e-9612-9ca3011b34e1 req-5ebb3edd-b9c5-4f21-8d12-aebfe6163064 service nova] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Received event network-vif-unplugged-2c64da14-81c7-48d5-b272-2e09127f33fd {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-53f079cf-a552-427e-9612-9ca3011b34e1 req-5ebb3edd-b9c5-4f21-8d12-aebfe6163064 service nova] Acquiring lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-53f079cf-a552-427e-9612-9ca3011b34e1 req-5ebb3edd-b9c5-4f21-8d12-aebfe6163064 service nova] Lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-53f079cf-a552-427e-9612-9ca3011b34e1 req-5ebb3edd-b9c5-4f21-8d12-aebfe6163064 service nova] Lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG nova.compute.manager [req-53f079cf-a552-427e-9612-9ca3011b34e1 req-5ebb3edd-b9c5-4f21-8d12-aebfe6163064 service nova] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] No waiting events found dispatching network-vif-unplugged-2c64da14-81c7-48d5-b272-2e09127f33fd {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG nova.compute.manager [req-53f079cf-a552-427e-9612-9ca3011b34e1 req-5ebb3edd-b9c5-4f21-8d12-aebfe6163064 service nova] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Received event network-vif-unplugged-2c64da14-81c7-48d5-b272-2e09127f33fd for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:57 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Instance destroyed successfully.
Apr 12 10:52:57 user nova-compute[71557]: DEBUG nova.objects.instance [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lazy-loading 'resources' on Instance uuid 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:51:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1490063816',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1490063816',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1490063816',id=34,image_ref='877d5436-0b95-4a8d-a3b4-2f4d4699201a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:51:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a67f3d23b8f74a9496d445c7fc75717e',ramdisk_id='',reservation_id='r-a57zktid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-638607559',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-638607559-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-638607559',owner_user_name='tempest-TestVolumeBootPattern-638607559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:51:24Z,user_data=None,user_id='b914d7ca786f455baf120f98816abffd',uuid=468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c64da14-81c7-48d5-b272-2e09127f33fd", "address": "fa:16:3e:17:f2:80", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c64da14-81", "ovs_interfaceid": "2c64da14-81c7-48d5-b272-2e09127f33fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converting VIF {"id": "2c64da14-81c7-48d5-b272-2e09127f33fd", "address": "fa:16:3e:17:f2:80", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c64da14-81", "ovs_interfaceid": "2c64da14-81c7-48d5-b272-2e09127f33fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:f2:80,bridge_name='br-int',has_traffic_filtering=True,id=2c64da14-81c7-48d5-b272-2e09127f33fd,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c64da14-81') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG os_vif [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:f2:80,bridge_name='br-int',has_traffic_filtering=True,id=2c64da14-81c7-48d5-b272-2e09127f33fd,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c64da14-81') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c64da14-81, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:52:57 user nova-compute[71557]: INFO os_vif [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:f2:80,bridge_name='br-int',has_traffic_filtering=True,id=2c64da14-81c7-48d5-b272-2e09127f33fd,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c64da14-81')
Apr 12 10:52:57 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hAqzuHiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:52:57 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:52:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[933bb44c-8d31-4c22-9838-4398f0f3a291]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:52:57 user nova-compute[71557]: No targets found.
Apr 12 10:52:57 user nova-compute[71557]: iSNS:
Apr 12 10:52:57 user nova-compute[71557]: No targets found.
Apr 12 10:52:57 user nova-compute[71557]: STATIC:
Apr 12 10:52:57 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:52:57 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:52:57 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:52:57 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8
Apr 12 10:52:57 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:52:57 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:52:57 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d
Apr 12 10:52:57 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:52:57 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:52:57 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4
Apr 12 10:52:57 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:52:57 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:52:57 user nova-compute[71557]: FIRMWARE:
Apr 12 10:52:57 user nova-compute[71557]: No targets found.
Apr 12 10:52:57 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:52:57 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:52:57 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[41af8302-5af5-44a3-8048-2f36bbbd553b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f46ad7a-b11f-4f16-b289-4b5a76faaf8a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:52:57 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:52:57 user nova-compute[71557]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d (non-flash)
Apr 12 10:52:57 user nova-compute[71557]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:52:57 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:52:57 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:52:57 user nova-compute[71557]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d (non-flash)
Apr 12 10:52:57 user nova-compute[71557]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:52:57 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd46545e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d'): ({'sde'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Removing single pathed devices sde {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b629e8c-e018-472a-80b6-9fccd6175e4e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ccab27-b19d-4a0d-8de1-b03220561d81]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flushing IO for device /dev/sde {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96542a5-82b5-4bf2-9a67-535b56f6afda]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:52:57 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59e9129-b686-41ee-a725-3f7eb0b9c89b]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] SCSI volumes sde have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[196f5b87-b706-473f-86e8-a23e77af18ff]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b49165-8f8e-475e-ab56-d0f9e60d6e18]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d, portal: 172.16.0.220,3260]
Apr 12 10:52:58 user nova-compute[71557]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d, portal: 172.16.0.220,3260] successful.
Apr 12 10:52:58 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e6dc66f-725e-412b-9d12-c4639c94341d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[460f60ea-b540-40ca-9ddc-d1ea07d93c12]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] <== disconnect_volume: return (357ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:52:58 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Deleting instance files /opt/stack/data/nova/instances/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8_del
Apr 12 10:52:58 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Deletion of /opt/stack/data/nova/instances/468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8_del complete
Apr 12 10:52:58 user nova-compute[71557]: INFO nova.compute.manager [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Took 1.26 seconds to destroy the instance on the hypervisor.
Apr 12 10:52:58 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:52:58 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Took 0.47 seconds to deallocate network for instance.
Apr 12 10:52:58 user nova-compute[71557]: DEBUG nova.compute.manager [req-234bd7ed-d2f2-4a4c-a907-7f4bd2e6af93 req-f5167207-5308-40f6-a08e-d0e959fba10d service nova] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Received event network-vif-deleted-2c64da14-81c7-48d5-b272-2e09127f33fd {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:52:58 user nova-compute[71557]: INFO nova.compute.manager [req-234bd7ed-d2f2-4a4c-a907-7f4bd2e6af93 req-f5167207-5308-40f6-a08e-d0e959fba10d service nova] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Neutron deleted interface 2c64da14-81c7-48d5-b272-2e09127f33fd; detaching it from the instance and deleting it from the info cache
Apr 12 10:52:58 user nova-compute[71557]: DEBUG nova.network.neutron [req-234bd7ed-d2f2-4a4c-a907-7f4bd2e6af93 req-f5167207-5308-40f6-a08e-d0e959fba10d service nova] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:52:58 user nova-compute[71557]: DEBUG nova.compute.manager [req-234bd7ed-d2f2-4a4c-a907-7f4bd2e6af93 req-f5167207-5308-40f6-a08e-d0e959fba10d service nova] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Detach interface failed, port_id=2c64da14-81c7-48d5-b272-2e09127f33fd, reason: Instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 could not be found. {{(pid=71557) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 10:52:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:52:59 user nova-compute[71557]: DEBUG nova.compute.manager [req-c36b497a-9296-4255-ab57-7b847e8a588e req-395fa113-de94-4783-a197-7cf873286edd service nova] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Received event network-vif-plugged-2c64da14-81c7-48d5-b272-2e09127f33fd {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:52:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c36b497a-9296-4255-ab57-7b847e8a588e req-395fa113-de94-4783-a197-7cf873286edd service nova] Acquiring lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c36b497a-9296-4255-ab57-7b847e8a588e req-395fa113-de94-4783-a197-7cf873286edd service nova] Lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c36b497a-9296-4255-ab57-7b847e8a588e req-395fa113-de94-4783-a197-7cf873286edd service nova] Lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:52:59 user nova-compute[71557]: DEBUG nova.compute.manager [req-c36b497a-9296-4255-ab57-7b847e8a588e req-395fa113-de94-4783-a197-7cf873286edd service nova] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] No waiting events found dispatching network-vif-plugged-2c64da14-81c7-48d5-b272-2e09127f33fd {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:52:59 user nova-compute[71557]: WARNING nova.compute.manager [req-c36b497a-9296-4255-ab57-7b847e8a588e req-395fa113-de94-4783-a197-7cf873286edd service nova] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Received unexpected event network-vif-plugged-2c64da14-81c7-48d5-b272-2e09127f33fd for instance with vm_state active and task_state deleting.
Apr 12 10:52:59 user nova-compute[71557]: INFO nova.compute.manager [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Took 0.77 seconds to detach 1 volumes for instance.
Apr 12 10:52:59 user nova-compute[71557]: DEBUG nova.compute.manager [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Deleting volume: 5e6dc66f-725e-412b-9d12-c4639c94341d {{(pid=71557) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 10:52:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:52:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:52:59 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:52:59 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:53:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:00 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Deleted allocations for instance 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8
Apr 12 10:53:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b994176a-78c1-4303-94de-226e94fc7d15 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.200s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "cdc51c71-9d3b-4957-b912-0666c68b46fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG nova.objects.instance [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lazy-loading 'flavor' on Instance uuid cdc51c71-9d3b-4957-b912-0666c68b46fc {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "cdc51c71-9d3b-4957-b912-0666c68b46fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:01 user nova-compute[71557]: INFO nova.compute.manager [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Attaching volume ab32971b-fad9-41b7-8447-224947e10d53 to /dev/vdb
Apr 12 10:53:01 user nova-compute[71557]: DEBUG os_brick.utils [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c482ba-470f-4871-bf61-39eceb2d5df9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5e4671-3b2c-481c-82b7-2fc1cecd2766]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[908eda23-fcac-4129-a032-eac0c6b78e71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b225868-1f6e-4b0a-9803-685c5efa3b01]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:53:01 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:53:01 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91aeb36-7783-4f74-920f-9b74ed78bc37]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG os_brick.utils [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:53:01 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Updating existing volume attachment record: 87a5d36f-b396-4892-902f-6394532a99d2 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:53:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:03 user nova-compute[71557]: DEBUG nova.compute.manager [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:53:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:03 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:53:03 user nova-compute[71557]: INFO nova.compute.claims [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Claim successful on node user
Apr 12 10:53:04 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG nova.compute.manager [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG nova.compute.manager [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG nova.network.neutron [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:53:04 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:53:04 user nova-compute[71557]: DEBUG nova.compute.manager [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG nova.policy [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ec47d3cdacb45e5a39509e76b546e34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cecbfbfd5f42dbb663367f6fbdf3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG nova.compute.manager [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:53:04 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Creating image(s)
Apr 12 10:53:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "/opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "/opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/disk 1073741824" returned: 0 in 0.051s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.150s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG nova.network.neutron [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Successfully created port: 4372d146-13c3-4479-84ba-bdf514061696 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Cannot resize image /opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG nova.objects.instance [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'migration_context' on Instance uuid fcd57d3d-16cb-4b4e-8785-ae15027621a5 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Ensure instance console log exists: /opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:05 user nova-compute[71557]: DEBUG nova.network.neutron [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Successfully updated port: 4372d146-13c3-4479-84ba-bdf514061696 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:53:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "refresh_cache-fcd57d3d-16cb-4b4e-8785-ae15027621a5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:53:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquired lock "refresh_cache-fcd57d3d-16cb-4b4e-8785-ae15027621a5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:53:05 user nova-compute[71557]: DEBUG nova.network.neutron [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:53:05 user nova-compute[71557]: DEBUG nova.compute.manager [req-6f00677d-4dce-4058-8d2c-f2ad9573c33b req-c713e4ea-e1ab-4207-916a-c4a60f395c16 service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Received event network-changed-4372d146-13c3-4479-84ba-bdf514061696 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:05 user nova-compute[71557]: DEBUG nova.compute.manager [req-6f00677d-4dce-4058-8d2c-f2ad9573c33b req-c713e4ea-e1ab-4207-916a-c4a60f395c16 service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Refreshing instance network info cache due to event network-changed-4372d146-13c3-4479-84ba-bdf514061696. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:53:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6f00677d-4dce-4058-8d2c-f2ad9573c33b req-c713e4ea-e1ab-4207-916a-c4a60f395c16 service nova] Acquiring lock "refresh_cache-fcd57d3d-16cb-4b4e-8785-ae15027621a5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:53:05 user nova-compute[71557]: DEBUG nova.network.neutron [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUgJYjmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:53:06 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:53:06 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:53:06 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[260f4367-2df2-423c-b447-86cabb1e3275]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:53:06 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7c57f5-e8cf-43f7-a5de-cda86628c8da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53] added
Apr 12 10:53:06 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8112d48b-fa96-4ff1-ae29-fe8537c085eb]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ce4bd5-01dd-4614-b036-4767bb3918bd]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hUgJYjmE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hUgJYjmE" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6709ca7f-054a-47e9-b76e-201a4fc4a184]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hUgJYjmE'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d302df86-fe90-4ca3-a075-2acb226996d2]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[71538544-faf5-4928-8cd7-2e042305f8ee]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:53:06 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:53:06 user nova-compute[71557]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:53:06 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:53:06 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:53:06 user nova-compute[71557]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:53:06 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[348bdfc4-9244-4b74-b918-d870b40a0dbd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53, portal: 172.16.0.220,3260]
Apr 12 10:53:06 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53, portal: 172.16.0.220,3260] successful.
Apr 12 10:53:06 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d738d5-37e9-43fc-9269-100e2ab8d874]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f474c0ab-68e8-4119-8c67-218968eb4e1b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:53:06 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:53:06 user nova-compute[71557]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:53:06 user nova-compute[71557]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:53:06 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:53:06 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:53:06 user nova-compute[71557]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:53:06 user nova-compute[71557]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:53:06 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7b903c-9469-4697-9dfe-030e12ae115e]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUgJYjmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.network.neutron [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Updating instance_info_cache with network_info: [{"id": "4372d146-13c3-4479-84ba-bdf514061696", "address": "fa:16:3e:9a:98:b5", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4372d146-13", "ovs_interfaceid": "4372d146-13c3-4479-84ba-bdf514061696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Releasing lock "refresh_cache-fcd57d3d-16cb-4b4e-8785-ae15027621a5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.compute.manager [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Instance network_info: |[{"id": "4372d146-13c3-4479-84ba-bdf514061696", "address": "fa:16:3e:9a:98:b5", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4372d146-13", "ovs_interfaceid": "4372d146-13c3-4479-84ba-bdf514061696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6f00677d-4dce-4058-8d2c-f2ad9573c33b req-c713e4ea-e1ab-4207-916a-c4a60f395c16 service nova] Acquired lock "refresh_cache-fcd57d3d-16cb-4b4e-8785-ae15027621a5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.network.neutron [req-6f00677d-4dce-4058-8d2c-f2ad9573c33b req-c713e4ea-e1ab-4207-916a-c4a60f395c16 service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Refreshing network info cache for port 4372d146-13c3-4479-84ba-bdf514061696 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Start _get_guest_xml network_info=[{"id": "4372d146-13c3-4479-84ba-bdf514061696", "address": "fa:16:3e:9a:98:b5", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4372d146-13", "ovs_interfaceid": "4372d146-13c3-4479-84ba-bdf514061696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:53:06 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:53:06 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1560426502',display_name='tempest-AttachVolumeNegativeTest-server-1560426502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1560426502',id=39,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+hB5VUXtE8B/YaMiFQ2YUKHLAghyGHpe7cu33U+wTFBemejCfwunXyySeBzqPTLAjvTdvbP0Krte07gGPW8AcjjlLUZvUIYG48wpov2PrAl8Hw38NY5EVmxBCiRNse7Q==',key_name='tempest-keypair-1567303486',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3cecbfbfd5f42dbb663367f6fbdf3b0',ramdisk_id='',reservation_id='r-hluh7l0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-249658876',owner_user_name='tempest-AttachVolumeNegativeTest-249658876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ec47d3cdacb45e5a39509e76b546e34',uuid=fcd57d3d-16cb-4b4e-8785-ae15027621a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4372d146-13c3-4479-84ba-bdf514061696", "address": "fa:16:3e:9a:98:b5", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4372d146-13", "ovs_interfaceid": "4372d146-13c3-4479-84ba-bdf514061696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converting VIF {"id": "4372d146-13c3-4479-84ba-bdf514061696", "address": "fa:16:3e:9a:98:b5", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4372d146-13", "ovs_interfaceid": "4372d146-13c3-4479-84ba-bdf514061696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:98:b5,bridge_name='br-int',has_traffic_filtering=True,id=4372d146-13c3-4479-84ba-bdf514061696,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4372d146-13') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.objects.instance [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'pci_devices' on Instance uuid fcd57d3d-16cb-4b4e-8785-ae15027621a5 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:53:06 user nova-compute[71557]:   <uuid>fcd57d3d-16cb-4b4e-8785-ae15027621a5</uuid>
Apr 12 10:53:06 user nova-compute[71557]:   <name>instance-00000027</name>
Apr 12 10:53:06 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:53:06 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:53:06 user nova-compute[71557]:   <metadata>
Apr 12 10:53:06 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:53:06 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:53:06 user nova-compute[71557]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1560426502</nova:name>
Apr 12 10:53:06 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:53:06</nova:creationTime>
Apr 12 10:53:06 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:53:06 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:53:06 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:53:06 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:53:06 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:53:06 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:53:06 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:53:06 user nova-compute[71557]:       <nova:owner>
Apr 12 10:53:06 user nova-compute[71557]:         <nova:user uuid="7ec47d3cdacb45e5a39509e76b546e34">tempest-AttachVolumeNegativeTest-249658876-project-member</nova:user>
Apr 12 10:53:06 user nova-compute[71557]:         <nova:project uuid="c3cecbfbfd5f42dbb663367f6fbdf3b0">tempest-AttachVolumeNegativeTest-249658876</nova:project>
Apr 12 10:53:06 user nova-compute[71557]:       </nova:owner>
Apr 12 10:53:06 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:53:06 user nova-compute[71557]:       <nova:ports>
Apr 12 10:53:06 user nova-compute[71557]:         <nova:port uuid="4372d146-13c3-4479-84ba-bdf514061696">
Apr 12 10:53:06 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 10:53:06 user nova-compute[71557]:         </nova:port>
Apr 12 10:53:06 user nova-compute[71557]:       </nova:ports>
Apr 12 10:53:06 user nova-compute[71557]:     </nova:instance>
Apr 12 10:53:06 user nova-compute[71557]:   </metadata>
Apr 12 10:53:06 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:53:06 user nova-compute[71557]:     <system>
Apr 12 10:53:06 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:53:06 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:53:06 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:53:06 user nova-compute[71557]:       <entry name="serial">fcd57d3d-16cb-4b4e-8785-ae15027621a5</entry>
Apr 12 10:53:06 user nova-compute[71557]:       <entry name="uuid">fcd57d3d-16cb-4b4e-8785-ae15027621a5</entry>
Apr 12 10:53:06 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:53:06 user nova-compute[71557]:     </system>
Apr 12 10:53:06 user nova-compute[71557]:   </sysinfo>
Apr 12 10:53:06 user nova-compute[71557]:   <os>
Apr 12 10:53:06 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:53:06 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:53:06 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:53:06 user nova-compute[71557]:   </os>
Apr 12 10:53:06 user nova-compute[71557]:   <features>
Apr 12 10:53:06 user nova-compute[71557]:     <acpi/>
Apr 12 10:53:06 user nova-compute[71557]:     <apic/>
Apr 12 10:53:06 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:53:06 user nova-compute[71557]:   </features>
Apr 12 10:53:06 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:53:06 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:53:06 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:53:06 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:53:06 user nova-compute[71557]:   </clock>
Apr 12 10:53:06 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:53:06 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:53:06 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:53:06 user nova-compute[71557]:   </cpu>
Apr 12 10:53:06 user nova-compute[71557]:   <devices>
Apr 12 10:53:06 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:53:06 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:53:06 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/disk"/>
Apr 12 10:53:06 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:53:06 user nova-compute[71557]:     </disk>
Apr 12 10:53:06 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:53:06 user nova-compute[71557]:       <mac address="fa:16:3e:9a:98:b5"/>
Apr 12 10:53:06 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:53:06 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:53:06 user nova-compute[71557]:       <target dev="tap4372d146-13"/>
Apr 12 10:53:06 user nova-compute[71557]:     </interface>
Apr 12 10:53:06 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:53:06 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/console.log" append="off"/>
Apr 12 10:53:06 user nova-compute[71557]:     </serial>
Apr 12 10:53:06 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:53:06 user nova-compute[71557]:     <video>
Apr 12 10:53:06 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:53:06 user nova-compute[71557]:     </video>
Apr 12 10:53:06 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:53:06 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:53:06 user nova-compute[71557]:     </rng>
Apr 12 10:53:06 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:53:06 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:53:06 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:53:06 user nova-compute[71557]:     </memballoon>
Apr 12 10:53:06 user nova-compute[71557]:   </devices>
Apr 12 10:53:06 user nova-compute[71557]: </domain>
Apr 12 10:53:06 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1560426502',display_name='tempest-AttachVolumeNegativeTest-server-1560426502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1560426502',id=39,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+hB5VUXtE8B/YaMiFQ2YUKHLAghyGHpe7cu33U+wTFBemejCfwunXyySeBzqPTLAjvTdvbP0Krte07gGPW8AcjjlLUZvUIYG48wpov2PrAl8Hw38NY5EVmxBCiRNse7Q==',key_name='tempest-keypair-1567303486',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3cecbfbfd5f42dbb663367f6fbdf3b0',ramdisk_id='',reservation_id='r-hluh7l0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-249658876',owner_user_name='tempest-AttachVolumeNegativeTest-249658876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ec47d3cdacb45e5a39509e76b546e34',uuid=fcd57d3d-16cb-4b4e-8785-ae15027621a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4372d146-13c3-4479-84ba-bdf514061696", "address": "fa:16:3e:9a:98:b5", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4372d146-13", "ovs_interfaceid": "4372d146-13c3-4479-84ba-bdf514061696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converting VIF {"id": "4372d146-13c3-4479-84ba-bdf514061696", "address": "fa:16:3e:9a:98:b5", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4372d146-13", "ovs_interfaceid": "4372d146-13c3-4479-84ba-bdf514061696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:98:b5,bridge_name='br-int',has_traffic_filtering=True,id=4372d146-13c3-4479-84ba-bdf514061696,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4372d146-13') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG os_vif [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:98:b5,bridge_name='br-int',has_traffic_filtering=True,id=4372d146-13c3-4479-84ba-bdf514061696,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4372d146-13') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4372d146-13, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4372d146-13, col_values=(('external_ids', {'iface-id': '4372d146-13c3-4479-84ba-bdf514061696', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:98:b5', 'vm-uuid': 'fcd57d3d-16cb-4b4e-8785-ae15027621a5'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:06 user nova-compute[71557]: INFO os_vif [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:98:b5,bridge_name='br-int',has_traffic_filtering=True,id=4372d146-13c3-4479-84ba-bdf514061696,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4372d146-13')
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:53:06 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] No VIF found with MAC fa:16:3e:9a:98:b5, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:53:07 user nova-compute[71557]: DEBUG nova.network.neutron [req-6f00677d-4dce-4058-8d2c-f2ad9573c33b req-c713e4ea-e1ab-4207-916a-c4a60f395c16 service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Updated VIF entry in instance network info cache for port 4372d146-13c3-4479-84ba-bdf514061696. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:53:07 user nova-compute[71557]: DEBUG nova.network.neutron [req-6f00677d-4dce-4058-8d2c-f2ad9573c33b req-c713e4ea-e1ab-4207-916a-c4a60f395c16 service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Updating instance_info_cache with network_info: [{"id": "4372d146-13c3-4479-84ba-bdf514061696", "address": "fa:16:3e:9a:98:b5", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4372d146-13", "ovs_interfaceid": "4372d146-13c3-4479-84ba-bdf514061696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:53:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6f00677d-4dce-4058-8d2c-f2ad9573c33b req-c713e4ea-e1ab-4207-916a-c4a60f395c16 service nova] Releasing lock "refresh_cache-fcd57d3d-16cb-4b4e-8785-ae15027621a5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:53:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:53:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26432636438356532', 'path': '/dev/sde'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:53:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432636438356532', 'path': '/dev/sde'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:53:07 user nova-compute[71557]: DEBUG nova.objects.instance [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lazy-loading 'flavor' on Instance uuid cdc51c71-9d3b-4957-b912-0666c68b46fc {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:53:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 10:53:07 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:53:07 user nova-compute[71557]:   <source dev="/dev/sde"/>
Apr 12 10:53:07 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:53:07 user nova-compute[71557]:   <serial>ab32971b-fad9-41b7-8447-224947e10d53</serial>
Apr 12 10:53:07 user nova-compute[71557]: </disk>
Apr 12 10:53:07 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 10:53:08 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:53:08 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:53:08 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] No VIF found with MAC fa:16:3e:c3:0b:b8, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:53:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6b68324b-dc67-41e1-8620-12b0171732df tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.660s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:08 user nova-compute[71557]: DEBUG nova.compute.manager [req-bdc42e64-2e35-4862-83da-7ac1dc10b9b2 req-4a5cb70c-1837-437d-913a-13025e7508e0 service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Received event network-vif-plugged-4372d146-13c3-4479-84ba-bdf514061696 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bdc42e64-2e35-4862-83da-7ac1dc10b9b2 req-4a5cb70c-1837-437d-913a-13025e7508e0 service nova] Acquiring lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bdc42e64-2e35-4862-83da-7ac1dc10b9b2 req-4a5cb70c-1837-437d-913a-13025e7508e0 service nova] Lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bdc42e64-2e35-4862-83da-7ac1dc10b9b2 req-4a5cb70c-1837-437d-913a-13025e7508e0 service nova] Lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:08 user nova-compute[71557]: DEBUG nova.compute.manager [req-bdc42e64-2e35-4862-83da-7ac1dc10b9b2 req-4a5cb70c-1837-437d-913a-13025e7508e0 service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] No waiting events found dispatching network-vif-plugged-4372d146-13c3-4479-84ba-bdf514061696 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:53:08 user nova-compute[71557]: WARNING nova.compute.manager [req-bdc42e64-2e35-4862-83da-7ac1dc10b9b2 req-4a5cb70c-1837-437d-913a-13025e7508e0 service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Received unexpected event network-vif-plugged-4372d146-13c3-4479-84ba-bdf514061696 for instance with vm_state building and task_state spawning.
Apr 12 10:53:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:10 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296790.5123289, fcd57d3d-16cb-4b4e-8785-ae15027621a5 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:53:10 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] VM Resumed (Lifecycle Event)
Apr 12 10:53:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:53:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:53:10 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Instance spawned successfully.
Apr 12 10:53:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:53:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:53:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:53:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:53:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:53:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:53:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:53:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:53:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:53:10 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:53:10 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296790.5174818, fcd57d3d-16cb-4b4e-8785-ae15027621a5 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:53:10 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] VM Started (Lifecycle Event)
Apr 12 10:53:10 user nova-compute[71557]: DEBUG nova.compute.manager [req-411ff742-6240-485f-ad32-8957783cd151 req-0346ccac-0a64-4d34-bf94-8281f4e3693c service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Received event network-vif-plugged-4372d146-13c3-4479-84ba-bdf514061696 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-411ff742-6240-485f-ad32-8957783cd151 req-0346ccac-0a64-4d34-bf94-8281f4e3693c service nova] Acquiring lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-411ff742-6240-485f-ad32-8957783cd151 req-0346ccac-0a64-4d34-bf94-8281f4e3693c service nova] Lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-411ff742-6240-485f-ad32-8957783cd151 req-0346ccac-0a64-4d34-bf94-8281f4e3693c service nova] Lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:10 user nova-compute[71557]: DEBUG nova.compute.manager [req-411ff742-6240-485f-ad32-8957783cd151 req-0346ccac-0a64-4d34-bf94-8281f4e3693c service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] No waiting events found dispatching network-vif-plugged-4372d146-13c3-4479-84ba-bdf514061696 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:53:10 user nova-compute[71557]: WARNING nova.compute.manager [req-411ff742-6240-485f-ad32-8957783cd151 req-0346ccac-0a64-4d34-bf94-8281f4e3693c service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Received unexpected event network-vif-plugged-4372d146-13c3-4479-84ba-bdf514061696 for instance with vm_state building and task_state spawning.
Apr 12 10:53:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:53:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:53:10 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:53:10 user nova-compute[71557]: INFO nova.compute.manager [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Took 6.37 seconds to spawn the instance on the hypervisor.
Apr 12 10:53:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:53:10 user nova-compute[71557]: INFO nova.compute.manager [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Took 7.14 seconds to build instance.
Apr 12 10:53:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-565db4a2-428e-4a42-9201-912122a0e06c tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.236s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:11 user nova-compute[71557]: DEBUG nova.compute.manager [req-b8074d23-ce08-4928-897a-df5fc3e11f84 req-5ea802fc-e34b-4a82-b09f-9a5946b5d732 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received event network-changed-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:11 user nova-compute[71557]: DEBUG nova.compute.manager [req-b8074d23-ce08-4928-897a-df5fc3e11f84 req-5ea802fc-e34b-4a82-b09f-9a5946b5d732 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Refreshing instance network info cache due to event network-changed-46213af2-2a93-4502-9f35-eda3d5b9f7fc. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:53:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b8074d23-ce08-4928-897a-df5fc3e11f84 req-5ea802fc-e34b-4a82-b09f-9a5946b5d732 service nova] Acquiring lock "refresh_cache-faa11b52-f2b6-45aa-937f-7468095ddb22" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:53:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b8074d23-ce08-4928-897a-df5fc3e11f84 req-5ea802fc-e34b-4a82-b09f-9a5946b5d732 service nova] Acquired lock "refresh_cache-faa11b52-f2b6-45aa-937f-7468095ddb22" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:53:11 user nova-compute[71557]: DEBUG nova.network.neutron [req-b8074d23-ce08-4928-897a-df5fc3e11f84 req-5ea802fc-e34b-4a82-b09f-9a5946b5d732 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Refreshing network info cache for port 46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "faa11b52-f2b6-45aa-937f-7468095ddb22" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG nova.objects.instance [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'flavor' on Instance uuid faa11b52-f2b6-45aa-937f-7468095ddb22 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "faa11b52-f2b6-45aa-937f-7468095ddb22" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:12 user nova-compute[71557]: INFO nova.compute.manager [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Attaching volume e7d3b210-cbed-4d4a-8f47-f68cd0560193 to /dev/vdb
Apr 12 10:53:12 user nova-compute[71557]: DEBUG os_brick.utils [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf46685-7648-49ab-b7be-ec9768c5205e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbce0fc1-b4db-4af1-8607-4cd9ffa6382b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG nova.network.neutron [req-b8074d23-ce08-4928-897a-df5fc3e11f84 req-5ea802fc-e34b-4a82-b09f-9a5946b5d732 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Updated VIF entry in instance network info cache for port 46213af2-2a93-4502-9f35-eda3d5b9f7fc. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG nova.network.neutron [req-b8074d23-ce08-4928-897a-df5fc3e11f84 req-5ea802fc-e34b-4a82-b09f-9a5946b5d732 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Updating instance_info_cache with network_info: [{"id": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "address": "fa:16:3e:c9:da:1c", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46213af2-2a", "ovs_interfaceid": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6c40e2-c49a-43eb-baba-5701f882ca4d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed93313-997b-4363-bd9d-b4cb6e2a4c52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b8074d23-ce08-4928-897a-df5fc3e11f84 req-5ea802fc-e34b-4a82-b09f-9a5946b5d732 service nova] Releasing lock "refresh_cache-faa11b52-f2b6-45aa-937f-7468095ddb22" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:53:12 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[09082363-a31e-4bb8-ae8a-5ed520c43649]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG os_brick.utils [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Updating existing volume attachment record: 61e18a6e-c8dd-4d20-b219-6e5308cdb54c {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-21b48b0a-9860-4d86-8402-4a6eb4e140ba req-7673f42c-e067-4a17-890a-c3e3c93f6e77 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Received event network-changed-66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-21b48b0a-9860-4d86-8402-4a6eb4e140ba req-7673f42c-e067-4a17-890a-c3e3c93f6e77 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Refreshing instance network info cache due to event network-changed-66db319f-02d8-4e75-b71a-2b2d136671a9. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-21b48b0a-9860-4d86-8402-4a6eb4e140ba req-7673f42c-e067-4a17-890a-c3e3c93f6e77 service nova] Acquiring lock "refresh_cache-cdc51c71-9d3b-4957-b912-0666c68b46fc" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-21b48b0a-9860-4d86-8402-4a6eb4e140ba req-7673f42c-e067-4a17-890a-c3e3c93f6e77 service nova] Acquired lock "refresh_cache-cdc51c71-9d3b-4957-b912-0666c68b46fc" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG nova.network.neutron [req-21b48b0a-9860-4d86-8402-4a6eb4e140ba req-7673f42c-e067-4a17-890a-c3e3c93f6e77 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Refreshing network info cache for port 66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:53:12 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296777.7800503, 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:53:12 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] VM Stopped (Lifecycle Event)
Apr 12 10:53:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f0ecf5e9-72ef-4086-9dda-d3b41811154a None None] [instance: 468bc1a7-fbb4-4ff1-b2b4-099d9d3d29e8] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:53:13 user nova-compute[71557]: DEBUG nova.network.neutron [req-21b48b0a-9860-4d86-8402-4a6eb4e140ba req-7673f42c-e067-4a17-890a-c3e3c93f6e77 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Updated VIF entry in instance network info cache for port 66db319f-02d8-4e75-b71a-2b2d136671a9. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:53:13 user nova-compute[71557]: DEBUG nova.network.neutron [req-21b48b0a-9860-4d86-8402-4a6eb4e140ba req-7673f42c-e067-4a17-890a-c3e3c93f6e77 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Updating instance_info_cache with network_info: [{"id": "66db319f-02d8-4e75-b71a-2b2d136671a9", "address": "fa:16:3e:c3:0b:b8", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66db319f-02", "ovs_interfaceid": "66db319f-02d8-4e75-b71a-2b2d136671a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:53:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-21b48b0a-9860-4d86-8402-4a6eb4e140ba req-7673f42c-e067-4a17-890a-c3e3c93f6e77 service nova] Releasing lock "refresh_cache-cdc51c71-9d3b-4957-b912-0666c68b46fc" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:53:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-39c228d6-6e6c-4c07-a14c-4622602c0afd tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "cdc51c71-9d3b-4957-b912-0666c68b46fc" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-39c228d6-6e6c-4c07-a14c-4622602c0afd tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:14 user nova-compute[71557]: INFO nova.compute.manager [None req-39c228d6-6e6c-4c07-a14c-4622602c0afd tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Rebooting instance
Apr 12 10:53:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-39c228d6-6e6c-4c07-a14c-4622602c0afd tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "refresh_cache-cdc51c71-9d3b-4957-b912-0666c68b46fc" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:53:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-39c228d6-6e6c-4c07-a14c-4622602c0afd tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquired lock "refresh_cache-cdc51c71-9d3b-4957-b912-0666c68b46fc" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:53:14 user nova-compute[71557]: DEBUG nova.network.neutron [None req-39c228d6-6e6c-4c07-a14c-4622602c0afd tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:53:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-f9742d66-668e-4f0f-92ac-843a414b61e3 req-73dba2ae-f4f8-4dbf-8acc-1728ac8d6d5b service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Received event network-changed-66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-f9742d66-668e-4f0f-92ac-843a414b61e3 req-73dba2ae-f4f8-4dbf-8acc-1728ac8d6d5b service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Refreshing instance network info cache due to event network-changed-66db319f-02d8-4e75-b71a-2b2d136671a9. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:53:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f9742d66-668e-4f0f-92ac-843a414b61e3 req-73dba2ae-f4f8-4dbf-8acc-1728ac8d6d5b service nova] Acquiring lock "refresh_cache-cdc51c71-9d3b-4957-b912-0666c68b46fc" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:53:14 user nova-compute[71557]: DEBUG nova.network.neutron [None req-39c228d6-6e6c-4c07-a14c-4622602c0afd tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Updating instance_info_cache with network_info: [{"id": "66db319f-02d8-4e75-b71a-2b2d136671a9", "address": "fa:16:3e:c3:0b:b8", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66db319f-02", "ovs_interfaceid": "66db319f-02d8-4e75-b71a-2b2d136671a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:53:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-39c228d6-6e6c-4c07-a14c-4622602c0afd tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Releasing lock "refresh_cache-cdc51c71-9d3b-4957-b912-0666c68b46fc" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:53:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f9742d66-668e-4f0f-92ac-843a414b61e3 req-73dba2ae-f4f8-4dbf-8acc-1728ac8d6d5b service nova] Acquired lock "refresh_cache-cdc51c71-9d3b-4957-b912-0666c68b46fc" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:53:14 user nova-compute[71557]: DEBUG nova.network.neutron [req-f9742d66-668e-4f0f-92ac-843a414b61e3 req-73dba2ae-f4f8-4dbf-8acc-1728ac8d6d5b service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Refreshing network info cache for port 66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:53:14 user nova-compute[71557]: DEBUG nova.compute.manager [None req-39c228d6-6e6c-4c07-a14c-4622602c0afd tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:53:15 user nova-compute[71557]: DEBUG nova.network.neutron [req-f9742d66-668e-4f0f-92ac-843a414b61e3 req-73dba2ae-f4f8-4dbf-8acc-1728ac8d6d5b service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Updated VIF entry in instance network info cache for port 66db319f-02d8-4e75-b71a-2b2d136671a9. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:53:15 user nova-compute[71557]: DEBUG nova.network.neutron [req-f9742d66-668e-4f0f-92ac-843a414b61e3 req-73dba2ae-f4f8-4dbf-8acc-1728ac8d6d5b service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Updating instance_info_cache with network_info: [{"id": "66db319f-02d8-4e75-b71a-2b2d136671a9", "address": "fa:16:3e:c3:0b:b8", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66db319f-02", "ovs_interfaceid": "66db319f-02d8-4e75-b71a-2b2d136671a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:53:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f9742d66-668e-4f0f-92ac-843a414b61e3 req-73dba2ae-f4f8-4dbf-8acc-1728ac8d6d5b service nova] Releasing lock "refresh_cache-cdc51c71-9d3b-4957-b912-0666c68b46fc" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:53:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AklEFjuH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:53:17 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:53:17 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:53:17 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[55993bef-bd20-4794-b759-988b3232473f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:53:17 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7e45d4-6b32-4fdc-9c7c-9a388cd1dba3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193] added
Apr 12 10:53:17 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba71327-ba49-4056-b904-bb9e06a0d455]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b880588c-1b9f-4611-82f0-0d56df19c6b9]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AklEFjuH {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AklEFjuH" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed2cb5a-6f96-41b2-907a-e0fd5894e721]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AklEFjuH'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[763c1b6c-f491-4df2-bd04-b3ec7f793a14]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd6e3ef-cb08-4357-bea2-9b3067a51b91]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:53:17 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:53:17 user nova-compute[71557]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:53:17 user nova-compute[71557]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:53:17 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:53:17 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:53:17 user nova-compute[71557]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:53:17 user nova-compute[71557]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:53:17 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7eecda2-27ff-4986-9895-be2183665575]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193, portal: 172.16.0.220,3260]
Apr 12 10:53:17 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193, portal: 172.16.0.220,3260] successful.
Apr 12 10:53:17 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG nova.compute.manager [req-0fe2bf6f-0afa-4063-b4e8-018aa8040cb2 req-3038853a-781e-4a58-80e5-aacffb753fd8 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Received event network-vif-unplugged-66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0fe2bf6f-0afa-4063-b4e8-018aa8040cb2 req-3038853a-781e-4a58-80e5-aacffb753fd8 service nova] Acquiring lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0fe2bf6f-0afa-4063-b4e8-018aa8040cb2 req-3038853a-781e-4a58-80e5-aacffb753fd8 service nova] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0fe2bf6f-0afa-4063-b4e8-018aa8040cb2 req-3038853a-781e-4a58-80e5-aacffb753fd8 service nova] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG nova.compute.manager [req-0fe2bf6f-0afa-4063-b4e8-018aa8040cb2 req-3038853a-781e-4a58-80e5-aacffb753fd8 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] No waiting events found dispatching network-vif-unplugged-66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:53:17 user nova-compute[71557]: WARNING nova.compute.manager [req-0fe2bf6f-0afa-4063-b4e8-018aa8040cb2 req-3038853a-781e-4a58-80e5-aacffb753fd8 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Received unexpected event network-vif-unplugged-66db319f-02d8-4e75-b71a-2b2d136671a9 for instance with vm_state active and task_state reboot_started.
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d9dff9-ac20-46fd-b3db-cc425fce9de6]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed49dd39-7279-4cac-9342-8fc58bb8ea79]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:53:17 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:53:17 user nova-compute[71557]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:53:17 user nova-compute[71557]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:53:17 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:53:17 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:53:17 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:53:17 user nova-compute[71557]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:53:17 user nova-compute[71557]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:53:17 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:53:17 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1c591c-63fa-499d-bdae-d50199dea7d8]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AklEFjuH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:17 user nova-compute[71557]: INFO nova.compute.manager [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Terminating instance
Apr 12 10:53:17 user nova-compute[71557]: DEBUG nova.compute.manager [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:53:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:18 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-39c228d6-6e6c-4c07-a14c-4622602c0afd tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Instance shutdown successfully.
Apr 12 10:53:18 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:18 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:53:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23963366138353236', 'path': '/dev/sdf'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:53:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963366138353236', 'path': '/dev/sdf'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:53:18 user nova-compute[71557]: DEBUG nova.objects.instance [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'flavor' on Instance uuid faa11b52-f2b6-45aa-937f-7468095ddb22 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:53:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 10:53:18 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:53:18 user nova-compute[71557]:   <source dev="/dev/sdf"/>
Apr 12 10:53:18 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:53:18 user nova-compute[71557]:   <serial>e7d3b210-cbed-4d4a-8f47-f68cd0560193</serial>
Apr 12 10:53:18 user nova-compute[71557]: </disk>
Apr 12 10:53:18 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 10:53:19 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Instance destroyed successfully.
Apr 12 10:53:19 user nova-compute[71557]: DEBUG nova.objects.instance [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'resources' on Instance uuid dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1485644091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1485644091',id=24,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:44:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3789b59ccc704f86afac83af21fd84f9',ramdisk_id='',reservation_id='r-r3zcz1a4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:45:53Z,user_data=None,user_id='ba49b947c74e48f3b161b6f9fce8b1c5',uuid=dda9c8d0-6b6e-468f-a129-0675aa2cc2d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0", "address": "fa:16:3e:f5:e0:54", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce57bd29-c2", "ovs_interfaceid": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converting VIF {"id": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0", "address": "fa:16:3e:f5:e0:54", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce57bd29-c2", "ovs_interfaceid": "ce57bd29-c20b-4373-8e1c-724a3cf51fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e0:54,bridge_name='br-int',has_traffic_filtering=True,id=ce57bd29-c20b-4373-8e1c-724a3cf51fb0,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce57bd29-c2') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG os_vif [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e0:54,bridge_name='br-int',has_traffic_filtering=True,id=ce57bd29-c20b-4373-8e1c-724a3cf51fb0,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce57bd29-c2') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce57bd29-c2, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:19 user nova-compute[71557]: INFO os_vif [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e0:54,bridge_name='br-int',has_traffic_filtering=True,id=ce57bd29-c20b-4373-8e1c-724a3cf51fb0,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce57bd29-c2')
Apr 12 10:53:19 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Deleting instance files /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6_del
Apr 12 10:53:19 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Deletion of /opt/stack/data/nova/instances/dda9c8d0-6b6e-468f-a129-0675aa2cc2d6_del complete
Apr 12 10:53:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] No VIF found with MAC fa:16:3e:c9:da:1c, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:53:19 user nova-compute[71557]: INFO nova.compute.manager [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Took 1.31 seconds to destroy the instance on the hypervisor.
Apr 12 10:53:19 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-75737646-6f61-4dd0-818d-4a713798ae47 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.908s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG nova.compute.manager [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Received event network-vif-plugged-66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] Acquiring lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG nova.compute.manager [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] No waiting events found dispatching network-vif-plugged-66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:53:19 user nova-compute[71557]: WARNING nova.compute.manager [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Received unexpected event network-vif-plugged-66db319f-02d8-4e75-b71a-2b2d136671a9 for instance with vm_state active and task_state reboot_started.
Apr 12 10:53:19 user nova-compute[71557]: DEBUG nova.compute.manager [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Received event network-vif-unplugged-ce57bd29-c20b-4373-8e1c-724a3cf51fb0 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] Acquiring lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] Lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] Lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG nova.compute.manager [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] No waiting events found dispatching network-vif-unplugged-ce57bd29-c20b-4373-8e1c-724a3cf51fb0 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG nova.compute.manager [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Received event network-vif-unplugged-ce57bd29-c20b-4373-8e1c-724a3cf51fb0 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG nova.compute.manager [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Received event network-vif-plugged-ce57bd29-c20b-4373-8e1c-724a3cf51fb0 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] Acquiring lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] Lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] Lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG nova.compute.manager [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] No waiting events found dispatching network-vif-plugged-ce57bd29-c20b-4373-8e1c-724a3cf51fb0 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:53:19 user nova-compute[71557]: WARNING nova.compute.manager [req-4ac44e95-725c-4d0a-a4a2-7ad718e4ef0d req-24fabeee-ea1f-4f15-a3fe-b6122ebdd11f service nova] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Received unexpected event network-vif-plugged-ce57bd29-c20b-4373-8e1c-724a3cf51fb0 for instance with vm_state active and task_state deleting.
Apr 12 10:53:19 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG nova.compute.manager [req-655caba7-4cd9-45a6-aede-964f3d4fe420 req-8df6a52e-acc3-42ac-90be-bd97ef2a8dc7 service nova] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Received event network-vif-deleted-ce57bd29-c20b-4373-8e1c-724a3cf51fb0 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:19 user nova-compute[71557]: INFO nova.compute.manager [req-655caba7-4cd9-45a6-aede-964f3d4fe420 req-8df6a52e-acc3-42ac-90be-bd97ef2a8dc7 service nova] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Neutron deleted interface ce57bd29-c20b-4373-8e1c-724a3cf51fb0; detaching it from the instance and deleting it from the info cache
Apr 12 10:53:19 user nova-compute[71557]: DEBUG nova.network.neutron [req-655caba7-4cd9-45a6-aede-964f3d4fe420 req-8df6a52e-acc3-42ac-90be-bd97ef2a8dc7 service nova] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:53:19 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Took 0.59 seconds to deallocate network for instance.
Apr 12 10:53:19 user nova-compute[71557]: DEBUG nova.compute.manager [req-655caba7-4cd9-45a6-aede-964f3d4fe420 req-8df6a52e-acc3-42ac-90be-bd97ef2a8dc7 service nova] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Detach interface failed, port_id=ce57bd29-c20b-4373-8e1c-724a3cf51fb0, reason: Instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 could not be found. {{(pid=71557) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:20 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:53:20 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:53:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.536s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:20 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Deleted allocations for instance dda9c8d0-6b6e-468f-a129-0675aa2cc2d6
Apr 12 10:53:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-598fe5c5-274b-4d55-8cbc-44a29493597b tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "dda9c8d0-6b6e-468f-a129-0675aa2cc2d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.636s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:20 user nova-compute[71557]: INFO nova.compute.manager [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Rescuing
Apr 12 10:53:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "refresh_cache-faa11b52-f2b6-45aa-937f-7468095ddb22" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:53:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquired lock "refresh_cache-faa11b52-f2b6-45aa-937f-7468095ddb22" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:53:20 user nova-compute[71557]: DEBUG nova.network.neutron [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:53:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG nova.network.neutron [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Updating instance_info_cache with network_info: [{"id": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "address": "fa:16:3e:c9:da:1c", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46213af2-2a", "ovs_interfaceid": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Releasing lock "refresh_cache-faa11b52-f2b6-45aa-937f-7468095ddb22" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-62d87f2a-9d13-431b-9f17-b8957c92b345 req-20082376-17ce-4080-9d67-24b0297ff798 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received event network-vif-unplugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-62d87f2a-9d13-431b-9f17-b8957c92b345 req-20082376-17ce-4080-9d67-24b0297ff798 service nova] Acquiring lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-62d87f2a-9d13-431b-9f17-b8957c92b345 req-20082376-17ce-4080-9d67-24b0297ff798 service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-62d87f2a-9d13-431b-9f17-b8957c92b345 req-20082376-17ce-4080-9d67-24b0297ff798 service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-62d87f2a-9d13-431b-9f17-b8957c92b345 req-20082376-17ce-4080-9d67-24b0297ff798 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] No waiting events found dispatching network-vif-unplugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:53:21 user nova-compute[71557]: WARNING nova.compute.manager [req-62d87f2a-9d13-431b-9f17-b8957c92b345 req-20082376-17ce-4080-9d67-24b0297ff798 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received unexpected event network-vif-unplugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance with vm_state active and task_state rescuing.
Apr 12 10:53:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-8ca5f1e9-904a-484d-8b5e-84ebcc18cee2 req-9b5d5b4f-7a98-41e6-b8ca-1459b30ddfb1 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Received event network-vif-plugged-66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8ca5f1e9-904a-484d-8b5e-84ebcc18cee2 req-9b5d5b4f-7a98-41e6-b8ca-1459b30ddfb1 service nova] Acquiring lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8ca5f1e9-904a-484d-8b5e-84ebcc18cee2 req-9b5d5b4f-7a98-41e6-b8ca-1459b30ddfb1 service nova] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8ca5f1e9-904a-484d-8b5e-84ebcc18cee2 req-9b5d5b4f-7a98-41e6-b8ca-1459b30ddfb1 service nova] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-8ca5f1e9-904a-484d-8b5e-84ebcc18cee2 req-9b5d5b4f-7a98-41e6-b8ca-1459b30ddfb1 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] No waiting events found dispatching network-vif-plugged-66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:53:21 user nova-compute[71557]: WARNING nova.compute.manager [req-8ca5f1e9-904a-484d-8b5e-84ebcc18cee2 req-9b5d5b4f-7a98-41e6-b8ca-1459b30ddfb1 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Received unexpected event network-vif-plugged-66db319f-02d8-4e75-b71a-2b2d136671a9 for instance with vm_state active and task_state reboot_started.
Apr 12 10:53:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-8ca5f1e9-904a-484d-8b5e-84ebcc18cee2 req-9b5d5b4f-7a98-41e6-b8ca-1459b30ddfb1 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Received event network-vif-plugged-66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8ca5f1e9-904a-484d-8b5e-84ebcc18cee2 req-9b5d5b4f-7a98-41e6-b8ca-1459b30ddfb1 service nova] Acquiring lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8ca5f1e9-904a-484d-8b5e-84ebcc18cee2 req-9b5d5b4f-7a98-41e6-b8ca-1459b30ddfb1 service nova] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8ca5f1e9-904a-484d-8b5e-84ebcc18cee2 req-9b5d5b4f-7a98-41e6-b8ca-1459b30ddfb1 service nova] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-8ca5f1e9-904a-484d-8b5e-84ebcc18cee2 req-9b5d5b4f-7a98-41e6-b8ca-1459b30ddfb1 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] No waiting events found dispatching network-vif-plugged-66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:53:21 user nova-compute[71557]: WARNING nova.compute.manager [req-8ca5f1e9-904a-484d-8b5e-84ebcc18cee2 req-9b5d5b4f-7a98-41e6-b8ca-1459b30ddfb1 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Received unexpected event network-vif-plugged-66db319f-02d8-4e75-b71a-2b2d136671a9 for instance with vm_state active and task_state reboot_started.
Apr 12 10:53:21 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Instance destroyed successfully.
Apr 12 10:53:21 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Attempting rescue
Apr 12 10:53:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71557) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Instance directory exists: not creating {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 10:53:21 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Creating image(s)
Apr 12 10:53:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "/opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "/opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "/opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG nova.objects.instance [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'trusted_certs' on Instance uuid faa11b52-f2b6-45aa-937f-7468095ddb22 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.142s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk.rescue {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk.rescue" returned: 0 in 0.141s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.objects.instance [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'migration_context' on Instance uuid faa11b52-f2b6-45aa-937f-7468095ddb22 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Start _get_guest_xml network_info=[{"id": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "address": "fa:16:3e:c9:da:1c", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "vif_mac": "fa:16:3e:c9:da:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46213af2-2a", "ovs_interfaceid": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.objects.instance [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'resources' on Instance uuid faa11b52-f2b6-45aa-937f-7468095ddb22 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.objects.instance [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'numa_topology' on Instance uuid faa11b52-f2b6-45aa-937f-7468095ddb22 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:53:22 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:53:22 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.objects.instance [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'vcpu_model' on Instance uuid faa11b52-f2b6-45aa-937f-7468095ddb22 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:51:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1704970245',display_name='tempest-ServerRescueNegativeTestJSON-server-1704970245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1704970245',id=36,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/YpGpY39pjPnnc5Woimceec0NAaa03OrDNhA1pvgsqwdaodbpAhPJh05gGMZMrWZbb/FVge7phkuwRvAKHKPJI+cKczayHgYAnGWdfu4mixptN5qgJSlvLfPCtJ2jZMw==',key_name='tempest-keypair-1748374270',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:51:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b39cd8e55b54a86a7784f2934273e20',ramdisk_id='',reservation_id='r-9v4ub20y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1632398833',owner_user_name='tempest-ServerRescueNegativeTestJSON-1632398833-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abdf772f2c7341c29159b6f1f2ce7ccb',uuid=faa11b52-f2b6-45aa-937f-7468095ddb22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "address": "fa:16:3e:c9:da:1c", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "vif_mac": "fa:16:3e:c9:da:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46213af2-2a", "ovs_interfaceid": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converting VIF {"id": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "address": "fa:16:3e:c9:da:1c", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "vif_mac": "fa:16:3e:c9:da:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46213af2-2a", "ovs_interfaceid": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:da:1c,bridge_name='br-int',has_traffic_filtering=True,id=46213af2-2a93-4502-9f35-eda3d5b9f7fc,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46213af2-2a') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.objects.instance [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'pci_devices' on Instance uuid faa11b52-f2b6-45aa-937f-7468095ddb22 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:53:22 user nova-compute[71557]:   <uuid>faa11b52-f2b6-45aa-937f-7468095ddb22</uuid>
Apr 12 10:53:22 user nova-compute[71557]:   <name>instance-00000024</name>
Apr 12 10:53:22 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:53:22 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:53:22 user nova-compute[71557]:   <metadata>
Apr 12 10:53:22 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:53:22 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:53:22 user nova-compute[71557]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1704970245</nova:name>
Apr 12 10:53:22 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:53:22</nova:creationTime>
Apr 12 10:53:22 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:53:22 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:53:22 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:53:22 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:53:22 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:53:22 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:53:22 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:53:22 user nova-compute[71557]:       <nova:owner>
Apr 12 10:53:22 user nova-compute[71557]:         <nova:user uuid="abdf772f2c7341c29159b6f1f2ce7ccb">tempest-ServerRescueNegativeTestJSON-1632398833-project-member</nova:user>
Apr 12 10:53:22 user nova-compute[71557]:         <nova:project uuid="2b39cd8e55b54a86a7784f2934273e20">tempest-ServerRescueNegativeTestJSON-1632398833</nova:project>
Apr 12 10:53:22 user nova-compute[71557]:       </nova:owner>
Apr 12 10:53:22 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:53:22 user nova-compute[71557]:       <nova:ports>
Apr 12 10:53:22 user nova-compute[71557]:         <nova:port uuid="46213af2-2a93-4502-9f35-eda3d5b9f7fc">
Apr 12 10:53:22 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 10:53:22 user nova-compute[71557]:         </nova:port>
Apr 12 10:53:22 user nova-compute[71557]:       </nova:ports>
Apr 12 10:53:22 user nova-compute[71557]:     </nova:instance>
Apr 12 10:53:22 user nova-compute[71557]:   </metadata>
Apr 12 10:53:22 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:53:22 user nova-compute[71557]:     <system>
Apr 12 10:53:22 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:53:22 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:53:22 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:53:22 user nova-compute[71557]:       <entry name="serial">faa11b52-f2b6-45aa-937f-7468095ddb22</entry>
Apr 12 10:53:22 user nova-compute[71557]:       <entry name="uuid">faa11b52-f2b6-45aa-937f-7468095ddb22</entry>
Apr 12 10:53:22 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:53:22 user nova-compute[71557]:     </system>
Apr 12 10:53:22 user nova-compute[71557]:   </sysinfo>
Apr 12 10:53:22 user nova-compute[71557]:   <os>
Apr 12 10:53:22 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:53:22 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:53:22 user nova-compute[71557]:   </os>
Apr 12 10:53:22 user nova-compute[71557]:   <features>
Apr 12 10:53:22 user nova-compute[71557]:     <acpi/>
Apr 12 10:53:22 user nova-compute[71557]:     <apic/>
Apr 12 10:53:22 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:53:22 user nova-compute[71557]:   </features>
Apr 12 10:53:22 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:53:22 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:53:22 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:53:22 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:53:22 user nova-compute[71557]:   </clock>
Apr 12 10:53:22 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:53:22 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:53:22 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:53:22 user nova-compute[71557]:   </cpu>
Apr 12 10:53:22 user nova-compute[71557]:   <devices>
Apr 12 10:53:22 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:53:22 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:53:22 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk.rescue"/>
Apr 12 10:53:22 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:53:22 user nova-compute[71557]:     </disk>
Apr 12 10:53:22 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:53:22 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:53:22 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk"/>
Apr 12 10:53:22 user nova-compute[71557]:       <target dev="vdb" bus="virtio"/>
Apr 12 10:53:22 user nova-compute[71557]:     </disk>
Apr 12 10:53:22 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:53:22 user nova-compute[71557]:       <mac address="fa:16:3e:c9:da:1c"/>
Apr 12 10:53:22 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:53:22 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:53:22 user nova-compute[71557]:       <target dev="tap46213af2-2a"/>
Apr 12 10:53:22 user nova-compute[71557]:     </interface>
Apr 12 10:53:22 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:53:22 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/console.log" append="off"/>
Apr 12 10:53:22 user nova-compute[71557]:     </serial>
Apr 12 10:53:22 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:53:22 user nova-compute[71557]:     <video>
Apr 12 10:53:22 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:53:22 user nova-compute[71557]:     </video>
Apr 12 10:53:22 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:53:22 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:53:22 user nova-compute[71557]:     </rng>
Apr 12 10:53:22 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:53:22 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:53:22 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:53:22 user nova-compute[71557]:     </memballoon>
Apr 12 10:53:22 user nova-compute[71557]:   </devices>
Apr 12 10:53:22 user nova-compute[71557]: </domain>
Apr 12 10:53:22 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:53:22 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Instance destroyed successfully.
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] No VIF found with MAC fa:16:3e:c9:da:1c, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Removed pending event for cdc51c71-9d3b-4957-b912-0666c68b46fc due to event {{(pid=71557) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296802.4779289, cdc51c71-9d3b-4957-b912-0666c68b46fc => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:53:22 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] VM Resumed (Lifecycle Event)
Apr 12 10:53:22 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Instance running successfully.
Apr 12 10:53:22 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-39c228d6-6e6c-4c07-a14c-4622602c0afd tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Instance soft rebooted successfully.
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-39c228d6-6e6c-4c07-a14c-4622602c0afd tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:53:22 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296802.4801064, cdc51c71-9d3b-4957-b912-0666c68b46fc => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:53:22 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] VM Started (Lifecycle Event)
Apr 12 10:53:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-39c228d6-6e6c-4c07-a14c-4622602c0afd tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.220s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:53:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:53:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-592bf819-7103-44fb-b559-7875a6d72b64 req-90a85c7f-b439-4045-b947-97d33d725c97 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received event network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-592bf819-7103-44fb-b559-7875a6d72b64 req-90a85c7f-b439-4045-b947-97d33d725c97 service nova] Acquiring lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-592bf819-7103-44fb-b559-7875a6d72b64 req-90a85c7f-b439-4045-b947-97d33d725c97 service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-592bf819-7103-44fb-b559-7875a6d72b64 req-90a85c7f-b439-4045-b947-97d33d725c97 service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-592bf819-7103-44fb-b559-7875a6d72b64 req-90a85c7f-b439-4045-b947-97d33d725c97 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] No waiting events found dispatching network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:53:23 user nova-compute[71557]: WARNING nova.compute.manager [req-592bf819-7103-44fb-b559-7875a6d72b64 req-90a85c7f-b439-4045-b947-97d33d725c97 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received unexpected event network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance with vm_state active and task_state rescuing.
Apr 12 10:53:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-2f49605e-0e9c-44d0-875d-7ff6f206a063 req-33f99d51-e8e9-4ddf-b522-60d3b70a2593 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received event network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f49605e-0e9c-44d0-875d-7ff6f206a063 req-33f99d51-e8e9-4ddf-b522-60d3b70a2593 service nova] Acquiring lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f49605e-0e9c-44d0-875d-7ff6f206a063 req-33f99d51-e8e9-4ddf-b522-60d3b70a2593 service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f49605e-0e9c-44d0-875d-7ff6f206a063 req-33f99d51-e8e9-4ddf-b522-60d3b70a2593 service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-2f49605e-0e9c-44d0-875d-7ff6f206a063 req-33f99d51-e8e9-4ddf-b522-60d3b70a2593 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] No waiting events found dispatching network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:53:25 user nova-compute[71557]: WARNING nova.compute.manager [req-2f49605e-0e9c-44d0-875d-7ff6f206a063 req-33f99d51-e8e9-4ddf-b522-60d3b70a2593 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received unexpected event network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance with vm_state active and task_state rescuing.
Apr 12 10:53:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-2f49605e-0e9c-44d0-875d-7ff6f206a063 req-33f99d51-e8e9-4ddf-b522-60d3b70a2593 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received event network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f49605e-0e9c-44d0-875d-7ff6f206a063 req-33f99d51-e8e9-4ddf-b522-60d3b70a2593 service nova] Acquiring lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f49605e-0e9c-44d0-875d-7ff6f206a063 req-33f99d51-e8e9-4ddf-b522-60d3b70a2593 service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2f49605e-0e9c-44d0-875d-7ff6f206a063 req-33f99d51-e8e9-4ddf-b522-60d3b70a2593 service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-2f49605e-0e9c-44d0-875d-7ff6f206a063 req-33f99d51-e8e9-4ddf-b522-60d3b70a2593 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] No waiting events found dispatching network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:53:25 user nova-compute[71557]: WARNING nova.compute.manager [req-2f49605e-0e9c-44d0-875d-7ff6f206a063 req-33f99d51-e8e9-4ddf-b522-60d3b70a2593 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received unexpected event network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance with vm_state active and task_state rescuing.
Apr 12 10:53:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Removed pending event for faa11b52-f2b6-45aa-937f-7468095ddb22 due to event {{(pid=71557) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 10:53:26 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296806.094843, faa11b52-f2b6-45aa-937f-7468095ddb22 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:53:26 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] VM Resumed (Lifecycle Event)
Apr 12 10:53:26 user nova-compute[71557]: DEBUG nova.compute.manager [None req-9ea33a54-df20-4ddc-a829-f15f72a18365 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:53:26 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:53:26 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:53:26 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 10:53:26 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296806.0966578, faa11b52-f2b6-45aa-937f-7468095ddb22 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:53:26 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] VM Started (Lifecycle Event)
Apr 12 10:53:26 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:53:26 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:53:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:29 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:53:29 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:53:30 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:53:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:30 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:53:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:53:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:53:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:30 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:31 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:53:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:53:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:53:33 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:53:33 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:53:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=7698MB free_disk=26.05815887451172GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:53:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:53:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:53:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:53:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 97bafe22-36bf-4939-baf8-9602551bad52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:53:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 6b99fe06-9139-4475-aa72-2968a59df0bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:53:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:53:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance cdc51c71-9d3b-4957-b912-0666c68b46fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:53:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance faa11b52-f2b6-45aa-937f-7468095ddb22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:53:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0cb22a78-94df-49fb-918c-32856e1b5136 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:53:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:53:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:53:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:53:33 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:53:34 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296799.0065696, dda9c8d0-6b6e-468f-a129-0675aa2cc2d6 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:53:34 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] VM Stopped (Lifecycle Event)
Apr 12 10:53:34 user nova-compute[71557]: DEBUG nova.compute.manager [None req-a311cb04-1daf-422e-8d21-57272d9eb0ad None None] [instance: dda9c8d0-6b6e-468f-a129-0675aa2cc2d6] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:53:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:34 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:53:34 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:53:34 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:53:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.518s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:53:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:53:35 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:53:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-97bafe22-36bf-4939-baf8-9602551bad52" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:53:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-97bafe22-36bf-4939-baf8-9602551bad52" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:53:35 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:53:35 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Updating instance_info_cache with network_info: [{"id": "580ed46e-ff10-494f-b864-42eda726a7ff", "address": "fa:16:3e:a7:62:8b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580ed46e-ff", "ovs_interfaceid": "580ed46e-ff10-494f-b864-42eda726a7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:53:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-97bafe22-36bf-4939-baf8-9602551bad52" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:53:35 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:53:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:53:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:53:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:53:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:53:37 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:53:37 user nova-compute[71557]: DEBUG nova.compute.manager [req-3d0454ab-55db-4db9-83c4-c9cfdbdcefed req-685ce64b-a236-4ea5-8f43-192aeea73bf2 service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Received event network-changed-59e0f8a4-966b-46f3-921d-be0c6f15f281 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:37 user nova-compute[71557]: DEBUG nova.compute.manager [req-3d0454ab-55db-4db9-83c4-c9cfdbdcefed req-685ce64b-a236-4ea5-8f43-192aeea73bf2 service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Refreshing instance network info cache due to event network-changed-59e0f8a4-966b-46f3-921d-be0c6f15f281. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:53:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3d0454ab-55db-4db9-83c4-c9cfdbdcefed req-685ce64b-a236-4ea5-8f43-192aeea73bf2 service nova] Acquiring lock "refresh_cache-a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:53:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3d0454ab-55db-4db9-83c4-c9cfdbdcefed req-685ce64b-a236-4ea5-8f43-192aeea73bf2 service nova] Acquired lock "refresh_cache-a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:53:37 user nova-compute[71557]: DEBUG nova.network.neutron [req-3d0454ab-55db-4db9-83c4-c9cfdbdcefed req-685ce64b-a236-4ea5-8f43-192aeea73bf2 service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Refreshing network info cache for port 59e0f8a4-966b-46f3-921d-be0c6f15f281 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:53:38 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:53:38 user nova-compute[71557]: DEBUG nova.network.neutron [req-3d0454ab-55db-4db9-83c4-c9cfdbdcefed req-685ce64b-a236-4ea5-8f43-192aeea73bf2 service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Updated VIF entry in instance network info cache for port 59e0f8a4-966b-46f3-921d-be0c6f15f281. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:53:38 user nova-compute[71557]: DEBUG nova.network.neutron [req-3d0454ab-55db-4db9-83c4-c9cfdbdcefed req-685ce64b-a236-4ea5-8f43-192aeea73bf2 service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Updating instance_info_cache with network_info: [{"id": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "address": "fa:16:3e:98:5d:7d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e0f8a4-96", "ovs_interfaceid": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:53:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3d0454ab-55db-4db9-83c4-c9cfdbdcefed req-685ce64b-a236-4ea5-8f43-192aeea73bf2 service nova] Releasing lock "refresh_cache-a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:53:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Stashing vm_state: active {{(pid=71557) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 12 10:53:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:39 user nova-compute[71557]: DEBUG nova.objects.instance [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'pci_requests' on Instance uuid 0cb22a78-94df-49fb-918c-32856e1b5136 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:53:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:53:39 user nova-compute[71557]: INFO nova.compute.claims [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Claim successful on node user
Apr 12 10:53:39 user nova-compute[71557]: DEBUG nova.objects.instance [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'resources' on Instance uuid 0cb22a78-94df-49fb-918c-32856e1b5136 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:53:39 user nova-compute[71557]: DEBUG nova.objects.instance [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'pci_devices' on Instance uuid 0cb22a78-94df-49fb-918c-32856e1b5136 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:53:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-70bb2fbf-7024-422e-a036-2768ec1b005f req-1221b0f6-430e-49f4-9d38-2d414b149910 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Received event network-changed-225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-70bb2fbf-7024-422e-a036-2768ec1b005f req-1221b0f6-430e-49f4-9d38-2d414b149910 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Refreshing instance network info cache due to event network-changed-225efc65-26fe-4d54-93aa-35298d6ddd3f. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:53:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-70bb2fbf-7024-422e-a036-2768ec1b005f req-1221b0f6-430e-49f4-9d38-2d414b149910 service nova] Acquiring lock "refresh_cache-0cb22a78-94df-49fb-918c-32856e1b5136" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:53:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-70bb2fbf-7024-422e-a036-2768ec1b005f req-1221b0f6-430e-49f4-9d38-2d414b149910 service nova] Acquired lock "refresh_cache-0cb22a78-94df-49fb-918c-32856e1b5136" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:53:39 user nova-compute[71557]: DEBUG nova.network.neutron [req-70bb2fbf-7024-422e-a036-2768ec1b005f req-1221b0f6-430e-49f4-9d38-2d414b149910 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Refreshing network info cache for port 225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:53:39 user nova-compute[71557]: INFO nova.compute.resource_tracker [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Updating resource usage from migration 2fb831f6-d091-4c04-b56c-c6dcc28b3384
Apr 12 10:53:40 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:53:40 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:53:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.471s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:40 user nova-compute[71557]: INFO nova.compute.manager [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Migrating
Apr 12 10:53:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "refresh_cache-0cb22a78-94df-49fb-918c-32856e1b5136" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:53:40 user nova-compute[71557]: DEBUG nova.network.neutron [req-70bb2fbf-7024-422e-a036-2768ec1b005f req-1221b0f6-430e-49f4-9d38-2d414b149910 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Updated VIF entry in instance network info cache for port 225efc65-26fe-4d54-93aa-35298d6ddd3f. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:53:40 user nova-compute[71557]: DEBUG nova.network.neutron [req-70bb2fbf-7024-422e-a036-2768ec1b005f req-1221b0f6-430e-49f4-9d38-2d414b149910 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Updating instance_info_cache with network_info: [{"id": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "address": "fa:16:3e:e3:f1:6d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225efc65-26", "ovs_interfaceid": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:53:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-70bb2fbf-7024-422e-a036-2768ec1b005f req-1221b0f6-430e-49f4-9d38-2d414b149910 service nova] Releasing lock "refresh_cache-0cb22a78-94df-49fb-918c-32856e1b5136" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:53:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquired lock "refresh_cache-0cb22a78-94df-49fb-918c-32856e1b5136" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:53:40 user nova-compute[71557]: DEBUG nova.network.neutron [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:53:40 user nova-compute[71557]: DEBUG nova.network.neutron [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Updating instance_info_cache with network_info: [{"id": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "address": "fa:16:3e:e3:f1:6d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225efc65-26", "ovs_interfaceid": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:53:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Releasing lock "refresh_cache-0cb22a78-94df-49fb-918c-32856e1b5136" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:53:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Starting migrate_disk_and_power_off {{(pid=71557) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 12 10:53:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:41 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Instance destroyed successfully.
Apr 12 10:53:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-465944081',display_name='tempest-ServerActionsTestJSON-server-465944081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-465944081',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSPzZAK4K6WfKgZv6ul+nJ2Lzppw5IMfK0+f9KuGByC6XjA59WQJmgMTCh01/yWlwW8qMjnx6gjYen9tQKzYmdVo3Z1KGqS/wGYHKKDRVeNNONzm9HfPYp2EDH6xyugDA==',key_name='tempest-keypair-1241183546',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:51:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32235c67d269474b879a58269c1bfb28',ramdisk_id='',reservation_id='r-u95j204e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2042231427',owner_user_name='tempest-ServerActionsTestJSON-2042231427-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:53:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0059d31539304ffcb5214b408751cd4f',uuid=0cb22a78-94df-49fb-918c-32856e1b5136,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "address": "fa:16:3e:e3:f1:6d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-707748820-network", "vif_mac": "fa:16:3e:e3:f1:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225efc65-26", "ovs_interfaceid": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converting VIF {"id": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "address": "fa:16:3e:e3:f1:6d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-707748820-network", "vif_mac": "fa:16:3e:e3:f1:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225efc65-26", "ovs_interfaceid": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:f1:6d,bridge_name='br-int',has_traffic_filtering=True,id=225efc65-26fe-4d54-93aa-35298d6ddd3f,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225efc65-26') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG os_vif [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:f1:6d,bridge_name='br-int',has_traffic_filtering=True,id=225efc65-26fe-4d54-93aa-35298d6ddd3f,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225efc65-26') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap225efc65-26, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:53:41 user nova-compute[71557]: INFO os_vif [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:f1:6d,bridge_name='br-int',has_traffic_filtering=True,id=225efc65-26fe-4d54-93aa-35298d6ddd3f,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225efc65-26')
Apr 12 10:53:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlepnzcC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:53:41 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:53:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b984322a-3932-4773-9db7-b1886504a7a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:53:41 user nova-compute[71557]: No targets found.
Apr 12 10:53:41 user nova-compute[71557]: iSNS:
Apr 12 10:53:41 user nova-compute[71557]: No targets found.
Apr 12 10:53:41 user nova-compute[71557]: STATIC:
Apr 12 10:53:41 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:53:41 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:53:41 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:53:41 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193
Apr 12 10:53:41 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:53:41 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:53:41 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53
Apr 12 10:53:41 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:53:41 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:53:41 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8
Apr 12 10:53:41 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:53:41 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:53:41 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4
Apr 12 10:53:41 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:53:41 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:53:41 user nova-compute[71557]: FIRMWARE:
Apr 12 10:53:41 user nova-compute[71557]: No targets found.
Apr 12 10:53:41 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:53:41 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:53:41 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ccfc9a-3aaf-43ac-a93d-b84de848fde0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6677bde-0606-4441-9ec9-807cd86e165e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:53:41 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:53:41 user nova-compute[71557]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:53:41 user nova-compute[71557]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:53:41 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:53:41 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:53:41 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:53:41 user nova-compute[71557]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:53:41 user nova-compute[71557]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:53:41 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:53:41 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fa4590d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4'): ({'sdd'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Removing single pathed devices sdd {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ca0d1d-2cca-4e9d-a138-2e427ff93356]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad65318d-5add-4632-820a-bdc3e10cf26a]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flushing IO for device /dev/sdd {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab928318-0441-4054-8226-b870a7b94e36]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3501ff-e9da-4ece-891c-1af4d8a2d628]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] SCSI volumes sdd have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2b33b5e5-2790c23a39a0bd98', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2b33b5e5', '/dev/disk/by-id/scsi-23237393063323361') {{(pid=82009) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e260ac8-d2f8-4836-8476-9a09d051e3c7]: (4, None) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5b7473-f5cf-477b-8049-a086b9c9ac6a]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-afca47be-d97b-4159-a305-106b78a8374b req-f4fae2b0-38ac-436c-905b-32c58836eb62 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Received event network-vif-unplugged-225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-afca47be-d97b-4159-a305-106b78a8374b req-f4fae2b0-38ac-436c-905b-32c58836eb62 service nova] Acquiring lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-afca47be-d97b-4159-a305-106b78a8374b req-f4fae2b0-38ac-436c-905b-32c58836eb62 service nova] Lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-afca47be-d97b-4159-a305-106b78a8374b req-f4fae2b0-38ac-436c-905b-32c58836eb62 service nova] Lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-afca47be-d97b-4159-a305-106b78a8374b req-f4fae2b0-38ac-436c-905b-32c58836eb62 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] No waiting events found dispatching network-vif-unplugged-225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:53:41 user nova-compute[71557]: WARNING nova.compute.manager [req-afca47be-d97b-4159-a305-106b78a8374b req-f4fae2b0-38ac-436c-905b-32c58836eb62 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Received unexpected event network-vif-unplugged-225efc65-26fe-4d54-93aa-35298d6ddd3f for instance with vm_state active and task_state resize_migrating.
Apr 12 10:53:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-afca47be-d97b-4159-a305-106b78a8374b req-f4fae2b0-38ac-436c-905b-32c58836eb62 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Received event network-vif-plugged-225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-afca47be-d97b-4159-a305-106b78a8374b req-f4fae2b0-38ac-436c-905b-32c58836eb62 service nova] Acquiring lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-afca47be-d97b-4159-a305-106b78a8374b req-f4fae2b0-38ac-436c-905b-32c58836eb62 service nova] Lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-afca47be-d97b-4159-a305-106b78a8374b req-f4fae2b0-38ac-436c-905b-32c58836eb62 service nova] Lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-afca47be-d97b-4159-a305-106b78a8374b req-f4fae2b0-38ac-436c-905b-32c58836eb62 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] No waiting events found dispatching network-vif-plugged-225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:53:41 user nova-compute[71557]: WARNING nova.compute.manager [req-afca47be-d97b-4159-a305-106b78a8374b req-f4fae2b0-38ac-436c-905b-32c58836eb62 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Received unexpected event network-vif-plugged-225efc65-26fe-4d54-93aa-35298d6ddd3f for instance with vm_state active and task_state resize_migrating.
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c9e2d4-20a3-4347-9629-b93042678a95]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4, portal: 172.16.0.220,3260]
Apr 12 10:53:41 user nova-compute[71557]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4, portal: 172.16.0.220,3260] successful.
Apr 12 10:53:41 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2604b18-b3b1-4b87-a85a-7d4d3314bb26]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] <== disconnect_volume: return (330ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:53:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:53:42 user nova-compute[71557]: DEBUG nova.network.neutron [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Port 225efc65-26fe-4d54-93aa-35298d6ddd3f binding to destination host user is already ACTIVE {{(pid=71557) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 10:53:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "refresh_cache-0cb22a78-94df-49fb-918c-32856e1b5136" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:53:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquired lock "refresh_cache-0cb22a78-94df-49fb-918c-32856e1b5136" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:53:43 user nova-compute[71557]: DEBUG nova.network.neutron [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:53:43 user nova-compute[71557]: DEBUG nova.network.neutron [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Updating instance_info_cache with network_info: [{"id": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "address": "fa:16:3e:e3:f1:6d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225efc65-26", "ovs_interfaceid": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:53:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Releasing lock "refresh_cache-0cb22a78-94df-49fb-918c-32856e1b5136" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:53:43 user nova-compute[71557]: DEBUG os_brick.utils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:53:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:43 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8ee270-8426-4abf-bfa0-65911e984b84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:44 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[18407f38-0b0b-433c-96bd-6b2192bfb953]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:44 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7908de-c753-4fee-b472-158831019623]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:44 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[872a139b-2297-48ac-bdbc-df34b06c0e08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:53:44 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:53:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:53:44 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:53:44 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[168c33b7-ce9f-44b1-b282-7d29a09e8b81]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:44 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:53:44 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:53:44 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:53:44 user nova-compute[71557]: DEBUG os_brick.utils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:53:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Starting finish_migration {{(pid=71557) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Instance directory exists: not creating {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 10:53:48 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Creating image(s)
Apr 12 10:53:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Did not create local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Ensure instance console log exists: /opt/stack/data/nova/instances/0cb22a78-94df-49fb-918c-32856e1b5136/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Start _get_guest_xml network_info=[{"id": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "address": "fa:16:3e:e3:f1:6d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-707748820-network", "vif_mac": "fa:16:3e:e3:f1:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225efc65-26", "ovs_interfaceid": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'a8a8db36-8dac-441d-bece-5ce753fc33ff', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlepnzcC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '0cb22a78-94df-49fb-918c-32856e1b5136', 'attached_at': '2023-04-12T10:53:48.000000', 'detached_at': '', 'volume_id': 'aa22aac8-82c0-4487-bc15-af046a4aa2b4', 'serial': 'aa22aac8-82c0-4487-bc15-af046a4aa2b4'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:53:48 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:53:48 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:53:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG nova.objects.instance [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0cb22a78-94df-49fb-918c-32856e1b5136 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlepnzcC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:53:48 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:53:48 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:53:48 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f72fd6-669c-4f27-bee6-e8e12e66c04b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:53:48 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c300ac11-ad13-4ded-bc6f-d0c4193b67c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4] added
Apr 12 10:53:48 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61d0eca-6520-45a6-9ac0-c11c308decc8]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b92da93-b8c7-4253-9428-15fb8635f022]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QlepnzcC {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QlepnzcC" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc12302-064e-467d-b5a0-dd81e0020648]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QlepnzcC'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e162136-a86f-45b0-bcc5-c4c81fc388f8]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[68982827-f04a-4c87-a31a-4010008d1631]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:53:48 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:53:48 user nova-compute[71557]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:53:48 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:53:48 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:53:48 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:53:48 user nova-compute[71557]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:53:48 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:53:48 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[035f18e0-5745-45f2-bd39-78a68fa11375]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4, portal: 172.16.0.220,3260]
Apr 12 10:53:48 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4, portal: 172.16.0.220,3260] successful.
Apr 12 10:53:48 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[97daefe5-387a-4d26-afb3-9858c8fe7ca7]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dfafe7-5e4d-4403-aa7d-006e0f7512cb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:53:48 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:53:48 user nova-compute[71557]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:53:48 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:53:48 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:53:48 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:53:48 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:53:48 user nova-compute[71557]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:53:48 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:53:48 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:53:48 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9508e9-7791-4c16-bfa2-4c1c0392e604]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:53:48 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlepnzcC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "6b99fe06-9139-4475-aa72-2968a59df0bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "6b99fe06-9139-4475-aa72-2968a59df0bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "6b99fe06-9139-4475-aa72-2968a59df0bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "6b99fe06-9139-4475-aa72-2968a59df0bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "6b99fe06-9139-4475-aa72-2968a59df0bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:49 user nova-compute[71557]: INFO nova.compute.manager [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Terminating instance
Apr 12 10:53:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23237393063323361', 'path': '/dev/sdd'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237393063323361', 'path': '/dev/sdd'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-465944081',display_name='tempest-ServerActionsTestJSON-server-465944081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-465944081',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSPzZAK4K6WfKgZv6ul+nJ2Lzppw5IMfK0+f9KuGByC6XjA59WQJmgMTCh01/yWlwW8qMjnx6gjYen9tQKzYmdVo3Z1KGqS/wGYHKKDRVeNNONzm9HfPYp2EDH6xyugDA==',key_name='tempest-keypair-1241183546',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:51:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32235c67d269474b879a58269c1bfb28',ramdisk_id='',reservation_id='r-u95j204e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2042231427',owner_user_name='tempest-ServerActionsTestJSON-2042231427-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0059d31539304ffcb5214b408751cd4f',uuid=0cb22a78-94df-49fb-918c-32856e1b5136,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "address": "fa:16:3e:e3:f1:6d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-707748820-network", "vif_mac": "fa:16:3e:e3:f1:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225efc65-26", "ovs_interfaceid": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converting VIF {"id": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "address": "fa:16:3e:e3:f1:6d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-707748820-network", "vif_mac": "fa:16:3e:e3:f1:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225efc65-26", "ovs_interfaceid": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:f1:6d,bridge_name='br-int',has_traffic_filtering=True,id=225efc65-26fe-4d54-93aa-35298d6ddd3f,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225efc65-26') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:53:49 user nova-compute[71557]:   <uuid>0cb22a78-94df-49fb-918c-32856e1b5136</uuid>
Apr 12 10:53:49 user nova-compute[71557]:   <name>instance-00000025</name>
Apr 12 10:53:49 user nova-compute[71557]:   <memory>196608</memory>
Apr 12 10:53:49 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:53:49 user nova-compute[71557]:   <metadata>
Apr 12 10:53:49 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:53:49 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:53:49 user nova-compute[71557]:       <nova:name>tempest-ServerActionsTestJSON-server-465944081</nova:name>
Apr 12 10:53:49 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:53:48</nova:creationTime>
Apr 12 10:53:49 user nova-compute[71557]:       <nova:flavor name="m1.micro">
Apr 12 10:53:49 user nova-compute[71557]:         <nova:memory>192</nova:memory>
Apr 12 10:53:49 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:53:49 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:53:49 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:53:49 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:53:49 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:53:49 user nova-compute[71557]:       <nova:owner>
Apr 12 10:53:49 user nova-compute[71557]:         <nova:user uuid="0059d31539304ffcb5214b408751cd4f">tempest-ServerActionsTestJSON-2042231427-project-member</nova:user>
Apr 12 10:53:49 user nova-compute[71557]:         <nova:project uuid="32235c67d269474b879a58269c1bfb28">tempest-ServerActionsTestJSON-2042231427</nova:project>
Apr 12 10:53:49 user nova-compute[71557]:       </nova:owner>
Apr 12 10:53:49 user nova-compute[71557]:       <nova:ports>
Apr 12 10:53:49 user nova-compute[71557]:         <nova:port uuid="225efc65-26fe-4d54-93aa-35298d6ddd3f">
Apr 12 10:53:49 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 10:53:49 user nova-compute[71557]:         </nova:port>
Apr 12 10:53:49 user nova-compute[71557]:       </nova:ports>
Apr 12 10:53:49 user nova-compute[71557]:     </nova:instance>
Apr 12 10:53:49 user nova-compute[71557]:   </metadata>
Apr 12 10:53:49 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:53:49 user nova-compute[71557]:     <system>
Apr 12 10:53:49 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:53:49 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:53:49 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:53:49 user nova-compute[71557]:       <entry name="serial">0cb22a78-94df-49fb-918c-32856e1b5136</entry>
Apr 12 10:53:49 user nova-compute[71557]:       <entry name="uuid">0cb22a78-94df-49fb-918c-32856e1b5136</entry>
Apr 12 10:53:49 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:53:49 user nova-compute[71557]:     </system>
Apr 12 10:53:49 user nova-compute[71557]:   </sysinfo>
Apr 12 10:53:49 user nova-compute[71557]:   <os>
Apr 12 10:53:49 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:53:49 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:53:49 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:53:49 user nova-compute[71557]:   </os>
Apr 12 10:53:49 user nova-compute[71557]:   <features>
Apr 12 10:53:49 user nova-compute[71557]:     <acpi/>
Apr 12 10:53:49 user nova-compute[71557]:     <apic/>
Apr 12 10:53:49 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:53:49 user nova-compute[71557]:   </features>
Apr 12 10:53:49 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:53:49 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:53:49 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:53:49 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:53:49 user nova-compute[71557]:   </clock>
Apr 12 10:53:49 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:53:49 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:53:49 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:53:49 user nova-compute[71557]:   </cpu>
Apr 12 10:53:49 user nova-compute[71557]:   <devices>
Apr 12 10:53:49 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:53:49 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:53:49 user nova-compute[71557]:       <source dev="/dev/sdd"/>
Apr 12 10:53:49 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:53:49 user nova-compute[71557]:       <serial>aa22aac8-82c0-4487-bc15-af046a4aa2b4</serial>
Apr 12 10:53:49 user nova-compute[71557]:     </disk>
Apr 12 10:53:49 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:53:49 user nova-compute[71557]:       <mac address="fa:16:3e:e3:f1:6d"/>
Apr 12 10:53:49 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:53:49 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:53:49 user nova-compute[71557]:       <target dev="tap225efc65-26"/>
Apr 12 10:53:49 user nova-compute[71557]:     </interface>
Apr 12 10:53:49 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:53:49 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/0cb22a78-94df-49fb-918c-32856e1b5136/console.log" append="off"/>
Apr 12 10:53:49 user nova-compute[71557]:     </serial>
Apr 12 10:53:49 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:53:49 user nova-compute[71557]:     <video>
Apr 12 10:53:49 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:53:49 user nova-compute[71557]:     </video>
Apr 12 10:53:49 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:53:49 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:53:49 user nova-compute[71557]:     </rng>
Apr 12 10:53:49 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:53:49 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:53:49 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:53:49 user nova-compute[71557]:     </memballoon>
Apr 12 10:53:49 user nova-compute[71557]:   </devices>
Apr 12 10:53:49 user nova-compute[71557]: </domain>
Apr 12 10:53:49 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-465944081',display_name='tempest-ServerActionsTestJSON-server-465944081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-465944081',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSPzZAK4K6WfKgZv6ul+nJ2Lzppw5IMfK0+f9KuGByC6XjA59WQJmgMTCh01/yWlwW8qMjnx6gjYen9tQKzYmdVo3Z1KGqS/wGYHKKDRVeNNONzm9HfPYp2EDH6xyugDA==',key_name='tempest-keypair-1241183546',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:51:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32235c67d269474b879a58269c1bfb28',ramdisk_id='',reservation_id='r-u95j204e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2042231427',owner_user_name='tempest-ServerActionsTestJSON-2042231427-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0059d31539304ffcb5214b408751cd4f',uuid=0cb22a78-94df-49fb-918c-32856e1b5136,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "address": "fa:16:3e:e3:f1:6d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-707748820-network", "vif_mac": "fa:16:3e:e3:f1:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225efc65-26", "ovs_interfaceid": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converting VIF {"id": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "address": "fa:16:3e:e3:f1:6d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-707748820-network", "vif_mac": "fa:16:3e:e3:f1:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225efc65-26", "ovs_interfaceid": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:f1:6d,bridge_name='br-int',has_traffic_filtering=True,id=225efc65-26fe-4d54-93aa-35298d6ddd3f,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225efc65-26') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG os_vif [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:f1:6d,bridge_name='br-int',has_traffic_filtering=True,id=225efc65-26fe-4d54-93aa-35298d6ddd3f,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225efc65-26') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap225efc65-26, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap225efc65-26, col_values=(('external_ids', {'iface-id': '225efc65-26fe-4d54-93aa-35298d6ddd3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:f1:6d', 'vm-uuid': '0cb22a78-94df-49fb-918c-32856e1b5136'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:49 user nova-compute[71557]: INFO os_vif [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:f1:6d,bridge_name='br-int',has_traffic_filtering=True,id=225efc65-26fe-4d54-93aa-35298d6ddd3f,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225efc65-26')
Apr 12 10:53:49 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] No VIF found with MAC fa:16:3e:e3:f1:6d, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG nova.compute.manager [req-cf293c97-d138-4247-a848-27dc39ed307a req-5053f23b-c00d-4e16-8208-a9a09870752d service nova] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Received event network-vif-unplugged-d728429a-36b4-4d31-abe3-ef0cd1154866 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cf293c97-d138-4247-a848-27dc39ed307a req-5053f23b-c00d-4e16-8208-a9a09870752d service nova] Acquiring lock "6b99fe06-9139-4475-aa72-2968a59df0bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cf293c97-d138-4247-a848-27dc39ed307a req-5053f23b-c00d-4e16-8208-a9a09870752d service nova] Lock "6b99fe06-9139-4475-aa72-2968a59df0bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cf293c97-d138-4247-a848-27dc39ed307a req-5053f23b-c00d-4e16-8208-a9a09870752d service nova] Lock "6b99fe06-9139-4475-aa72-2968a59df0bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG nova.compute.manager [req-cf293c97-d138-4247-a848-27dc39ed307a req-5053f23b-c00d-4e16-8208-a9a09870752d service nova] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] No waiting events found dispatching network-vif-unplugged-d728429a-36b4-4d31-abe3-ef0cd1154866 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:53:49 user nova-compute[71557]: DEBUG nova.compute.manager [req-cf293c97-d138-4247-a848-27dc39ed307a req-5053f23b-c00d-4e16-8208-a9a09870752d service nova] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Received event network-vif-unplugged-d728429a-36b4-4d31-abe3-ef0cd1154866 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:53:50 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Instance destroyed successfully.
Apr 12 10:53:50 user nova-compute[71557]: DEBUG nova.objects.instance [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lazy-loading 'resources' on Instance uuid 6b99fe06-9139-4475-aa72-2968a59df0bd {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:49:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-236384963',display_name='tempest-TestVolumeBootPattern-volume-backed-server-236384963',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-236384963',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a67f3d23b8f74a9496d445c7fc75717e',ramdisk_id='',reservation_id='r-moek7icn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-638607559',owner_user_name='tempest-TestVolumeBootPattern-638607559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:49:25Z,user_data=None,user_id='b914d7ca786f455baf120f98816abffd',uuid=6b99fe06-9139-4475-aa72-2968a59df0bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d728429a-36b4-4d31-abe3-ef0cd1154866", "address": "fa:16:3e:c7:82:3c", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd728429a-36", "ovs_interfaceid": "d728429a-36b4-4d31-abe3-ef0cd1154866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converting VIF {"id": "d728429a-36b4-4d31-abe3-ef0cd1154866", "address": "fa:16:3e:c7:82:3c", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd728429a-36", "ovs_interfaceid": "d728429a-36b4-4d31-abe3-ef0cd1154866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:82:3c,bridge_name='br-int',has_traffic_filtering=True,id=d728429a-36b4-4d31-abe3-ef0cd1154866,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd728429a-36') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG os_vif [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:82:3c,bridge_name='br-int',has_traffic_filtering=True,id=d728429a-36b4-4d31-abe3-ef0cd1154866,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd728429a-36') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd728429a-36, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:50 user nova-compute[71557]: INFO os_vif [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:82:3c,bridge_name='br-int',has_traffic_filtering=True,id=d728429a-36b4-4d31-abe3-ef0cd1154866,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd728429a-36')
Apr 12 10:53:50 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MUuHKaQB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:53:50 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:53:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8968427-2336-4476-b9e9-3d220661caf3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:53:50 user nova-compute[71557]: No targets found.
Apr 12 10:53:50 user nova-compute[71557]: iSNS:
Apr 12 10:53:50 user nova-compute[71557]: No targets found.
Apr 12 10:53:50 user nova-compute[71557]: STATIC:
Apr 12 10:53:50 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:53:50 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:53:50 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:53:50 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193
Apr 12 10:53:50 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:53:50 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:53:50 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53
Apr 12 10:53:50 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:53:50 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:53:50 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8
Apr 12 10:53:50 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:53:50 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:53:50 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4
Apr 12 10:53:50 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:53:50 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:53:50 user nova-compute[71557]: FIRMWARE:
Apr 12 10:53:50 user nova-compute[71557]: No targets found.
Apr 12 10:53:50 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:53:50 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:53:50 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[46214aa8-6ad0-428b-aa86-4e7a4388ab16]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f5412a-7782-4829-a820-2830121c40ab]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:53:50 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:53:50 user nova-compute[71557]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:53:50 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:53:50 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:53:50 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:53:50 user nova-compute[71557]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 (non-flash)
Apr 12 10:53:50 user nova-compute[71557]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:53:50 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:53:50 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:53:50 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fc423a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8'): ({'sdc'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Removing single pathed devices sdc {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:53:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9af401e-f5ee-4898-b796-80f3fbbcb15f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[54891876-06da-45cd-b0ef-b9e0b0d7c467]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flushing IO for device /dev/sdc {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c79b3c-4f71-4d4c-96b6-d121daa0c5f7]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[05df1bab-05f7-4c43-bc56-6ad7cdd98259]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] SCSI volumes sdc have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d777848b-bb42-4807-b4b8-85fccc138670]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccbf47c-8ef6-4279-9e1a-4ab0fd90c421]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8, portal: 172.16.0.220,3260]
Apr 12 10:53:51 user nova-compute[71557]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8, portal: 172.16.0.220,3260] successful.
Apr 12 10:53:51 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87ef4ba7-ac18-4477-a31f-f433c041fda8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3848b487-3514-4b04-8030-003e3bc47a71]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] <== disconnect_volume: return (328ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:53:51 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Deleting instance files /opt/stack/data/nova/instances/6b99fe06-9139-4475-aa72-2968a59df0bd_del
Apr 12 10:53:51 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Deletion of /opt/stack/data/nova/instances/6b99fe06-9139-4475-aa72-2968a59df0bd_del complete
Apr 12 10:53:51 user nova-compute[71557]: INFO nova.compute.manager [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Took 1.58 seconds to destroy the instance on the hypervisor.
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG nova.compute.manager [req-1cd66f07-c2b9-4179-8627-90a02ac906e9 req-16af134f-7051-4cbd-a322-b69945dbc436 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Received event network-vif-plugged-225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-1cd66f07-c2b9-4179-8627-90a02ac906e9 req-16af134f-7051-4cbd-a322-b69945dbc436 service nova] Acquiring lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-1cd66f07-c2b9-4179-8627-90a02ac906e9 req-16af134f-7051-4cbd-a322-b69945dbc436 service nova] Lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-1cd66f07-c2b9-4179-8627-90a02ac906e9 req-16af134f-7051-4cbd-a322-b69945dbc436 service nova] Lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG nova.compute.manager [req-1cd66f07-c2b9-4179-8627-90a02ac906e9 req-16af134f-7051-4cbd-a322-b69945dbc436 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] No waiting events found dispatching network-vif-plugged-225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:53:51 user nova-compute[71557]: WARNING nova.compute.manager [req-1cd66f07-c2b9-4179-8627-90a02ac906e9 req-16af134f-7051-4cbd-a322-b69945dbc436 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Received unexpected event network-vif-plugged-225efc65-26fe-4d54-93aa-35298d6ddd3f for instance with vm_state active and task_state resize_finish.
Apr 12 10:53:51 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:51 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:53:51 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Took 0.54 seconds to deallocate network for instance.
Apr 12 10:53:52 user nova-compute[71557]: DEBUG nova.compute.manager [req-1a19c2d4-a8a7-464c-bbb5-f910c1bb1bb7 req-0d6309b5-60f7-4e83-bc14-aaef24453f3d service nova] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Received event network-vif-plugged-d728429a-36b4-4d31-abe3-ef0cd1154866 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-1a19c2d4-a8a7-464c-bbb5-f910c1bb1bb7 req-0d6309b5-60f7-4e83-bc14-aaef24453f3d service nova] Acquiring lock "6b99fe06-9139-4475-aa72-2968a59df0bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-1a19c2d4-a8a7-464c-bbb5-f910c1bb1bb7 req-0d6309b5-60f7-4e83-bc14-aaef24453f3d service nova] Lock "6b99fe06-9139-4475-aa72-2968a59df0bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-1a19c2d4-a8a7-464c-bbb5-f910c1bb1bb7 req-0d6309b5-60f7-4e83-bc14-aaef24453f3d service nova] Lock "6b99fe06-9139-4475-aa72-2968a59df0bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:52 user nova-compute[71557]: DEBUG nova.compute.manager [req-1a19c2d4-a8a7-464c-bbb5-f910c1bb1bb7 req-0d6309b5-60f7-4e83-bc14-aaef24453f3d service nova] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] No waiting events found dispatching network-vif-plugged-d728429a-36b4-4d31-abe3-ef0cd1154866 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:53:52 user nova-compute[71557]: WARNING nova.compute.manager [req-1a19c2d4-a8a7-464c-bbb5-f910c1bb1bb7 req-0d6309b5-60f7-4e83-bc14-aaef24453f3d service nova] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Received unexpected event network-vif-plugged-d728429a-36b4-4d31-abe3-ef0cd1154866 for instance with vm_state active and task_state deleting.
Apr 12 10:53:52 user nova-compute[71557]: DEBUG nova.compute.manager [req-1a19c2d4-a8a7-464c-bbb5-f910c1bb1bb7 req-0d6309b5-60f7-4e83-bc14-aaef24453f3d service nova] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Received event network-vif-deleted-d728429a-36b4-4d31-abe3-ef0cd1154866 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:52 user nova-compute[71557]: INFO nova.compute.manager [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Took 0.76 seconds to detach 1 volumes for instance.
Apr 12 10:53:52 user nova-compute[71557]: DEBUG nova.compute.manager [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Deleting volume: 87ef4ba7-ac18-4477-a31f-f433c041fda8 {{(pid=71557) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 10:53:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:53 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:53:53 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:53:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:53 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Deleted allocations for instance 6b99fe06-9139-4475-aa72-2968a59df0bd
Apr 12 10:53:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-7d0301f9-e655-4c1c-90aa-a27027788cf2 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "6b99fe06-9139-4475-aa72-2968a59df0bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.511s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Removed pending event for 0cb22a78-94df-49fb-918c-32856e1b5136 due to event {{(pid=71557) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 10:53:53 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296833.5850983, 0cb22a78-94df-49fb-918c-32856e1b5136 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:53:53 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] VM Resumed (Lifecycle Event)
Apr 12 10:53:53 user nova-compute[71557]: DEBUG nova.compute.manager [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:53:53 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Instance running successfully.
Apr 12 10:53:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Failed to set time: agent not configured {{(pid=71557) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 12 10:53:53 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-88d81711-decc-44fb-b18c-c9e055d14e0b tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] finish_migration finished successfully. {{(pid=71557) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 12 10:53:53 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:53:53 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:53:53 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 10:53:53 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296833.586743, 0cb22a78-94df-49fb-918c-32856e1b5136 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:53:53 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] VM Started (Lifecycle Event)
Apr 12 10:53:53 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:53:53 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:53:53 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 10:53:53 user nova-compute[71557]: DEBUG nova.compute.manager [req-6a7db1f7-4a6b-4925-acb1-af9e487918b5 req-e7b1dcba-6c5d-4875-ba4d-fec99fccfe80 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Received event network-vif-plugged-225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:53:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6a7db1f7-4a6b-4925-acb1-af9e487918b5 req-e7b1dcba-6c5d-4875-ba4d-fec99fccfe80 service nova] Acquiring lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:53:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6a7db1f7-4a6b-4925-acb1-af9e487918b5 req-e7b1dcba-6c5d-4875-ba4d-fec99fccfe80 service nova] Lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:53:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6a7db1f7-4a6b-4925-acb1-af9e487918b5 req-e7b1dcba-6c5d-4875-ba4d-fec99fccfe80 service nova] Lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:53:53 user nova-compute[71557]: DEBUG nova.compute.manager [req-6a7db1f7-4a6b-4925-acb1-af9e487918b5 req-e7b1dcba-6c5d-4875-ba4d-fec99fccfe80 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] No waiting events found dispatching network-vif-plugged-225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:53:53 user nova-compute[71557]: WARNING nova.compute.manager [req-6a7db1f7-4a6b-4925-acb1-af9e487918b5 req-e7b1dcba-6c5d-4875-ba4d-fec99fccfe80 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Received unexpected event network-vif-plugged-225efc65-26fe-4d54-93aa-35298d6ddd3f for instance with vm_state resized and task_state None.
Apr 12 10:53:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:53:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:54:05 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296830.8564718, 6b99fe06-9139-4475-aa72-2968a59df0bd => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:54:05 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] VM Stopped (Lifecycle Event)
Apr 12 10:54:05 user nova-compute[71557]: DEBUG nova.compute.manager [None req-86234ab6-f70e-45a4-80f6-7ec15d2c4696 None None] [instance: 6b99fe06-9139-4475-aa72-2968a59df0bd] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:54:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:54:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 10:54:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:54:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:54:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:54:08 user nova-compute[71557]: INFO nova.compute.manager [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Terminating instance
Apr 12 10:54:08 user nova-compute[71557]: DEBUG nova.compute.manager [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:54:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:08 user nova-compute[71557]: DEBUG nova.compute.manager [req-92ddfa15-6c9f-4b61-bcd0-d99ce3745486 req-6c843458-1266-4937-94e5-b26a9bddb158 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received event network-vif-unplugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:54:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-92ddfa15-6c9f-4b61-bcd0-d99ce3745486 req-6c843458-1266-4937-94e5-b26a9bddb158 service nova] Acquiring lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-92ddfa15-6c9f-4b61-bcd0-d99ce3745486 req-6c843458-1266-4937-94e5-b26a9bddb158 service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-92ddfa15-6c9f-4b61-bcd0-d99ce3745486 req-6c843458-1266-4937-94e5-b26a9bddb158 service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:54:08 user nova-compute[71557]: DEBUG nova.compute.manager [req-92ddfa15-6c9f-4b61-bcd0-d99ce3745486 req-6c843458-1266-4937-94e5-b26a9bddb158 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] No waiting events found dispatching network-vif-unplugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:54:08 user nova-compute[71557]: DEBUG nova.compute.manager [req-92ddfa15-6c9f-4b61-bcd0-d99ce3745486 req-6c843458-1266-4937-94e5-b26a9bddb158 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received event network-vif-unplugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:54:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:09 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Instance destroyed successfully.
Apr 12 10:54:09 user nova-compute[71557]: DEBUG nova.objects.instance [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'resources' on Instance uuid 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1497116859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1497116859',id=14,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:40:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3789b59ccc704f86afac83af21fd84f9',ramdisk_id='',reservation_id='r-qmvf1fzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:42:10Z,user_data=None,user_id='ba49b947c74e48f3b161b6f9fce8b1c5',uuid=8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "address": "fa:16:3e:e8:3f:f9", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e23fbbf-0b", "ovs_interfaceid": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converting VIF {"id": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "address": "fa:16:3e:e8:3f:f9", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e23fbbf-0b", "ovs_interfaceid": "1e23fbbf-0bbf-491b-b83b-b1e7067f91fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:3f:f9,bridge_name='br-int',has_traffic_filtering=True,id=1e23fbbf-0bbf-491b-b83b-b1e7067f91fb,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e23fbbf-0b') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG os_vif [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:3f:f9,bridge_name='br-int',has_traffic_filtering=True,id=1e23fbbf-0bbf-491b-b83b-b1e7067f91fb,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e23fbbf-0b') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e23fbbf-0b, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:54:09 user nova-compute[71557]: INFO os_vif [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:3f:f9,bridge_name='br-int',has_traffic_filtering=True,id=1e23fbbf-0bbf-491b-b83b-b1e7067f91fb,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e23fbbf-0b')
Apr 12 10:54:09 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MomdaHlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:54:09 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:54:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc24bd5a-673a-495b-b7f2-473902161c14]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:54:09 user nova-compute[71557]: No targets found.
Apr 12 10:54:09 user nova-compute[71557]: iSNS:
Apr 12 10:54:09 user nova-compute[71557]: No targets found.
Apr 12 10:54:09 user nova-compute[71557]: STATIC:
Apr 12 10:54:09 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0
Apr 12 10:54:09 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:54:09 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:54:09 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193
Apr 12 10:54:09 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:54:09 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:54:09 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53
Apr 12 10:54:09 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:54:09 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:54:09 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4
Apr 12 10:54:09 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:54:09 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:54:09 user nova-compute[71557]: FIRMWARE:
Apr 12 10:54:09 user nova-compute[71557]: No targets found.
Apr 12 10:54:09 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:54:09 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:54:09 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fff2052-c074-469e-b659-5f78765d7561]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4c5af8-a0d3-4366-b14c-0b248501ff23]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:54:09 user nova-compute[71557]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:54:09 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:54:09 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:54:09 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 (non-flash)
Apr 12 10:54:09 user nova-compute[71557]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:54:09 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:54:09 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:54:09 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fa4591ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0'): ({'sdb'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Removing single pathed devices sdb {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ada700-6eb6-418f-8c21-834f003d6300]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[943d744b-a814-4cf1-8661-757f5c9856ce]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Flushing IO for device /dev/sdb {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c6e7f7-5573-42dc-8988-a79e8a3ac456]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4d3029-b4f9-4367-aa4d-991713bf603d]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36a2e81-2986-4aaa-baac-d97e3890c288]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8462aa1-68bb-4e93-993a-2c2a73527cac]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0, portal: 172.16.0.220,3260]
Apr 12 10:54:09 user nova-compute[71557]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0, portal: 172.16.0.220,3260] successful.
Apr 12 10:54:09 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8585bd8b-e5a9-4a52-84c2-194841fc5cd0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c738d9-e11c-4d46-a0db-ec7350b7e6e0]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] <== disconnect_volume: return (314ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:54:09 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Deleting instance files /opt/stack/data/nova/instances/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212_del
Apr 12 10:54:09 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Deletion of /opt/stack/data/nova/instances/8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212_del complete
Apr 12 10:54:09 user nova-compute[71557]: INFO nova.compute.manager [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 12 10:54:09 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:54:09 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Took 0.45 seconds to deallocate network for instance.
Apr 12 10:54:09 user nova-compute[71557]: DEBUG nova.compute.manager [req-a091070f-87c7-4255-8703-7ff4dc917d8c req-f57b4f87-651b-481c-be3e-3e7de75432b0 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received event network-vif-deleted-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:54:09 user nova-compute[71557]: INFO nova.compute.manager [req-a091070f-87c7-4255-8703-7ff4dc917d8c req-f57b4f87-651b-481c-be3e-3e7de75432b0 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Neutron deleted interface 1e23fbbf-0bbf-491b-b83b-b1e7067f91fb; detaching it from the instance and deleting it from the info cache
Apr 12 10:54:09 user nova-compute[71557]: DEBUG nova.network.neutron [req-a091070f-87c7-4255-8703-7ff4dc917d8c req-f57b4f87-651b-481c-be3e-3e7de75432b0 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:54:09 user nova-compute[71557]: DEBUG nova.compute.manager [req-a091070f-87c7-4255-8703-7ff4dc917d8c req-f57b4f87-651b-481c-be3e-3e7de75432b0 service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Detach interface failed, port_id=1e23fbbf-0bbf-491b-b83b-b1e7067f91fb, reason: Instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 could not be found. {{(pid=71557) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 10:54:10 user nova-compute[71557]: DEBUG nova.compute.manager [req-f2f61d95-4458-43fe-850e-56e061e7755d req-e0752e97-3688-43e9-8580-91f4a3a2c81e service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received event network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:54:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f2f61d95-4458-43fe-850e-56e061e7755d req-e0752e97-3688-43e9-8580-91f4a3a2c81e service nova] Acquiring lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f2f61d95-4458-43fe-850e-56e061e7755d req-e0752e97-3688-43e9-8580-91f4a3a2c81e service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f2f61d95-4458-43fe-850e-56e061e7755d req-e0752e97-3688-43e9-8580-91f4a3a2c81e service nova] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:54:10 user nova-compute[71557]: DEBUG nova.compute.manager [req-f2f61d95-4458-43fe-850e-56e061e7755d req-e0752e97-3688-43e9-8580-91f4a3a2c81e service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] No waiting events found dispatching network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:54:10 user nova-compute[71557]: WARNING nova.compute.manager [req-f2f61d95-4458-43fe-850e-56e061e7755d req-e0752e97-3688-43e9-8580-91f4a3a2c81e service nova] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Received unexpected event network-vif-plugged-1e23fbbf-0bbf-491b-b83b-b1e7067f91fb for instance with vm_state active and task_state deleting.
Apr 12 10:54:10 user nova-compute[71557]: INFO nova.compute.manager [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Took 0.76 seconds to detach 1 volumes for instance.
Apr 12 10:54:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:10 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:54:11 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:54:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:54:11 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Deleted allocations for instance 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212
Apr 12 10:54:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3f2e8ee9-1941-4c8a-931b-212a6185d693 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.887s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:54:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:24 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296849.0127187, 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:54:24 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] VM Stopped (Lifecycle Event)
Apr 12 10:54:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-fd949176-fa2c-426c-83dc-d8abd1670f2c None None] [instance: 8e99b4b0-9fee-4bff-ba01-c2f4ffd7d212] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:54:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:29 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:54:29 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:54:32 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:54:32 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:54:32 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:54:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:54:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:54:32 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:54:32 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Updating instance_info_cache with network_info: [{"id": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "address": "fa:16:3e:98:5d:7d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e0f8a4-96", "ovs_interfaceid": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:54:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:54:32 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:54:32 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:54:32 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:54:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:54:32 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:54:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:54:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:54:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:54:36 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:54:36 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:54:36 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=7759MB free_disk=26.028793334960938GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:54:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:36 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Applying migration context for instance 0cb22a78-94df-49fb-918c-32856e1b5136 as it has an incoming, in-progress migration 2fb831f6-d091-4c04-b56c-c6dcc28b3384. Migration status is finished {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 10:54:36 user nova-compute[71557]: INFO nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Updating resource usage from migration 2fb831f6-d091-4c04-b56c-c6dcc28b3384
Apr 12 10:54:36 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0f55cab4-8530-4be0-a91d-65671f0dccd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:54:36 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:54:36 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 97bafe22-36bf-4939-baf8-9602551bad52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:54:36 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:54:36 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance cdc51c71-9d3b-4957-b912-0666c68b46fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:54:36 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance faa11b52-f2b6-45aa-937f-7468095ddb22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:54:36 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:54:36 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:54:36 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Migration 2fb831f6-d091-4c04-b56c-c6dcc28b3384 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 10:54:36 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0cb22a78-94df-49fb-918c-32856e1b5136 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:54:36 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:54:36 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1856MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:54:36 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:54:36 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:54:36 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:54:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:54:38 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:54:38 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:54:38 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:54:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-adaff219-1138-4b49-a7aa-a737d0496f18 req-4dc2b9c9-87cb-4f98-9e61-71c3a78ae5ec service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received event network-changed-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:54:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-adaff219-1138-4b49-a7aa-a737d0496f18 req-4dc2b9c9-87cb-4f98-9e61-71c3a78ae5ec service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Refreshing instance network info cache due to event network-changed-8786a087-f036-403b-9b82-c75fc6dbb110. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:54:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-adaff219-1138-4b49-a7aa-a737d0496f18 req-4dc2b9c9-87cb-4f98-9e61-71c3a78ae5ec service nova] Acquiring lock "refresh_cache-2aef35e7-5daf-4d41-b91b-a7ff4a481644" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:54:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-adaff219-1138-4b49-a7aa-a737d0496f18 req-4dc2b9c9-87cb-4f98-9e61-71c3a78ae5ec service nova] Acquired lock "refresh_cache-2aef35e7-5daf-4d41-b91b-a7ff4a481644" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:54:39 user nova-compute[71557]: DEBUG nova.network.neutron [req-adaff219-1138-4b49-a7aa-a737d0496f18 req-4dc2b9c9-87cb-4f98-9e61-71c3a78ae5ec service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Refreshing network info cache for port 8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:54:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:39 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:54:39 user nova-compute[71557]: DEBUG nova.network.neutron [req-adaff219-1138-4b49-a7aa-a737d0496f18 req-4dc2b9c9-87cb-4f98-9e61-71c3a78ae5ec service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Updated VIF entry in instance network info cache for port 8786a087-f036-403b-9b82-c75fc6dbb110. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:54:39 user nova-compute[71557]: DEBUG nova.network.neutron [req-adaff219-1138-4b49-a7aa-a737d0496f18 req-4dc2b9c9-87cb-4f98-9e61-71c3a78ae5ec service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Updating instance_info_cache with network_info: [{"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:54:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-adaff219-1138-4b49-a7aa-a737d0496f18 req-4dc2b9c9-87cb-4f98-9e61-71c3a78ae5ec service nova] Releasing lock "refresh_cache-2aef35e7-5daf-4d41-b91b-a7ff4a481644" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:54:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:40 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'flavor' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:54:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:54:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:40 user nova-compute[71557]: INFO nova.compute.manager [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Attaching volume 811e93eb-e600-41b9-ad7c-577a0f9938d1 to /dev/vdb
Apr 12 10:54:41 user nova-compute[71557]: DEBUG os_brick.utils [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:54:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[42851df4-0794-4076-b867-e838c09e6125]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[97be9b28-a6bb-492b-9860-00a8948335b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[57681bad-d2c7-4011-bfee-06546a31bfe9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2105079-ee19-44fe-a0a2-b7313479f891]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:54:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:54:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:54:41 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:54:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[73832abc-8761-4f40-a3cf-4f3a61614178]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:54:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:54:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:54:41 user nova-compute[71557]: DEBUG os_brick.utils [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:54:41 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Updating existing volume attachment record: 6aac6dd6-66d4-42f4-a297-1e0951d50187 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:54:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MndrmjNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:54:46 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:54:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:54:46 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:54:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:54:46 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[910344e7-80f0-424d-8957-74c340efed4b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:54:46 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8e6301-c4d8-444a-8714-fcb9aac50c98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1] added
Apr 12 10:54:46 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19ea927-a408-492b-933e-4b624e9ff266]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[df74e2f8-a053-4a31-9ddc-f0940f3cc877]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MndrmjNh {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MndrmjNh" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4ecbe5-1814-41e3-aa5f-3a704fd45b53]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MndrmjNh'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2b9e3d-ed35-4df2-a265-6b6e1522dc03]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e2b9a4-7405-4814-b28b-30fd91724705]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:54:46 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:54:46 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:54:46 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:54:46 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:54:46 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:54:46 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2024ce-9371-4656-ae18-55440f54d758]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1, portal: 172.16.0.220,3260]
Apr 12 10:54:46 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1, portal: 172.16.0.220,3260] successful.
Apr 12 10:54:46 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2580ff3a-6f04-46a5-8056-3bb43c1c2e05]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0ef400-1cd8-4d29-b0e7-469f47e6ec93]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:54:46 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:54:46 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:54:46 user nova-compute[71557]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:54:46 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:54:46 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:54:46 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:54:46 user nova-compute[71557]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:54:46 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e29c49-d4f3-429d-8bec-9e087fd0508f]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:46 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: None {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:54:47 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:54:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MndrmjNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:54:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:54:47 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23939653132343033', 'path': '/dev/sdb'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:54:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939653132343033', 'path': '/dev/sdb'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:54:47 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'flavor' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:54:47 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 10:54:47 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:54:47 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 10:54:47 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:54:47 user nova-compute[71557]:   <serial>811e93eb-e600-41b9-ad7c-577a0f9938d1</serial>
Apr 12 10:54:47 user nova-compute[71557]: </disk>
Apr 12 10:54:47 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 10:54:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:54:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:54:48 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] No VIF found with MAC fa:16:3e:59:45:ef, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:54:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a0037d22-b11e-441f-8d82-7eb0fa85a181 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.573s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:54:49 user nova-compute[71557]: INFO nova.compute.claims [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Claim successful on node user
Apr 12 10:54:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.579s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-126f501e-9325-4b67-b033-868317a57a6c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-126f501e-9325-4b67-b033-868317a57a6c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-126f501e-9325-4b67-b033-868317a57a6c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG nova.network.neutron [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-126f501e-9325-4b67-b033-868317a57a6c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71557) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG nova.objects.instance [None req-126f501e-9325-4b67-b033-868317a57a6c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'flavor' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:54:49 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:54:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:54:49 user nova-compute[71557]: INFO nova.virt.block_device [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Booting with volume 27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 at /dev/vda
Apr 12 10:54:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG os_brick.utils [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG nova.policy [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[11378b57-f445-46b0-bdb5-efc3513647ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1dcdea-4d40-46d9-9b2b-fdc940840404]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:49 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:50 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c79dc2a-3520-4d31-ae15-6b695d930165]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:50 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aafd734-ea4e-4caf-a7a5-279a3275b3f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:54:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:54:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:50 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:54:50 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:54:50 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1256d52-e5c7-427b-945e-b0ccc02a20c6]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:54:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:54:50 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:54:50 user nova-compute[71557]: DEBUG os_brick.utils [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:54:50 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Updating existing volume attachment record: df819ddd-9503-4794-bd6b-a3afa64f17b4 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:54:50 user nova-compute[71557]: DEBUG nova.compute.manager [req-c582f1d5-c7ed-443d-82bb-c91bea78ce7e req-e6168397-208b-40fb-9de0-c9898f2cfbd6 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received event network-vif-unplugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:54:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c582f1d5-c7ed-443d-82bb-c91bea78ce7e req-e6168397-208b-40fb-9de0-c9898f2cfbd6 service nova] Acquiring lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c582f1d5-c7ed-443d-82bb-c91bea78ce7e req-e6168397-208b-40fb-9de0-c9898f2cfbd6 service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-c582f1d5-c7ed-443d-82bb-c91bea78ce7e req-e6168397-208b-40fb-9de0-c9898f2cfbd6 service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:54:50 user nova-compute[71557]: DEBUG nova.compute.manager [req-c582f1d5-c7ed-443d-82bb-c91bea78ce7e req-e6168397-208b-40fb-9de0-c9898f2cfbd6 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] No waiting events found dispatching network-vif-unplugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:54:50 user nova-compute[71557]: WARNING nova.compute.manager [req-c582f1d5-c7ed-443d-82bb-c91bea78ce7e req-e6168397-208b-40fb-9de0-c9898f2cfbd6 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received unexpected event network-vif-unplugged-8786a087-f036-403b-9b82-c75fc6dbb110 for instance with vm_state active and task_state powering-off.
Apr 12 10:54:50 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Instance destroyed successfully.
Apr 12 10:54:50 user nova-compute[71557]: DEBUG nova.compute.manager [None req-126f501e-9325-4b67-b033-868317a57a6c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:54:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-126f501e-9325-4b67-b033-868317a57a6c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.882s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:54:50 user nova-compute[71557]: DEBUG nova.network.neutron [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Successfully created port: f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:54:51 user nova-compute[71557]: DEBUG nova.network.neutron [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Successfully updated port: f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:54:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "refresh_cache-95469ca9-8f8d-4755-8a00-4e2f5689f3de" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:54:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquired lock "refresh_cache-95469ca9-8f8d-4755-8a00-4e2f5689f3de" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:54:51 user nova-compute[71557]: DEBUG nova.network.neutron [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:54:51 user nova-compute[71557]: DEBUG nova.network.neutron [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:54:52 user nova-compute[71557]: DEBUG nova.network.neutron [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Updating instance_info_cache with network_info: [{"id": "f3314b2f-1470-40cb-9699-71a5020d2bff", "address": "fa:16:3e:64:ca:1c", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314b2f-14", "ovs_interfaceid": "f3314b2f-1470-40cb-9699-71a5020d2bff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:54:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Releasing lock "refresh_cache-95469ca9-8f8d-4755-8a00-4e2f5689f3de" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:54:52 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Instance network_info: |[{"id": "f3314b2f-1470-40cb-9699-71a5020d2bff", "address": "fa:16:3e:64:ca:1c", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314b2f-14", "ovs_interfaceid": "f3314b2f-1470-40cb-9699-71a5020d2bff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:54:52 user nova-compute[71557]: DEBUG nova.compute.manager [req-3db76bcb-69d6-4780-b55e-e142d40770a0 req-f11331fb-44d6-460b-bfe4-5dd4b6848272 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received event network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:54:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3db76bcb-69d6-4780-b55e-e142d40770a0 req-f11331fb-44d6-460b-bfe4-5dd4b6848272 service nova] Acquiring lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3db76bcb-69d6-4780-b55e-e142d40770a0 req-f11331fb-44d6-460b-bfe4-5dd4b6848272 service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3db76bcb-69d6-4780-b55e-e142d40770a0 req-f11331fb-44d6-460b-bfe4-5dd4b6848272 service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:54:52 user nova-compute[71557]: DEBUG nova.compute.manager [req-3db76bcb-69d6-4780-b55e-e142d40770a0 req-f11331fb-44d6-460b-bfe4-5dd4b6848272 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] No waiting events found dispatching network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:54:52 user nova-compute[71557]: WARNING nova.compute.manager [req-3db76bcb-69d6-4780-b55e-e142d40770a0 req-f11331fb-44d6-460b-bfe4-5dd4b6848272 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received unexpected event network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 for instance with vm_state stopped and task_state None.
Apr 12 10:54:52 user nova-compute[71557]: DEBUG nova.compute.manager [req-3db76bcb-69d6-4780-b55e-e142d40770a0 req-f11331fb-44d6-460b-bfe4-5dd4b6848272 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Received event network-changed-f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:54:52 user nova-compute[71557]: DEBUG nova.compute.manager [req-3db76bcb-69d6-4780-b55e-e142d40770a0 req-f11331fb-44d6-460b-bfe4-5dd4b6848272 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Refreshing instance network info cache due to event network-changed-f3314b2f-1470-40cb-9699-71a5020d2bff. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:54:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3db76bcb-69d6-4780-b55e-e142d40770a0 req-f11331fb-44d6-460b-bfe4-5dd4b6848272 service nova] Acquiring lock "refresh_cache-95469ca9-8f8d-4755-8a00-4e2f5689f3de" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:54:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3db76bcb-69d6-4780-b55e-e142d40770a0 req-f11331fb-44d6-460b-bfe4-5dd4b6848272 service nova] Acquired lock "refresh_cache-95469ca9-8f8d-4755-8a00-4e2f5689f3de" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:54:52 user nova-compute[71557]: DEBUG nova.network.neutron [req-3db76bcb-69d6-4780-b55e-e142d40770a0 req-f11331fb-44d6-460b-bfe4-5dd4b6848272 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Refreshing network info cache for port f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:54:52 user nova-compute[71557]: DEBUG nova.network.neutron [req-3db76bcb-69d6-4780-b55e-e142d40770a0 req-f11331fb-44d6-460b-bfe4-5dd4b6848272 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Updated VIF entry in instance network info cache for port f3314b2f-1470-40cb-9699-71a5020d2bff. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:54:52 user nova-compute[71557]: DEBUG nova.network.neutron [req-3db76bcb-69d6-4780-b55e-e142d40770a0 req-f11331fb-44d6-460b-bfe4-5dd4b6848272 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Updating instance_info_cache with network_info: [{"id": "f3314b2f-1470-40cb-9699-71a5020d2bff", "address": "fa:16:3e:64:ca:1c", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314b2f-14", "ovs_interfaceid": "f3314b2f-1470-40cb-9699-71a5020d2bff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:54:52 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3db76bcb-69d6-4780-b55e-e142d40770a0 req-f11331fb-44d6-460b-bfe4-5dd4b6848272 service nova] Releasing lock "refresh_cache-95469ca9-8f8d-4755-8a00-4e2f5689f3de" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG nova.compute.manager [req-a2a32a60-6795-402a-aabe-900f44c3851c req-d2cdc72f-862a-4bb6-a705-6ee3d08d9157 service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Received event network-changed-4372d146-13c3-4479-84ba-bdf514061696 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG nova.compute.manager [req-a2a32a60-6795-402a-aabe-900f44c3851c req-d2cdc72f-862a-4bb6-a705-6ee3d08d9157 service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Refreshing instance network info cache due to event network-changed-4372d146-13c3-4479-84ba-bdf514061696. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a2a32a60-6795-402a-aabe-900f44c3851c req-d2cdc72f-862a-4bb6-a705-6ee3d08d9157 service nova] Acquiring lock "refresh_cache-fcd57d3d-16cb-4b4e-8785-ae15027621a5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a2a32a60-6795-402a-aabe-900f44c3851c req-d2cdc72f-862a-4bb6-a705-6ee3d08d9157 service nova] Acquired lock "refresh_cache-fcd57d3d-16cb-4b4e-8785-ae15027621a5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG nova.network.neutron [req-a2a32a60-6795-402a-aabe-900f44c3851c req-d2cdc72f-862a-4bb6-a705-6ee3d08d9157 service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Refreshing network info cache for port 4372d146-13c3-4479-84ba-bdf514061696 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:54:54 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Creating image(s)
Apr 12 10:54:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Did not create local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Ensure instance console log exists: /opt/stack/data/nova/instances/95469ca9-8f8d-4755-8a00-4e2f5689f3de/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Start _get_guest_xml network_info=[{"id": "f3314b2f-1470-40cb-9699-71a5020d2bff", "address": "fa:16:3e:64:ca:1c", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314b2f-14", "ovs_interfaceid": "f3314b2f-1470-40cb-9699-71a5020d2bff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'df819ddd-9503-4794-bd6b-a3afa64f17b4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyTZNWEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '95469ca9-8f8d-4755-8a00-4e2f5689f3de', 'attached_at': '', 'detached_at': '', 'volume_id': '27a37b7e-8277-4e8d-8d37-9fbc82af9ff9', 'serial': '27a37b7e-8277-4e8d-8d37-9fbc82af9ff9'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:54:54 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:54:54 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:54:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyTZNWEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:54:54 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:54:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:54:54 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:54:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:54:54 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa42c69-e390-4ed0-9172-e4553adcf254]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:54:54 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[55521afa-e8c5-4d91-9e2f-ecd780fdd7aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9] added
Apr 12 10:54:54 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b2fa65-0065-4395-9d84-cec19239ccc4]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[db311855-3789-43a1-974e-5be1dc702486]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YyTZNWEp {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YyTZNWEp" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[23087b2a-af99-4847-95e5-cff4653d201d]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YyTZNWEp'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f7c8f7-bf63-40e2-96f5-6f1b74827594]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4103d3a-bf69-4a6d-ac01-b44c50a67305]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:54:54 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:54:54 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:54:54 user nova-compute[71557]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:54:54 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:54:54 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:54:54 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:54:54 user nova-compute[71557]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:54:54 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bed6db-d077-4818-b224-73b4dabdc380]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9, portal: 172.16.0.220,3260]
Apr 12 10:54:54 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9, portal: 172.16.0.220,3260] successful.
Apr 12 10:54:54 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72d32d1-b7c8-41fa-a5d8-03bb2b0530ed]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe722bf-4d9d-4a71-b516-66b4539a0fd1]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:54:54 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:54:54 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:54:54 user nova-compute[71557]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:54:54 user nova-compute[71557]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:54:54 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:54:54 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:54:54 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:54:54 user nova-compute[71557]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:54:54 user nova-compute[71557]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:54:54 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69ecad4-8ef7-4fce-b4e6-48658dda3c6c]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:54 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: None {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG nova.network.neutron [req-a2a32a60-6795-402a-aabe-900f44c3851c req-d2cdc72f-862a-4bb6-a705-6ee3d08d9157 service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Updated VIF entry in instance network info cache for port 4372d146-13c3-4479-84ba-bdf514061696. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG nova.network.neutron [req-a2a32a60-6795-402a-aabe-900f44c3851c req-d2cdc72f-862a-4bb6-a705-6ee3d08d9157 service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Updating instance_info_cache with network_info: [{"id": "4372d146-13c3-4479-84ba-bdf514061696", "address": "fa:16:3e:9a:98:b5", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4372d146-13", "ovs_interfaceid": "4372d146-13c3-4479-84ba-bdf514061696", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a2a32a60-6795-402a-aabe-900f44c3851c req-d2cdc72f-862a-4bb6-a705-6ee3d08d9157 service nova] Releasing lock "refresh_cache-fcd57d3d-16cb-4b4e-8785-ae15027621a5" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyTZNWEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26137333730316234', 'path': '/dev/sdc'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137333730316234', 'path': '/dev/sdc'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:54:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1015870463',display_name='tempest-TestVolumeBootPattern-server-1015870463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1015870463',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeNYUbBfSwdaJdVL2RMsgRRuPmOdMNSAwl/DHzaeVhE0fDjZe84+pAYZqsgenmNqm/u0yGuL1KeKxxwsT2FNR2LdwQFC7iIcZOaTovpAXdmD/5wx/0lhCQf7gPsmZ5xfg==',key_name='tempest-TestVolumeBootPattern-162796269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a67f3d23b8f74a9496d445c7fc75717e',ramdisk_id='',reservation_id='r-hbhz4mck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-638607559',owner_user_name='tempest-TestVolumeBootPattern-638607559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:54:50Z,user_data=None,user_id='b914d7ca786f455baf120f98816abffd',uuid=95469ca9-8f8d-4755-8a00-4e2f5689f3de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3314b2f-1470-40cb-9699-71a5020d2bff", "address": "fa:16:3e:64:ca:1c", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314b2f-14", "ovs_interfaceid": "f3314b2f-1470-40cb-9699-71a5020d2bff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converting VIF {"id": "f3314b2f-1470-40cb-9699-71a5020d2bff", "address": "fa:16:3e:64:ca:1c", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314b2f-14", "ovs_interfaceid": "f3314b2f-1470-40cb-9699-71a5020d2bff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:ca:1c,bridge_name='br-int',has_traffic_filtering=True,id=f3314b2f-1470-40cb-9699-71a5020d2bff,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3314b2f-14') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG nova.objects.instance [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lazy-loading 'pci_devices' on Instance uuid 95469ca9-8f8d-4755-8a00-4e2f5689f3de {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:54:55 user nova-compute[71557]:   <uuid>95469ca9-8f8d-4755-8a00-4e2f5689f3de</uuid>
Apr 12 10:54:55 user nova-compute[71557]:   <name>instance-00000028</name>
Apr 12 10:54:55 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:54:55 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:54:55 user nova-compute[71557]:   <metadata>
Apr 12 10:54:55 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:54:55 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:54:55 user nova-compute[71557]:       <nova:name>tempest-TestVolumeBootPattern-server-1015870463</nova:name>
Apr 12 10:54:55 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:54:54</nova:creationTime>
Apr 12 10:54:55 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:54:55 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:54:55 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:54:55 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:54:55 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:54:55 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:54:55 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:54:55 user nova-compute[71557]:       <nova:owner>
Apr 12 10:54:55 user nova-compute[71557]:         <nova:user uuid="b914d7ca786f455baf120f98816abffd">tempest-TestVolumeBootPattern-638607559-project-member</nova:user>
Apr 12 10:54:55 user nova-compute[71557]:         <nova:project uuid="a67f3d23b8f74a9496d445c7fc75717e">tempest-TestVolumeBootPattern-638607559</nova:project>
Apr 12 10:54:55 user nova-compute[71557]:       </nova:owner>
Apr 12 10:54:55 user nova-compute[71557]:       <nova:ports>
Apr 12 10:54:55 user nova-compute[71557]:         <nova:port uuid="f3314b2f-1470-40cb-9699-71a5020d2bff">
Apr 12 10:54:55 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 10:54:55 user nova-compute[71557]:         </nova:port>
Apr 12 10:54:55 user nova-compute[71557]:       </nova:ports>
Apr 12 10:54:55 user nova-compute[71557]:     </nova:instance>
Apr 12 10:54:55 user nova-compute[71557]:   </metadata>
Apr 12 10:54:55 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:54:55 user nova-compute[71557]:     <system>
Apr 12 10:54:55 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:54:55 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:54:55 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:54:55 user nova-compute[71557]:       <entry name="serial">95469ca9-8f8d-4755-8a00-4e2f5689f3de</entry>
Apr 12 10:54:55 user nova-compute[71557]:       <entry name="uuid">95469ca9-8f8d-4755-8a00-4e2f5689f3de</entry>
Apr 12 10:54:55 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:54:55 user nova-compute[71557]:     </system>
Apr 12 10:54:55 user nova-compute[71557]:   </sysinfo>
Apr 12 10:54:55 user nova-compute[71557]:   <os>
Apr 12 10:54:55 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:54:55 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:54:55 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:54:55 user nova-compute[71557]:   </os>
Apr 12 10:54:55 user nova-compute[71557]:   <features>
Apr 12 10:54:55 user nova-compute[71557]:     <acpi/>
Apr 12 10:54:55 user nova-compute[71557]:     <apic/>
Apr 12 10:54:55 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:54:55 user nova-compute[71557]:   </features>
Apr 12 10:54:55 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:54:55 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:54:55 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:54:55 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:54:55 user nova-compute[71557]:   </clock>
Apr 12 10:54:55 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:54:55 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:54:55 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:54:55 user nova-compute[71557]:   </cpu>
Apr 12 10:54:55 user nova-compute[71557]:   <devices>
Apr 12 10:54:55 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:54:55 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:54:55 user nova-compute[71557]:       <source dev="/dev/sdc"/>
Apr 12 10:54:55 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:54:55 user nova-compute[71557]:       <serial>27a37b7e-8277-4e8d-8d37-9fbc82af9ff9</serial>
Apr 12 10:54:55 user nova-compute[71557]:     </disk>
Apr 12 10:54:55 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:54:55 user nova-compute[71557]:       <mac address="fa:16:3e:64:ca:1c"/>
Apr 12 10:54:55 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:54:55 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:54:55 user nova-compute[71557]:       <target dev="tapf3314b2f-14"/>
Apr 12 10:54:55 user nova-compute[71557]:     </interface>
Apr 12 10:54:55 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:54:55 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/95469ca9-8f8d-4755-8a00-4e2f5689f3de/console.log" append="off"/>
Apr 12 10:54:55 user nova-compute[71557]:     </serial>
Apr 12 10:54:55 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:54:55 user nova-compute[71557]:     <video>
Apr 12 10:54:55 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:54:55 user nova-compute[71557]:     </video>
Apr 12 10:54:55 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:54:55 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:54:55 user nova-compute[71557]:     </rng>
Apr 12 10:54:55 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:54:55 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:54:55 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:54:55 user nova-compute[71557]:     </memballoon>
Apr 12 10:54:55 user nova-compute[71557]:   </devices>
Apr 12 10:54:55 user nova-compute[71557]: </domain>
Apr 12 10:54:55 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:54:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1015870463',display_name='tempest-TestVolumeBootPattern-server-1015870463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1015870463',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeNYUbBfSwdaJdVL2RMsgRRuPmOdMNSAwl/DHzaeVhE0fDjZe84+pAYZqsgenmNqm/u0yGuL1KeKxxwsT2FNR2LdwQFC7iIcZOaTovpAXdmD/5wx/0lhCQf7gPsmZ5xfg==',key_name='tempest-TestVolumeBootPattern-162796269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a67f3d23b8f74a9496d445c7fc75717e',ramdisk_id='',reservation_id='r-hbhz4mck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-638607559',owner_user_name='tempest-TestVolumeBootPattern-638607559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:54:50Z,user_data=None,user_id='b914d7ca786f455baf120f98816abffd',uuid=95469ca9-8f8d-4755-8a00-4e2f5689f3de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3314b2f-1470-40cb-9699-71a5020d2bff", "address": "fa:16:3e:64:ca:1c", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314b2f-14", "ovs_interfaceid": "f3314b2f-1470-40cb-9699-71a5020d2bff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converting VIF {"id": "f3314b2f-1470-40cb-9699-71a5020d2bff", "address": "fa:16:3e:64:ca:1c", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314b2f-14", "ovs_interfaceid": "f3314b2f-1470-40cb-9699-71a5020d2bff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:ca:1c,bridge_name='br-int',has_traffic_filtering=True,id=f3314b2f-1470-40cb-9699-71a5020d2bff,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3314b2f-14') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG os_vif [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:ca:1c,bridge_name='br-int',has_traffic_filtering=True,id=f3314b2f-1470-40cb-9699-71a5020d2bff,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3314b2f-14') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3314b2f-14, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3314b2f-14, col_values=(('external_ids', {'iface-id': 'f3314b2f-1470-40cb-9699-71a5020d2bff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:ca:1c', 'vm-uuid': '95469ca9-8f8d-4755-8a00-4e2f5689f3de'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:54:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:55 user nova-compute[71557]: INFO os_vif [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:ca:1c,bridge_name='br-int',has_traffic_filtering=True,id=f3314b2f-1470-40cb-9699-71a5020d2bff,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3314b2f-14')
Apr 12 10:54:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG nova.objects.instance [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'flavor' on Instance uuid fcd57d3d-16cb-4b4e-8785-ae15027621a5 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] No VIF found with MAC fa:16:3e:64:ca:1c, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:56 user nova-compute[71557]: INFO nova.compute.manager [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Attaching volume b178c67e-b2d3-4f88-a2f0-c78db142c223 to /dev/vdb
Apr 12 10:54:56 user nova-compute[71557]: DEBUG os_brick.utils [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19fb2b0-3319-4b71-b444-e11772073c5f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[77941b7a-fb7d-4156-8a41-f44eb5c7cf0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed32d55-7a97-41d9-bbb1-2090f77fbc1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2756c626-368e-47bd-8974-21a4e98ee6bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:54:56 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:54:56 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8486494c-1013-4ed9-b0ad-f6c9487a1bf9]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG os_brick.utils [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:54:56 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Updating existing volume attachment record: d89327b2-2560-4a28-a1fa-f623f5625955 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:54:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:57 user nova-compute[71557]: DEBUG nova.compute.manager [req-95eced3c-c675-41f9-9da0-b37611f00171 req-78558f63-765c-410d-938e-eaa3877340b4 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Received event network-vif-plugged-f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:54:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-95eced3c-c675-41f9-9da0-b37611f00171 req-78558f63-765c-410d-938e-eaa3877340b4 service nova] Acquiring lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-95eced3c-c675-41f9-9da0-b37611f00171 req-78558f63-765c-410d-938e-eaa3877340b4 service nova] Lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:57 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-95eced3c-c675-41f9-9da0-b37611f00171 req-78558f63-765c-410d-938e-eaa3877340b4 service nova] Lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:54:57 user nova-compute[71557]: DEBUG nova.compute.manager [req-95eced3c-c675-41f9-9da0-b37611f00171 req-78558f63-765c-410d-938e-eaa3877340b4 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] No waiting events found dispatching network-vif-plugged-f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:54:57 user nova-compute[71557]: WARNING nova.compute.manager [req-95eced3c-c675-41f9-9da0-b37611f00171 req-78558f63-765c-410d-938e-eaa3877340b4 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Received unexpected event network-vif-plugged-f3314b2f-1470-40cb-9699-71a5020d2bff for instance with vm_state building and task_state spawning.
Apr 12 10:54:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "0f55cab4-8530-4be0-a91d-65671f0dccd9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "0f55cab4-8530-4be0-a91d-65671f0dccd9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "0f55cab4-8530-4be0-a91d-65671f0dccd9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "0f55cab4-8530-4be0-a91d-65671f0dccd9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:58 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "0f55cab4-8530-4be0-a91d-65671f0dccd9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:54:58 user nova-compute[71557]: INFO nova.compute.manager [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Terminating instance
Apr 12 10:54:58 user nova-compute[71557]: DEBUG nova.compute.manager [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296899.4729369, 95469ca9-8f8d-4755-8a00-4e2f5689f3de => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:54:59 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] VM Resumed (Lifecycle Event)
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:54:59 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Instance spawned successfully.
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:54:59 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Instance destroyed successfully.
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.objects.instance [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lazy-loading 'resources' on Instance uuid 0f55cab4-8530-4be0-a91d-65671f0dccd9 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:35:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-386378272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-386378272',id=2,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:35:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3789b59ccc704f86afac83af21fd84f9',ramdisk_id='',reservation_id='r-1nfkrdoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:37:21Z,user_data=None,user_id='ba49b947c74e48f3b161b6f9fce8b1c5',uuid=0f55cab4-8530-4be0-a91d-65671f0dccd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1506948-cd44-4d78-a019-853199016229", "address": "fa:16:3e:a5:75:17", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1506948-cd", "ovs_interfaceid": "e1506948-cd44-4d78-a019-853199016229", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converting VIF {"id": "e1506948-cd44-4d78-a019-853199016229", "address": "fa:16:3e:a5:75:17", "network": {"id": "49a2fb41-5e5e-4d4b-969a-0043778b4b0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-36297510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3789b59ccc704f86afac83af21fd84f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1506948-cd", "ovs_interfaceid": "e1506948-cd44-4d78-a019-853199016229", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:75:17,bridge_name='br-int',has_traffic_filtering=True,id=e1506948-cd44-4d78-a019-853199016229,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1506948-cd') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG os_vif [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:75:17,bridge_name='br-int',has_traffic_filtering=True,id=e1506948-cd44-4d78-a019-853199016229,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1506948-cd') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1506948-cd, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:54:59 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296899.477242, 95469ca9-8f8d-4755-8a00-4e2f5689f3de => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:54:59 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] VM Started (Lifecycle Event)
Apr 12 10:54:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.compute.manager [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Received event network-vif-plugged-f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] Acquiring lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] Lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] Lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.compute.manager [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] No waiting events found dispatching network-vif-plugged-f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:54:59 user nova-compute[71557]: WARNING nova.compute.manager [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Received unexpected event network-vif-plugged-f3314b2f-1470-40cb-9699-71a5020d2bff for instance with vm_state building and task_state spawning.
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.compute.manager [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Received event network-vif-unplugged-e1506948-cd44-4d78-a019-853199016229 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] Acquiring lock "0f55cab4-8530-4be0-a91d-65671f0dccd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] Lock "0f55cab4-8530-4be0-a91d-65671f0dccd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] Lock "0f55cab4-8530-4be0-a91d-65671f0dccd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.compute.manager [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] No waiting events found dispatching network-vif-unplugged-e1506948-cd44-4d78-a019-853199016229 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.compute.manager [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Received event network-vif-unplugged-e1506948-cd44-4d78-a019-853199016229 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.compute.manager [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Received event network-vif-plugged-e1506948-cd44-4d78-a019-853199016229 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] Acquiring lock "0f55cab4-8530-4be0-a91d-65671f0dccd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] Lock "0f55cab4-8530-4be0-a91d-65671f0dccd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] Lock "0f55cab4-8530-4be0-a91d-65671f0dccd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.compute.manager [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] No waiting events found dispatching network-vif-plugged-e1506948-cd44-4d78-a019-853199016229 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:54:59 user nova-compute[71557]: WARNING nova.compute.manager [req-d8ce48c6-a14a-42a6-a00c-dac650b69644 req-3b2f09fe-9131-40f6-b33d-c907f68976ed service nova] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Received unexpected event network-vif-plugged-e1506948-cd44-4d78-a019-853199016229 for instance with vm_state active and task_state deleting.
Apr 12 10:54:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:54:59 user nova-compute[71557]: INFO os_vif [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:75:17,bridge_name='br-int',has_traffic_filtering=True,id=e1506948-cd44-4d78-a019-853199016229,network=Network(49a2fb41-5e5e-4d4b-969a-0043778b4b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1506948-cd')
Apr 12 10:54:59 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Deleting instance files /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9_del
Apr 12 10:54:59 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Deletion of /opt/stack/data/nova/instances/0f55cab4-8530-4be0-a91d-65671f0dccd9_del complete
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:54:59 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:54:59 user nova-compute[71557]: INFO nova.compute.manager [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Took 5.17 seconds to spawn the instance on the hypervisor.
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:54:59 user nova-compute[71557]: INFO nova.compute.manager [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Took 0.72 seconds to destroy the instance on the hypervisor.
Apr 12 10:54:59 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:54:59 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:54:59 user nova-compute[71557]: INFO nova.compute.manager [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Took 10.62 seconds to build instance.
Apr 12 10:54:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ee1b527b-dbb8-43d5-a910-993ddd998f01 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.727s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:55:00 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Took 0.64 seconds to deallocate network for instance.
Apr 12 10:55:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-1417e259-6e44-4bd2-8660-6a9d664e81b2 req-5e506e6d-e6e2-44e6-a909-6586c5bbf9ab service nova] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Received event network-vif-deleted-e1506948-cd44-4d78-a019-853199016229 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALPnYqXr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:55:00 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:55:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:55:00 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:55:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:55:00 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:00 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Deleted allocations for instance 0f55cab4-8530-4be0-a91d-65671f0dccd9
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1833dab0-b1d7-4c12-88eb-7eb593651022]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:55:00 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9981a6f-a701-4fdb-87a0-1405b8810df5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223] added
Apr 12 10:55:00 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabfac83-d44f-485f-8c33-2260be3c0219]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-db5d8e4d-c5ac-4573-8d76-2a2d24cc09c9 tempest-ServerBootFromVolumeStableRescueTest-1826285115 tempest-ServerBootFromVolumeStableRescueTest-1826285115-project-member] Lock "0f55cab4-8530-4be0-a91d-65671f0dccd9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.902s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68a2288-8371-4f29-acce-b4102561616f]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ALPnYqXr {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ALPnYqXr" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57c9cc4-3094-43c4-8ce4-f3c5c6008b58]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ALPnYqXr'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc821899-1460-4194-8b1a-830be24e35f2]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b187a2a1-b257-429d-a96a-81882a124337]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:55:00 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:55:00 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:55:00 user nova-compute[71557]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:55:00 user nova-compute[71557]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:55:00 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:55:00 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:55:00 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:55:00 user nova-compute[71557]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:55:00 user nova-compute[71557]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:55:00 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:55:00 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:01 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9c9a48-f1c8-4ed3-b755-e80332b58746]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:01 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223, portal: 172.16.0.220,3260]
Apr 12 10:55:01 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223, portal: 172.16.0.220,3260] successful.
Apr 12 10:55:01 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:55:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:01 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[149959c9-9537-4118-90aa-eefc0aef3362]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:01 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:55:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:01 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ad302b-f083-49c8-bc80-0b088efbbd34]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:01 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:55:01 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:55:01 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:55:01 user nova-compute[71557]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:55:01 user nova-compute[71557]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:55:01 user nova-compute[71557]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 (non-flash)
Apr 12 10:55:01 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:55:01 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:55:01 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:55:01 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:55:01 user nova-compute[71557]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:55:01 user nova-compute[71557]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:55:01 user nova-compute[71557]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 (non-flash)
Apr 12 10:55:01 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:55:01 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:55:01 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:55:01 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] HCTL ('38', '-', '-', 0) found on session 42 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:55:01 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:55:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:01 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:01 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[638f70d7-019a-41ce-8e49-bb6c7fe8a136]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:01 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Searching for a device in session 42 and hctl ['38', '*', '*', 0] yield: None {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:55:02 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Searching for a device in session 42 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:55:02 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALPnYqXr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:55:02 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:55:02 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23062653833353139', 'path': '/dev/sdg'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:55:02 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062653833353139', 'path': '/dev/sdg'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:55:02 user nova-compute[71557]: DEBUG nova.objects.instance [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'flavor' on Instance uuid fcd57d3d-16cb-4b4e-8785-ae15027621a5 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:55:02 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 10:55:02 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:55:02 user nova-compute[71557]:   <source dev="/dev/sdg"/>
Apr 12 10:55:02 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:55:02 user nova-compute[71557]:   <serial>b178c67e-b2d3-4f88-a2f0-c78db142c223</serial>
Apr 12 10:55:02 user nova-compute[71557]: </disk>
Apr 12 10:55:02 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 10:55:02 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:55:02 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:55:02 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] No VIF found with MAC fa:16:3e:9a:98:b5, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:55:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-23680bb7-efd2-4201-be2c-444ff806ca8b tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.467s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:55:04 user nova-compute[71557]: INFO nova.compute.manager [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Detaching volume b178c67e-b2d3-4f88-a2f0-c78db142c223
Apr 12 10:55:04 user nova-compute[71557]: INFO nova.virt.block_device [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Attempting to driver detach volume b178c67e-b2d3-4f88-a2f0-c78db142c223 from mountpoint /dev/vdb
Apr 12 10:55:04 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Attempting to detach device vdb from instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:55:04 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:55:04 user nova-compute[71557]:   <source dev="/dev/sdg"/>
Apr 12 10:55:04 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:55:04 user nova-compute[71557]:   <serial>b178c67e-b2d3-4f88-a2f0-c78db142c223</serial>
Apr 12 10:55:04 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:55:04 user nova-compute[71557]: </disk>
Apr 12 10:55:04 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:55:04 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Successfully detached device vdb from instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 from the persistent domain config.
Apr 12 10:55:04 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:55:04 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:55:04 user nova-compute[71557]:   <source dev="/dev/sdg"/>
Apr 12 10:55:04 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:55:04 user nova-compute[71557]:   <serial>b178c67e-b2d3-4f88-a2f0-c78db142c223</serial>
Apr 12 10:55:04 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:55:04 user nova-compute[71557]: </disk>
Apr 12 10:55:04 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681296904.6548185, fcd57d3d-16cb-4b4e-8785-ae15027621a5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 10:55:04 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Successfully detached device vdb from instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 from the live domain config.
Apr 12 10:55:04 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALPnYqXr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:55:04 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:55:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1c99d7-8024-487f-88d7-0e4a9f788158]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:55:04 user nova-compute[71557]: No targets found.
Apr 12 10:55:04 user nova-compute[71557]: iSNS:
Apr 12 10:55:04 user nova-compute[71557]: No targets found.
Apr 12 10:55:04 user nova-compute[71557]: STATIC:
Apr 12 10:55:04 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193
Apr 12 10:55:04 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:55:04 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:55:04 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53
Apr 12 10:55:04 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:55:04 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:55:04 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1
Apr 12 10:55:04 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:55:04 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:55:04 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4
Apr 12 10:55:04 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:55:04 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:55:04 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223
Apr 12 10:55:04 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:55:04 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:55:04 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9
Apr 12 10:55:04 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:55:04 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:55:04 user nova-compute[71557]: FIRMWARE:
Apr 12 10:55:04 user nova-compute[71557]: No targets found.
Apr 12 10:55:04 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:55:04 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:55:04 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45a4a18-f6a0-46fc-9121-f22882e8d914]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[297c31cd-b6d1-428e-859c-a87d2b8eea16]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:55:04 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:55:04 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:55:04 user nova-compute[71557]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:55:04 user nova-compute[71557]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:55:04 user nova-compute[71557]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 (non-flash)
Apr 12 10:55:04 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:55:04 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:55:04 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:55:04 user nova-compute[71557]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:55:04 user nova-compute[71557]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:55:04 user nova-compute[71557]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 (non-flash)
Apr 12 10:55:04 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fc423a290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223'): ({'sdg'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Removing single pathed devices sdg {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d548cead-1921-423f-bb46-cf8de83e4696]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8465b5-c821-4e19-be4b-9073dced4116]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Flushing IO for device /dev/sdg {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1903dd-dd1e-4c86-a8e0-be52808ea467]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.058s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f7c4d4-5c62-4077-9311-d7802f37fbb5]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] SCSI volumes sdg have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a471b40-844f-427c-9a5e-2e69de0ac7df]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ba8e23-99d8-4e1b-93a8-cbc8ca76f204]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223, portal: 172.16.0.220,3260]
Apr 12 10:55:04 user nova-compute[71557]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223, portal: 172.16.0.220,3260] successful.
Apr 12 10:55:04 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b178c67e-b2d3-4f88-a2f0-c78db142c223 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd93a07b-0468-4a44-9402-780dcbf56e6d]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] <== disconnect_volume: return (328ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:55:04 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:55:05 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296890.566037, 2aef35e7-5daf-4d41-b91b-a7ff4a481644 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:55:05 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] VM Stopped (Lifecycle Event)
Apr 12 10:55:05 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f09731c0-cb2b-4dcd-9c96-b5a522f852dd None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:55:05 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f09731c0-cb2b-4dcd-9c96-b5a522f852dd None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:55:05 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'flavor' on Instance uuid fcd57d3d-16cb-4b4e-8785-ae15027621a5 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:55:05 user nova-compute[71557]: DEBUG nova.compute.manager [req-abe3b02d-e994-4153-81f8-3da8cf24b6dd req-7855383b-a080-4d97-ade9-a94afb0a830b service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Received event network-changed-66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:55:05 user nova-compute[71557]: DEBUG nova.compute.manager [req-abe3b02d-e994-4153-81f8-3da8cf24b6dd req-7855383b-a080-4d97-ade9-a94afb0a830b service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Refreshing instance network info cache due to event network-changed-66db319f-02d8-4e75-b71a-2b2d136671a9. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:55:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-abe3b02d-e994-4153-81f8-3da8cf24b6dd req-7855383b-a080-4d97-ade9-a94afb0a830b service nova] Acquiring lock "refresh_cache-cdc51c71-9d3b-4957-b912-0666c68b46fc" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:55:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-abe3b02d-e994-4153-81f8-3da8cf24b6dd req-7855383b-a080-4d97-ade9-a94afb0a830b service nova] Acquired lock "refresh_cache-cdc51c71-9d3b-4957-b912-0666c68b46fc" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:55:05 user nova-compute[71557]: DEBUG nova.network.neutron [req-abe3b02d-e994-4153-81f8-3da8cf24b6dd req-7855383b-a080-4d97-ade9-a94afb0a830b service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Refreshing network info cache for port 66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:55:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a1f7658a-ff92-421e-b787-6894b2ff2750 tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.839s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:55:06 user nova-compute[71557]: DEBUG nova.network.neutron [req-abe3b02d-e994-4153-81f8-3da8cf24b6dd req-7855383b-a080-4d97-ade9-a94afb0a830b service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Updated VIF entry in instance network info cache for port 66db319f-02d8-4e75-b71a-2b2d136671a9. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:55:06 user nova-compute[71557]: DEBUG nova.network.neutron [req-abe3b02d-e994-4153-81f8-3da8cf24b6dd req-7855383b-a080-4d97-ade9-a94afb0a830b service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Updating instance_info_cache with network_info: [{"id": "66db319f-02d8-4e75-b71a-2b2d136671a9", "address": "fa:16:3e:c3:0b:b8", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66db319f-02", "ovs_interfaceid": "66db319f-02d8-4e75-b71a-2b2d136671a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:55:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-abe3b02d-e994-4153-81f8-3da8cf24b6dd req-7855383b-a080-4d97-ade9-a94afb0a830b service nova] Releasing lock "refresh_cache-cdc51c71-9d3b-4957-b912-0666c68b46fc" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:55:06 user nova-compute[71557]: DEBUG nova.compute.manager [req-338a9869-a9fa-4697-ab5c-49431f84d09d req-be55a1b5-625c-431c-8d47-c5bd10e8e729 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Received event network-changed-66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:55:06 user nova-compute[71557]: DEBUG nova.compute.manager [req-338a9869-a9fa-4697-ab5c-49431f84d09d req-be55a1b5-625c-431c-8d47-c5bd10e8e729 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Refreshing instance network info cache due to event network-changed-66db319f-02d8-4e75-b71a-2b2d136671a9. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:55:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-338a9869-a9fa-4697-ab5c-49431f84d09d req-be55a1b5-625c-431c-8d47-c5bd10e8e729 service nova] Acquiring lock "refresh_cache-cdc51c71-9d3b-4957-b912-0666c68b46fc" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:55:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-338a9869-a9fa-4697-ab5c-49431f84d09d req-be55a1b5-625c-431c-8d47-c5bd10e8e729 service nova] Acquired lock "refresh_cache-cdc51c71-9d3b-4957-b912-0666c68b46fc" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:55:06 user nova-compute[71557]: DEBUG nova.network.neutron [req-338a9869-a9fa-4697-ab5c-49431f84d09d req-be55a1b5-625c-431c-8d47-c5bd10e8e729 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Refreshing network info cache for port 66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "cdc51c71-9d3b-4957-b912-0666c68b46fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:55:07 user nova-compute[71557]: INFO nova.compute.manager [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Detaching volume ab32971b-fad9-41b7-8447-224947e10d53
Apr 12 10:55:07 user nova-compute[71557]: INFO nova.virt.block_device [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Attempting to driver detach volume ab32971b-fad9-41b7-8447-224947e10d53 from mountpoint /dev/vdb
Apr 12 10:55:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Attempting to detach device vdb from instance cdc51c71-9d3b-4957-b912-0666c68b46fc from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:55:07 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:55:07 user nova-compute[71557]:   <source dev="/dev/sde"/>
Apr 12 10:55:07 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:55:07 user nova-compute[71557]:   <serial>ab32971b-fad9-41b7-8447-224947e10d53</serial>
Apr 12 10:55:07 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:55:07 user nova-compute[71557]: </disk>
Apr 12 10:55:07 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:55:07 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Successfully detached device vdb from instance cdc51c71-9d3b-4957-b912-0666c68b46fc from the persistent domain config.
Apr 12 10:55:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cdc51c71-9d3b-4957-b912-0666c68b46fc from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:55:07 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:55:07 user nova-compute[71557]:   <source dev="/dev/sde"/>
Apr 12 10:55:07 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:55:07 user nova-compute[71557]:   <serial>ab32971b-fad9-41b7-8447-224947e10d53</serial>
Apr 12 10:55:07 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:55:07 user nova-compute[71557]: </disk>
Apr 12 10:55:07 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG nova.network.neutron [req-338a9869-a9fa-4697-ab5c-49431f84d09d req-be55a1b5-625c-431c-8d47-c5bd10e8e729 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Updated VIF entry in instance network info cache for port 66db319f-02d8-4e75-b71a-2b2d136671a9. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG nova.network.neutron [req-338a9869-a9fa-4697-ab5c-49431f84d09d req-be55a1b5-625c-431c-8d47-c5bd10e8e729 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Updating instance_info_cache with network_info: [{"id": "66db319f-02d8-4e75-b71a-2b2d136671a9", "address": "fa:16:3e:c3:0b:b8", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66db319f-02", "ovs_interfaceid": "66db319f-02d8-4e75-b71a-2b2d136671a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-338a9869-a9fa-4697-ab5c-49431f84d09d req-be55a1b5-625c-431c-8d47-c5bd10e8e729 service nova] Releasing lock "refresh_cache-cdc51c71-9d3b-4957-b912-0666c68b46fc" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681296907.5832117, cdc51c71-9d3b-4957-b912-0666c68b46fc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cdc51c71-9d3b-4957-b912-0666c68b46fc {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 10:55:07 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Successfully detached device vdb from instance cdc51c71-9d3b-4957-b912-0666c68b46fc from the live domain config.
Apr 12 10:55:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUgJYjmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:55:07 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:55:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a230163e-faee-4cab-bc29-860077dfc8b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:55:07 user nova-compute[71557]: No targets found.
Apr 12 10:55:07 user nova-compute[71557]: iSNS:
Apr 12 10:55:07 user nova-compute[71557]: No targets found.
Apr 12 10:55:07 user nova-compute[71557]: STATIC:
Apr 12 10:55:07 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193
Apr 12 10:55:07 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:55:07 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:55:07 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53
Apr 12 10:55:07 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:55:07 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:55:07 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1
Apr 12 10:55:07 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:55:07 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:55:07 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4
Apr 12 10:55:07 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:55:07 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:55:07 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9
Apr 12 10:55:07 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:55:07 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:55:07 user nova-compute[71557]: FIRMWARE:
Apr 12 10:55:07 user nova-compute[71557]: No targets found.
Apr 12 10:55:07 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:55:07 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:55:07 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[950d79a1-fa14-476b-8b85-55e9eb1e5403]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ccb17a-03ee-4f66-bc71-7e613ca7dd51]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:55:07 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:55:07 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:55:07 user nova-compute[71557]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:55:07 user nova-compute[71557]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:55:07 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 (non-flash)
Apr 12 10:55:07 user nova-compute[71557]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:55:07 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:55:07 user nova-compute[71557]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:55:07 user nova-compute[71557]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:55:07 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd425cca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53'): ({'sde'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Removing single pathed devices sde {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3717bcce-e02e-405b-a0bd-95529de7a81c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[668b692a-cfc4-4fa7-897c-e23d77a16be7]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Flushing IO for device /dev/sde {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ebf24f-29a4-4b91-8bb3-d8b04cfe8850]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[793d1010-55f9-477e-8522-b6d7593606ba]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] SCSI volumes sde have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3e018e-c7f8-4336-8233-8fd5aa1baca7]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[329f772c-77d6-448a-b8bd-186738bfb0af]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53, portal: 172.16.0.220,3260]
Apr 12 10:55:07 user nova-compute[71557]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53, portal: 172.16.0.220,3260] successful.
Apr 12 10:55:07 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab32971b-fad9-41b7-8447-224947e10d53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8980bf-1409-4acc-934c-a84c5e535e97]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] <== disconnect_volume: return (302ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:55:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:55:08 user nova-compute[71557]: DEBUG nova.objects.instance [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lazy-loading 'flavor' on Instance uuid cdc51c71-9d3b-4957-b912-0666c68b46fc {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:55:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-0d56c779-1029-490e-a473-fe57da145640 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.614s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:55:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:11 user nova-compute[71557]: INFO nova.compute.manager [None req-09362c88-139a-42cc-bab2-d3286238f2ac tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Unrescuing
Apr 12 10:55:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-09362c88-139a-42cc-bab2-d3286238f2ac tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "refresh_cache-faa11b52-f2b6-45aa-937f-7468095ddb22" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:55:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-09362c88-139a-42cc-bab2-d3286238f2ac tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquired lock "refresh_cache-faa11b52-f2b6-45aa-937f-7468095ddb22" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:55:11 user nova-compute[71557]: DEBUG nova.network.neutron [None req-09362c88-139a-42cc-bab2-d3286238f2ac tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:55:12 user nova-compute[71557]: DEBUG nova.network.neutron [None req-09362c88-139a-42cc-bab2-d3286238f2ac tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Updating instance_info_cache with network_info: [{"id": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "address": "fa:16:3e:c9:da:1c", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46213af2-2a", "ovs_interfaceid": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:55:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-09362c88-139a-42cc-bab2-d3286238f2ac tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Releasing lock "refresh_cache-faa11b52-f2b6-45aa-937f-7468095ddb22" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:55:12 user nova-compute[71557]: DEBUG nova.objects.instance [None req-09362c88-139a-42cc-bab2-d3286238f2ac tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'flavor' on Instance uuid faa11b52-f2b6-45aa-937f-7468095ddb22 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:55:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-d443a66c-96b7-408b-906c-3dcb2cbbeee1 req-49a41dc4-d423-40e4-b3cf-5fd190e1926f service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received event network-vif-unplugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:55:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d443a66c-96b7-408b-906c-3dcb2cbbeee1 req-49a41dc4-d423-40e4-b3cf-5fd190e1926f service nova] Acquiring lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:55:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d443a66c-96b7-408b-906c-3dcb2cbbeee1 req-49a41dc4-d423-40e4-b3cf-5fd190e1926f service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:55:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d443a66c-96b7-408b-906c-3dcb2cbbeee1 req-49a41dc4-d423-40e4-b3cf-5fd190e1926f service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:55:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-d443a66c-96b7-408b-906c-3dcb2cbbeee1 req-49a41dc4-d423-40e4-b3cf-5fd190e1926f service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] No waiting events found dispatching network-vif-unplugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:55:12 user nova-compute[71557]: WARNING nova.compute.manager [req-d443a66c-96b7-408b-906c-3dcb2cbbeee1 req-49a41dc4-d423-40e4-b3cf-5fd190e1926f service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received unexpected event network-vif-unplugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance with vm_state rescued and task_state unrescuing.
Apr 12 10:55:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:12 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Instance destroyed successfully.
Apr 12 10:55:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-33f723b4-65da-4117-894f-61cd9ae22b80 req-cfa83a21-44d4-45e5-aaeb-f643e76162af service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received event network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:55:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-33f723b4-65da-4117-894f-61cd9ae22b80 req-cfa83a21-44d4-45e5-aaeb-f643e76162af service nova] Acquiring lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:55:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-33f723b4-65da-4117-894f-61cd9ae22b80 req-cfa83a21-44d4-45e5-aaeb-f643e76162af service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:55:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-33f723b4-65da-4117-894f-61cd9ae22b80 req-cfa83a21-44d4-45e5-aaeb-f643e76162af service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:55:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-33f723b4-65da-4117-894f-61cd9ae22b80 req-cfa83a21-44d4-45e5-aaeb-f643e76162af service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] No waiting events found dispatching network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:55:14 user nova-compute[71557]: WARNING nova.compute.manager [req-33f723b4-65da-4117-894f-61cd9ae22b80 req-cfa83a21-44d4-45e5-aaeb-f643e76162af service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received unexpected event network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance with vm_state rescued and task_state unrescuing.
Apr 12 10:55:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-33f723b4-65da-4117-894f-61cd9ae22b80 req-cfa83a21-44d4-45e5-aaeb-f643e76162af service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received event network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:55:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-33f723b4-65da-4117-894f-61cd9ae22b80 req-cfa83a21-44d4-45e5-aaeb-f643e76162af service nova] Acquiring lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:55:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-33f723b4-65da-4117-894f-61cd9ae22b80 req-cfa83a21-44d4-45e5-aaeb-f643e76162af service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:55:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-33f723b4-65da-4117-894f-61cd9ae22b80 req-cfa83a21-44d4-45e5-aaeb-f643e76162af service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:55:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-33f723b4-65da-4117-894f-61cd9ae22b80 req-cfa83a21-44d4-45e5-aaeb-f643e76162af service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] No waiting events found dispatching network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:55:14 user nova-compute[71557]: WARNING nova.compute.manager [req-33f723b4-65da-4117-894f-61cd9ae22b80 req-cfa83a21-44d4-45e5-aaeb-f643e76162af service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received unexpected event network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance with vm_state rescued and task_state unrescuing.
Apr 12 10:55:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:14 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296899.4944708, 0f55cab4-8530-4be0-a91d-65671f0dccd9 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:55:14 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] VM Stopped (Lifecycle Event)
Apr 12 10:55:14 user nova-compute[71557]: DEBUG nova.compute.manager [None req-896a74da-b176-4cd6-bdcd-c3a4f0f7eac0 None None] [instance: 0f55cab4-8530-4be0-a91d-65671f0dccd9] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:55:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.host [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Removed pending event for faa11b52-f2b6-45aa-937f-7468095ddb22 due to event {{(pid=71557) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 10:55:16 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296916.1636417, faa11b52-f2b6-45aa-937f-7468095ddb22 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:55:16 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] VM Resumed (Lifecycle Event)
Apr 12 10:55:16 user nova-compute[71557]: DEBUG nova.compute.manager [None req-09362c88-139a-42cc-bab2-d3286238f2ac tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:55:16 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:55:16 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:55:16 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 10:55:16 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681296916.1650348, faa11b52-f2b6-45aa-937f-7468095ddb22 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:55:16 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] VM Started (Lifecycle Event)
Apr 12 10:55:16 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:55:16 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:55:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-4275cfff-e62b-4aec-8484-6453311f9027 req-eb896110-6dce-41ec-ab38-c0744f1dfba4 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received event network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:55:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4275cfff-e62b-4aec-8484-6453311f9027 req-eb896110-6dce-41ec-ab38-c0744f1dfba4 service nova] Acquiring lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:55:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4275cfff-e62b-4aec-8484-6453311f9027 req-eb896110-6dce-41ec-ab38-c0744f1dfba4 service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:55:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4275cfff-e62b-4aec-8484-6453311f9027 req-eb896110-6dce-41ec-ab38-c0744f1dfba4 service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:55:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-4275cfff-e62b-4aec-8484-6453311f9027 req-eb896110-6dce-41ec-ab38-c0744f1dfba4 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] No waiting events found dispatching network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:55:16 user nova-compute[71557]: WARNING nova.compute.manager [req-4275cfff-e62b-4aec-8484-6453311f9027 req-eb896110-6dce-41ec-ab38-c0744f1dfba4 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received unexpected event network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance with vm_state active and task_state None.
Apr 12 10:55:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:55:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 10:55:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:55:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:55:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "0cb22a78-94df-49fb-918c-32856e1b5136" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:55:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "0cb22a78-94df-49fb-918c-32856e1b5136" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:55:29 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Going to confirm migration 2 {{(pid=71557) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 12 10:55:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:29 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:55:29 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:55:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "refresh_cache-0cb22a78-94df-49fb-918c-32856e1b5136" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:55:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquired lock "refresh_cache-0cb22a78-94df-49fb-918c-32856e1b5136" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:55:29 user nova-compute[71557]: DEBUG nova.network.neutron [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:55:29 user nova-compute[71557]: DEBUG nova.objects.instance [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'info_cache' on Instance uuid 0cb22a78-94df-49fb-918c-32856e1b5136 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:55:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:29 user nova-compute[71557]: DEBUG nova.network.neutron [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Updating instance_info_cache with network_info: [{"id": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "address": "fa:16:3e:e3:f1:6d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225efc65-26", "ovs_interfaceid": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:55:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Releasing lock "refresh_cache-0cb22a78-94df-49fb-918c-32856e1b5136" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:55:29 user nova-compute[71557]: DEBUG nova.objects.instance [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'migration_context' on Instance uuid 0cb22a78-94df-49fb-918c-32856e1b5136 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:55:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:55:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:55:30 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:55:30 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:55:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.336s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:55:30 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Deleted allocation for migration 2fb831f6-d091-4c04-b56c-c6dcc28b3384
Apr 12 10:55:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c2a3bb22-7fb6-4327-848c-6f75b933d36a tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "0cb22a78-94df-49fb-918c-32856e1b5136" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.314s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:55:32 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:55:33 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:55:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:34 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:55:34 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:55:34 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Rebuilding the list of instances to heal {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 10:55:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-be3f67e5-420d-42a2-b68a-7cadff22fa48" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:55:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-be3f67e5-420d-42a2-b68a-7cadff22fa48" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:55:34 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:55:34 user nova-compute[71557]: DEBUG nova.objects.instance [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lazy-loading 'info_cache' on Instance uuid be3f67e5-420d-42a2-b68a-7cadff22fa48 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:55:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:34 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Updating instance_info_cache with network_info: [{"id": "943dbed4-3180-4221-b27c-710c0118b7cf", "address": "fa:16:3e:d5:a9:3b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap943dbed4-31", "ovs_interfaceid": "943dbed4-3180-4221-b27c-710c0118b7cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:55:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-be3f67e5-420d-42a2-b68a-7cadff22fa48" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:55:34 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:55:34 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:55:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:55:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:55:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:55:34 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:55:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:55:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:55:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:55:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:55:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:55:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:55:37 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:55:37 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:55:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=7812MB free_disk=26.119205474853516GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:55:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:55:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:55:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:55:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 97bafe22-36bf-4939-baf8-9602551bad52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:55:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:55:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance cdc51c71-9d3b-4957-b912-0666c68b46fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:55:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance faa11b52-f2b6-45aa-937f-7468095ddb22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:55:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:55:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance fcd57d3d-16cb-4b4e-8785-ae15027621a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:55:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0cb22a78-94df-49fb-918c-32856e1b5136 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:55:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:55:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:55:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1728MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:55:38 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:55:38 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:55:38 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:55:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:55:38 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:55:38 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:55:38 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:55:38 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:55:39 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:55:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:55:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:51 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:55:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:55:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:55:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:55:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:55:54 user nova-compute[71557]: INFO nova.compute.manager [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Terminating instance
Apr 12 10:55:54 user nova-compute[71557]: DEBUG nova.compute.manager [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:55:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:54 user nova-compute[71557]: DEBUG nova.compute.manager [req-dc60e6da-5479-4c28-8b13-9c31fdf0f6c2 req-3abc88c1-b5a6-4686-96b7-264e3390d42a service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Received event network-vif-unplugged-4372d146-13c3-4479-84ba-bdf514061696 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:55:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-dc60e6da-5479-4c28-8b13-9c31fdf0f6c2 req-3abc88c1-b5a6-4686-96b7-264e3390d42a service nova] Acquiring lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:55:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-dc60e6da-5479-4c28-8b13-9c31fdf0f6c2 req-3abc88c1-b5a6-4686-96b7-264e3390d42a service nova] Lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:55:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-dc60e6da-5479-4c28-8b13-9c31fdf0f6c2 req-3abc88c1-b5a6-4686-96b7-264e3390d42a service nova] Lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:55:54 user nova-compute[71557]: DEBUG nova.compute.manager [req-dc60e6da-5479-4c28-8b13-9c31fdf0f6c2 req-3abc88c1-b5a6-4686-96b7-264e3390d42a service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] No waiting events found dispatching network-vif-unplugged-4372d146-13c3-4479-84ba-bdf514061696 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:55:54 user nova-compute[71557]: DEBUG nova.compute.manager [req-dc60e6da-5479-4c28-8b13-9c31fdf0f6c2 req-3abc88c1-b5a6-4686-96b7-264e3390d42a service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Received event network-vif-unplugged-4372d146-13c3-4479-84ba-bdf514061696 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:55:55 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Instance destroyed successfully.
Apr 12 10:55:55 user nova-compute[71557]: DEBUG nova.objects.instance [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lazy-loading 'resources' on Instance uuid fcd57d3d-16cb-4b4e-8785-ae15027621a5 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:55:55 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1560426502',display_name='tempest-AttachVolumeNegativeTest-server-1560426502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1560426502',id=39,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+hB5VUXtE8B/YaMiFQ2YUKHLAghyGHpe7cu33U+wTFBemejCfwunXyySeBzqPTLAjvTdvbP0Krte07gGPW8AcjjlLUZvUIYG48wpov2PrAl8Hw38NY5EVmxBCiRNse7Q==',key_name='tempest-keypair-1567303486',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:53:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3cecbfbfd5f42dbb663367f6fbdf3b0',ramdisk_id='',reservation_id='r-hluh7l0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-249658876',owner_user_name='tempest-AttachVolumeNegativeTest-249658876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:53:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ec47d3cdacb45e5a39509e76b546e34',uuid=fcd57d3d-16cb-4b4e-8785-ae15027621a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4372d146-13c3-4479-84ba-bdf514061696", "address": "fa:16:3e:9a:98:b5", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4372d146-13", "ovs_interfaceid": "4372d146-13c3-4479-84ba-bdf514061696", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:55:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converting VIF {"id": "4372d146-13c3-4479-84ba-bdf514061696", "address": "fa:16:3e:9a:98:b5", "network": {"id": "ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-734185384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3cecbfbfd5f42dbb663367f6fbdf3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4372d146-13", "ovs_interfaceid": "4372d146-13c3-4479-84ba-bdf514061696", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:55:55 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:98:b5,bridge_name='br-int',has_traffic_filtering=True,id=4372d146-13c3-4479-84ba-bdf514061696,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4372d146-13') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:55:55 user nova-compute[71557]: DEBUG os_vif [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:98:b5,bridge_name='br-int',has_traffic_filtering=True,id=4372d146-13c3-4479-84ba-bdf514061696,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4372d146-13') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:55:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4372d146-13, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:55:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:55:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:55 user nova-compute[71557]: INFO os_vif [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:98:b5,bridge_name='br-int',has_traffic_filtering=True,id=4372d146-13c3-4479-84ba-bdf514061696,network=Network(ab5e2871-7cdf-4910-b6c5-dde1a3cb3ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4372d146-13')
Apr 12 10:55:55 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Deleting instance files /opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5_del
Apr 12 10:55:55 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Deletion of /opt/stack/data/nova/instances/fcd57d3d-16cb-4b4e-8785-ae15027621a5_del complete
Apr 12 10:55:55 user nova-compute[71557]: INFO nova.compute.manager [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 10:55:55 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:55:55 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:55:55 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:55:55 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:55:56 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Took 0.64 seconds to deallocate network for instance.
Apr 12 10:55:56 user nova-compute[71557]: DEBUG nova.compute.manager [req-5a5f6328-f5ff-4531-b6c4-3942b4b53b77 req-54eb7fbc-2157-48cf-a4e7-0702ff037760 service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Received event network-vif-deleted-4372d146-13c3-4479-84ba-bdf514061696 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:55:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:55:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:55:56 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:55:56 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:55:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:55:56 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Deleted allocations for instance fcd57d3d-16cb-4b4e-8785-ae15027621a5
Apr 12 10:55:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8b1a33a1-a24b-492c-9752-d994423cd7ac tempest-AttachVolumeNegativeTest-249658876 tempest-AttachVolumeNegativeTest-249658876-project-member] Lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.049s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:55:56 user nova-compute[71557]: DEBUG nova.compute.manager [req-231db428-488c-421b-9715-a476d58e27fa req-4bc0c8bf-3595-44b8-98d7-c985f20b7f00 service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Received event network-vif-plugged-4372d146-13c3-4479-84ba-bdf514061696 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:55:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-231db428-488c-421b-9715-a476d58e27fa req-4bc0c8bf-3595-44b8-98d7-c985f20b7f00 service nova] Acquiring lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:55:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-231db428-488c-421b-9715-a476d58e27fa req-4bc0c8bf-3595-44b8-98d7-c985f20b7f00 service nova] Lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:55:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-231db428-488c-421b-9715-a476d58e27fa req-4bc0c8bf-3595-44b8-98d7-c985f20b7f00 service nova] Lock "fcd57d3d-16cb-4b4e-8785-ae15027621a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:55:56 user nova-compute[71557]: DEBUG nova.compute.manager [req-231db428-488c-421b-9715-a476d58e27fa req-4bc0c8bf-3595-44b8-98d7-c985f20b7f00 service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] No waiting events found dispatching network-vif-plugged-4372d146-13c3-4479-84ba-bdf514061696 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:55:56 user nova-compute[71557]: WARNING nova.compute.manager [req-231db428-488c-421b-9715-a476d58e27fa req-4bc0c8bf-3595-44b8-98d7-c985f20b7f00 service nova] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Received unexpected event network-vif-plugged-4372d146-13c3-4479-84ba-bdf514061696 for instance with vm_state deleted and task_state None.
Apr 12 10:55:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "cdc51c71-9d3b-4957-b912-0666c68b46fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:55:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:55:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:55:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:55:59 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:55:59 user nova-compute[71557]: INFO nova.compute.manager [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Terminating instance
Apr 12 10:55:59 user nova-compute[71557]: DEBUG nova.compute.manager [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:55:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:55:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-5a891a40-7a3f-49ab-83c7-02d5b9d3a5ff req-8ad7cbad-851a-48ef-890b-d4286798a3b6 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Received event network-vif-unplugged-66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:56:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5a891a40-7a3f-49ab-83c7-02d5b9d3a5ff req-8ad7cbad-851a-48ef-890b-d4286798a3b6 service nova] Acquiring lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:56:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5a891a40-7a3f-49ab-83c7-02d5b9d3a5ff req-8ad7cbad-851a-48ef-890b-d4286798a3b6 service nova] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:56:00 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5a891a40-7a3f-49ab-83c7-02d5b9d3a5ff req-8ad7cbad-851a-48ef-890b-d4286798a3b6 service nova] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:56:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-5a891a40-7a3f-49ab-83c7-02d5b9d3a5ff req-8ad7cbad-851a-48ef-890b-d4286798a3b6 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] No waiting events found dispatching network-vif-unplugged-66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:56:00 user nova-compute[71557]: DEBUG nova.compute.manager [req-5a891a40-7a3f-49ab-83c7-02d5b9d3a5ff req-8ad7cbad-851a-48ef-890b-d4286798a3b6 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Received event network-vif-unplugged-66db319f-02d8-4e75-b71a-2b2d136671a9 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:56:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:00 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Instance destroyed successfully.
Apr 12 10:56:00 user nova-compute[71557]: DEBUG nova.objects.instance [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lazy-loading 'resources' on Instance uuid cdc51c71-9d3b-4957-b912-0666c68b46fc {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:56:00 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:51:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1484132394',display_name='tempest-TestMinimumBasicScenario-server-1484132394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1484132394',id=35,image_ref='92fcccc4-57d4-4cb0-872e-507fce12c392',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0xYo/U9olcXUxWVNjyonA9aJ0xsZ/BfTVAGlL1ocRIDzPvg0PLVDDRxGGzI3LZdJJOo5Z6xxzKLkV/HZdcy8X23bxA81QZoa7yGQZyd2sGv0R6G4fpT0+Ec3zh6AfZuQ==',key_name='tempest-TestMinimumBasicScenario-2078556363',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:51:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b467fac451ee466fb93cec3d3aa3b408',ramdisk_id='',reservation_id='r-wzir7w0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='92fcccc4-57d4-4cb0-872e-507fce12c392',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2095634766',owner_user_name='tempest-TestMinimumBasicScenario-2095634766-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:53:23Z,user_data=None,user_id='a633ec4046a9467683cbfd2ebe59600f',uuid=cdc51c71-9d3b-4957-b912-0666c68b46fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66db319f-02d8-4e75-b71a-2b2d136671a9", "address": "fa:16:3e:c3:0b:b8", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66db319f-02", "ovs_interfaceid": "66db319f-02d8-4e75-b71a-2b2d136671a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:56:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Converting VIF {"id": "66db319f-02d8-4e75-b71a-2b2d136671a9", "address": "fa:16:3e:c3:0b:b8", "network": {"id": "d284a588-7406-446d-af3c-874a119b7536", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-176255989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b467fac451ee466fb93cec3d3aa3b408", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66db319f-02", "ovs_interfaceid": "66db319f-02d8-4e75-b71a-2b2d136671a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:56:00 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:0b:b8,bridge_name='br-int',has_traffic_filtering=True,id=66db319f-02d8-4e75-b71a-2b2d136671a9,network=Network(d284a588-7406-446d-af3c-874a119b7536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66db319f-02') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:56:00 user nova-compute[71557]: DEBUG os_vif [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:0b:b8,bridge_name='br-int',has_traffic_filtering=True,id=66db319f-02d8-4e75-b71a-2b2d136671a9,network=Network(d284a588-7406-446d-af3c-874a119b7536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66db319f-02') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:56:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66db319f-02, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:56:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:56:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:00 user nova-compute[71557]: INFO os_vif [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:0b:b8,bridge_name='br-int',has_traffic_filtering=True,id=66db319f-02d8-4e75-b71a-2b2d136671a9,network=Network(d284a588-7406-446d-af3c-874a119b7536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66db319f-02')
Apr 12 10:56:00 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Deleting instance files /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc_del
Apr 12 10:56:00 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Deletion of /opt/stack/data/nova/instances/cdc51c71-9d3b-4957-b912-0666c68b46fc_del complete
Apr 12 10:56:00 user nova-compute[71557]: INFO nova.compute.manager [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 12 10:56:00 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:56:00 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:56:00 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:56:01 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:56:01 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Took 0.76 seconds to deallocate network for instance.
Apr 12 10:56:01 user nova-compute[71557]: DEBUG nova.compute.manager [req-3c860943-8aea-4239-9955-12c3e7f6e773 req-8503cf7b-54f5-4a64-95ec-0bb05cce62e4 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Received event network-vif-deleted-66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:56:01 user nova-compute[71557]: INFO nova.compute.manager [req-3c860943-8aea-4239-9955-12c3e7f6e773 req-8503cf7b-54f5-4a64-95ec-0bb05cce62e4 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Neutron deleted interface 66db319f-02d8-4e75-b71a-2b2d136671a9; detaching it from the instance and deleting it from the info cache
Apr 12 10:56:01 user nova-compute[71557]: DEBUG nova.network.neutron [req-3c860943-8aea-4239-9955-12c3e7f6e773 req-8503cf7b-54f5-4a64-95ec-0bb05cce62e4 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:56:01 user nova-compute[71557]: DEBUG nova.compute.manager [req-3c860943-8aea-4239-9955-12c3e7f6e773 req-8503cf7b-54f5-4a64-95ec-0bb05cce62e4 service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Detach interface failed, port_id=66db319f-02d8-4e75-b71a-2b2d136671a9, reason: Instance cdc51c71-9d3b-4957-b912-0666c68b46fc could not be found. {{(pid=71557) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 10:56:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:56:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:56:01 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:56:01 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:56:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:56:01 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Deleted allocations for instance cdc51c71-9d3b-4957-b912-0666c68b46fc
Apr 12 10:56:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-63b6e406-2b98-4207-97e0-e0f91a776f70 tempest-TestMinimumBasicScenario-2095634766 tempest-TestMinimumBasicScenario-2095634766-project-member] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.061s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:56:02 user nova-compute[71557]: DEBUG nova.compute.manager [req-b431979e-3048-4e21-afc0-e210fe501a58 req-1154dd4e-2751-43ee-93f2-7f8364182fef service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Received event network-vif-plugged-66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:56:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b431979e-3048-4e21-afc0-e210fe501a58 req-1154dd4e-2751-43ee-93f2-7f8364182fef service nova] Acquiring lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:56:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b431979e-3048-4e21-afc0-e210fe501a58 req-1154dd4e-2751-43ee-93f2-7f8364182fef service nova] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:56:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b431979e-3048-4e21-afc0-e210fe501a58 req-1154dd4e-2751-43ee-93f2-7f8364182fef service nova] Lock "cdc51c71-9d3b-4957-b912-0666c68b46fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:56:02 user nova-compute[71557]: DEBUG nova.compute.manager [req-b431979e-3048-4e21-afc0-e210fe501a58 req-1154dd4e-2751-43ee-93f2-7f8364182fef service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] No waiting events found dispatching network-vif-plugged-66db319f-02d8-4e75-b71a-2b2d136671a9 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:56:02 user nova-compute[71557]: WARNING nova.compute.manager [req-b431979e-3048-4e21-afc0-e210fe501a58 req-1154dd4e-2751-43ee-93f2-7f8364182fef service nova] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Received unexpected event network-vif-plugged-66db319f-02d8-4e75-b71a-2b2d136671a9 for instance with vm_state deleted and task_state None.
Apr 12 10:56:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:10 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296955.2534688, fcd57d3d-16cb-4b4e-8785-ae15027621a5 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:56:10 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] VM Stopped (Lifecycle Event)
Apr 12 10:56:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-05f2249b-6940-4b01-bb71-4da5da8a31ac None None] [instance: fcd57d3d-16cb-4b4e-8785-ae15027621a5] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:56:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:15 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681296960.5469022, cdc51c71-9d3b-4957-b912-0666c68b46fc => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:56:15 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] VM Stopped (Lifecycle Event)
Apr 12 10:56:15 user nova-compute[71557]: DEBUG nova.compute.manager [None req-17ad3eba-25b2-49d4-bee0-f471766df621 None None] [instance: cdc51c71-9d3b-4957-b912-0666c68b46fc] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:56:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:56:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 10:56:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:56:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:56:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:56:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:31 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:56:31 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:56:31 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:56:34 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:56:34 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:56:34 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:56:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-97bafe22-36bf-4939-baf8-9602551bad52" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:56:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-97bafe22-36bf-4939-baf8-9602551bad52" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:56:34 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:56:34 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Updating instance_info_cache with network_info: [{"id": "580ed46e-ff10-494f-b864-42eda726a7ff", "address": "fa:16:3e:a7:62:8b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580ed46e-ff", "ovs_interfaceid": "580ed46e-ff10-494f-b864-42eda726a7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:56:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-97bafe22-36bf-4939-baf8-9602551bad52" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:56:34 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:56:34 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:56:34 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:56:34 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Cleaning up deleted instances with incomplete migration  {{(pid=71557) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 10:56:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:56:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:56:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:56:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:56:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:56:35 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:56:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:56:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:56:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:56:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:56:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:56:37 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:56:37 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:56:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=8108MB free_disk=26.147613525390625GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:56:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:56:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:56:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:56:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 97bafe22-36bf-4939-baf8-9602551bad52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:56:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:56:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance faa11b52-f2b6-45aa-937f-7468095ddb22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:56:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:56:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0cb22a78-94df-49fb-918c-32856e1b5136 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:56:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:56:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:56:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:56:38 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:56:38 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:56:38 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:56:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:56:39 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:56:39 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:56:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Cleaning up deleted instances {{(pid=71557) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 10:56:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] There are 0 instances to clean {{(pid=71557) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 10:56:40 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:56:40 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:56:40 user nova-compute[71557]: DEBUG nova.objects.instance [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'flavor' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:56:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "refresh_cache-2aef35e7-5daf-4d41-b91b-a7ff4a481644" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:56:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquired lock "refresh_cache-2aef35e7-5daf-4d41-b91b-a7ff4a481644" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:56:40 user nova-compute[71557]: DEBUG nova.network.neutron [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:56:40 user nova-compute[71557]: DEBUG nova.objects.instance [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'info_cache' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:56:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.network.neutron [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Updating instance_info_cache with network_info: [{"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Releasing lock "refresh_cache-2aef35e7-5daf-4d41-b91b-a7ff4a481644" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:56:41 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Instance destroyed successfully.
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.objects.instance [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'resources' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:52:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1710761960',display_name='tempest-AttachVolumeTestJSON-server-1710761960',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1710761960',id=38,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQLwZrl3jPnPhohKnRnR2qfd8ly9sETNwW4CsnbJ63gmB7R0QElmNz5jXYfSBpJs0XqGEZmxFm/4XJScQktvDrpb6FHDkQYZ7pSrXVh9P+kxqpboxMoLpeKxHkx0WwNzw==',key_name='tempest-keypair-1222347782',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:52:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9878bfe34ceb4a6695b253ad161c4f7b',ramdisk_id='',reservation_id='r-u8xhdlhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1953237893',owner_user_name='tempest-AttachVolumeTestJSON-1953237893-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:54:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6576467073e41e9b497097d5a8dfd3d',uuid=2aef35e7-5daf-4d41-b91b-a7ff4a481644,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converting VIF {"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=8786a087-f036-403b-9b82-c75fc6dbb110,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8786a087-f0') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_vif [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=8786a087-f036-403b-9b82-c75fc6dbb110,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8786a087-f0') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8786a087-f0, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:56:41 user nova-compute[71557]: INFO os_vif [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=8786a087-f036-403b-9b82-c75fc6dbb110,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8786a087-f0')
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MndrmjNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:56:41 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7655fc-2dbc-4260-b458-b78e30b1f596]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:56:41 user nova-compute[71557]: No targets found.
Apr 12 10:56:41 user nova-compute[71557]: iSNS:
Apr 12 10:56:41 user nova-compute[71557]: No targets found.
Apr 12 10:56:41 user nova-compute[71557]: STATIC:
Apr 12 10:56:41 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193
Apr 12 10:56:41 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:56:41 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:56:41 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1
Apr 12 10:56:41 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:56:41 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:56:41 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4
Apr 12 10:56:41 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:56:41 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:56:41 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9
Apr 12 10:56:41 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:56:41 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:56:41 user nova-compute[71557]: FIRMWARE:
Apr 12 10:56:41 user nova-compute[71557]: No targets found.
Apr 12 10:56:41 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:56:41 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:56:41 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[884d70f5-73f8-4870-8a97-6dc661c5ab11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f96c5d-2f50-4927-8f95-1dcecf16df72]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:56:41 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:56:41 user nova-compute[71557]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:56:41 user nova-compute[71557]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:56:41 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:56:41 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:56:41 user nova-compute[71557]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:56:41 user nova-compute[71557]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:56:41 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd40c6170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1'): ({'sdb'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Removing single pathed devices sdb {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10a4879-ffce-42a2-86fd-aa2adbaf7edd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c905df-4397-4293-be11-b36c975a6474]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Flushing IO for device /dev/sdb {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee36bc0-0b27-4012-9cf9-ae4df16aafae]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c2bb86-f3b0-4753-a8fc-3fa8e18ff6c0]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53f8415-0b95-4a41-932d-2252e0f1b9aa]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ece9e5-4dfc-4b33-b184-1d8b7ba2306e]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1, portal: 172.16.0.220,3260]
Apr 12 10:56:41 user nova-compute[71557]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1, portal: 172.16.0.220,3260] successful.
Apr 12 10:56:41 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dbf482-86d8-4b51-a147-0f2e6ae82d8c]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] <== disconnect_volume: return (347ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Start _get_guest_xml network_info=[{"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'attachment_id': '6aac6dd6-66d4-42f4-a297-1e0951d50187', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MndrmjNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '2aef35e7-5daf-4d41-b91b-a7ff4a481644', 'attached_at': '', 'detached_at': '', 'volume_id': '811e93eb-e600-41b9-ad7c-577a0f9938d1', 'serial': '811e93eb-e600-41b9-ad7c-577a0f9938d1'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.objects.instance [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'numa_topology' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:56:41 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:56:41 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.objects.instance [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MndrmjNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:56:41 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:56:41 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:56:41 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31b32af-d5df-4231-af29-9546bf09a15a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:56:41 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d940cbd-315a-4e75-850b-5f39765210ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1] added
Apr 12 10:56:41 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51bcc17-8429-4b22-aa2f-b35a5a2e9af4]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[90534862-cd81-414d-b46c-c205f7f74172]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MndrmjNh {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MndrmjNh" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ede5eea-7101-46d7-8768-5da59585ae6e]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MndrmjNh'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4733213-ba0a-4ee2-8cbe-5aaa93a09e42]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f1f18d-1435-4ab1-acf3-cbef4b7fd424]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:56:41 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:56:41 user nova-compute[71557]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:56:41 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:56:41 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:56:41 user nova-compute[71557]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:56:41 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-d9d7d633-7589-4136-a0f7-f47cd7713693 req-75758ca6-f300-42f7-9966-c94fc03a4ac3 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Received event network-changed-f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-d9d7d633-7589-4136-a0f7-f47cd7713693 req-75758ca6-f300-42f7-9966-c94fc03a4ac3 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Refreshing instance network info cache due to event network-changed-f3314b2f-1470-40cb-9699-71a5020d2bff. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d9d7d633-7589-4136-a0f7-f47cd7713693 req-75758ca6-f300-42f7-9966-c94fc03a4ac3 service nova] Acquiring lock "refresh_cache-95469ca9-8f8d-4755-8a00-4e2f5689f3de" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d9d7d633-7589-4136-a0f7-f47cd7713693 req-75758ca6-f300-42f7-9966-c94fc03a4ac3 service nova] Acquired lock "refresh_cache-95469ca9-8f8d-4755-8a00-4e2f5689f3de" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG nova.network.neutron [req-d9d7d633-7589-4136-a0f7-f47cd7713693 req-75758ca6-f300-42f7-9966-c94fc03a4ac3 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Refreshing network info cache for port f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[607e2cfe-369b-47b2-a98f-357f919306c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1, portal: 172.16.0.220,3260]
Apr 12 10:56:41 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1, portal: 172.16.0.220,3260] successful.
Apr 12 10:56:41 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[486a4648-ae8f-432e-9cbb-f4111bec3021]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4300bb93-d1c9-4a56-ab1b-40bfd0536714]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:56:41 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:56:41 user nova-compute[71557]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:56:41 user nova-compute[71557]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:56:41 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:56:41 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:56:41 user nova-compute[71557]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:56:41 user nova-compute[71557]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:56:41 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:56:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:56:42 user nova-compute[71557]: INFO nova.compute.manager [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Terminating instance
Apr 12 10:56:42 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac2ca99-e40e-4ec5-879d-e84f38f6a582]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MndrmjNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG nova.compute.manager [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG nova.compute.manager [req-528b5a72-1ffd-4047-a7df-d2ded44f82ae req-d36e4bfb-05b8-4c91-8562-022501a1e47b service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Received event network-vif-unplugged-f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-528b5a72-1ffd-4047-a7df-d2ded44f82ae req-d36e4bfb-05b8-4c91-8562-022501a1e47b service nova] Acquiring lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-528b5a72-1ffd-4047-a7df-d2ded44f82ae req-d36e4bfb-05b8-4c91-8562-022501a1e47b service nova] Lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-528b5a72-1ffd-4047-a7df-d2ded44f82ae req-d36e4bfb-05b8-4c91-8562-022501a1e47b service nova] Lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG nova.compute.manager [req-528b5a72-1ffd-4047-a7df-d2ded44f82ae req-d36e4bfb-05b8-4c91-8562-022501a1e47b service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] No waiting events found dispatching network-vif-unplugged-f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG nova.compute.manager [req-528b5a72-1ffd-4047-a7df-d2ded44f82ae req-d36e4bfb-05b8-4c91-8562-022501a1e47b service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Received event network-vif-unplugged-f3314b2f-1470-40cb-9699-71a5020d2bff for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG nova.network.neutron [req-d9d7d633-7589-4136-a0f7-f47cd7713693 req-75758ca6-f300-42f7-9966-c94fc03a4ac3 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Updated VIF entry in instance network info cache for port f3314b2f-1470-40cb-9699-71a5020d2bff. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG nova.network.neutron [req-d9d7d633-7589-4136-a0f7-f47cd7713693 req-75758ca6-f300-42f7-9966-c94fc03a4ac3 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Updating instance_info_cache with network_info: [{"id": "f3314b2f-1470-40cb-9699-71a5020d2bff", "address": "fa:16:3e:64:ca:1c", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314b2f-14", "ovs_interfaceid": "f3314b2f-1470-40cb-9699-71a5020d2bff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d9d7d633-7589-4136-a0f7-f47cd7713693 req-75758ca6-f300-42f7-9966-c94fc03a4ac3 service nova] Releasing lock "refresh_cache-95469ca9-8f8d-4755-8a00-4e2f5689f3de" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:42 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Instance destroyed successfully.
Apr 12 10:56:42 user nova-compute[71557]: DEBUG nova.objects.instance [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lazy-loading 'resources' on Instance uuid 95469ca9-8f8d-4755-8a00-4e2f5689f3de {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:54:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1015870463',display_name='tempest-TestVolumeBootPattern-server-1015870463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1015870463',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeNYUbBfSwdaJdVL2RMsgRRuPmOdMNSAwl/DHzaeVhE0fDjZe84+pAYZqsgenmNqm/u0yGuL1KeKxxwsT2FNR2LdwQFC7iIcZOaTovpAXdmD/5wx/0lhCQf7gPsmZ5xfg==',key_name='tempest-TestVolumeBootPattern-162796269',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:54:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a67f3d23b8f74a9496d445c7fc75717e',ramdisk_id='',reservation_id='r-hbhz4mck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-638607559',owner_user_name='tempest-TestVolumeBootPattern-638607559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:55:00Z,user_data=None,user_id='b914d7ca786f455baf120f98816abffd',uuid=95469ca9-8f8d-4755-8a00-4e2f5689f3de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3314b2f-1470-40cb-9699-71a5020d2bff", "address": "fa:16:3e:64:ca:1c", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314b2f-14", "ovs_interfaceid": "f3314b2f-1470-40cb-9699-71a5020d2bff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converting VIF {"id": "f3314b2f-1470-40cb-9699-71a5020d2bff", "address": "fa:16:3e:64:ca:1c", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314b2f-14", "ovs_interfaceid": "f3314b2f-1470-40cb-9699-71a5020d2bff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:ca:1c,bridge_name='br-int',has_traffic_filtering=True,id=f3314b2f-1470-40cb-9699-71a5020d2bff,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3314b2f-14') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG os_vif [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:ca:1c,bridge_name='br-int',has_traffic_filtering=True,id=f3314b2f-1470-40cb-9699-71a5020d2bff,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3314b2f-14') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3314b2f-14, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:56:42 user nova-compute[71557]: INFO os_vif [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:ca:1c,bridge_name='br-int',has_traffic_filtering=True,id=f3314b2f-1470-40cb-9699-71a5020d2bff,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3314b2f-14')
Apr 12 10:56:42 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:56:42 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyTZNWEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:56:42 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:56:42 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23939653132343033', 'path': '/dev/sdb'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939653132343033', 'path': '/dev/sdb'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.205s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c4a688-b760-4a1e-b1d2-4dbadd0e5282]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:56:43 user nova-compute[71557]: No targets found.
Apr 12 10:56:43 user nova-compute[71557]: iSNS:
Apr 12 10:56:43 user nova-compute[71557]: No targets found.
Apr 12 10:56:43 user nova-compute[71557]: STATIC:
Apr 12 10:56:43 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193
Apr 12 10:56:43 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:56:43 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:56:43 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1
Apr 12 10:56:43 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:56:43 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:56:43 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4
Apr 12 10:56:43 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:56:43 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:56:43 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9
Apr 12 10:56:43 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:56:43 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:56:43 user nova-compute[71557]: FIRMWARE:
Apr 12 10:56:43 user nova-compute[71557]: No targets found.
Apr 12 10:56:43 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:56:43 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:56:43 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:52:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1710761960',display_name='tempest-AttachVolumeTestJSON-server-1710761960',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1710761960',id=38,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQLwZrl3jPnPhohKnRnR2qfd8ly9sETNwW4CsnbJ63gmB7R0QElmNz5jXYfSBpJs0XqGEZmxFm/4XJScQktvDrpb6FHDkQYZ7pSrXVh9P+kxqpboxMoLpeKxHkx0WwNzw==',key_name='tempest-keypair-1222347782',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:52:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9878bfe34ceb4a6695b253ad161c4f7b',ramdisk_id='',reservation_id='r-u8xhdlhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1953237893',owner_user_name='tempest-AttachVolumeTestJSON-1953237893-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:54:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6576467073e41e9b497097d5a8dfd3d',uuid=2aef35e7-5daf-4d41-b91b-a7ff4a481644,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converting VIF {"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=8786a087-f036-403b-9b82-c75fc6dbb110,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8786a087-f0') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG nova.objects.instance [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'pci_devices' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac21f8de-37d2-4ac4-af3d-af0b727270fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:56:43 user nova-compute[71557]:   <uuid>2aef35e7-5daf-4d41-b91b-a7ff4a481644</uuid>
Apr 12 10:56:43 user nova-compute[71557]:   <name>instance-00000026</name>
Apr 12 10:56:43 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:56:43 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:56:43 user nova-compute[71557]:   <metadata>
Apr 12 10:56:43 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:56:43 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:56:43 user nova-compute[71557]:       <nova:name>tempest-AttachVolumeTestJSON-server-1710761960</nova:name>
Apr 12 10:56:43 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:56:41</nova:creationTime>
Apr 12 10:56:43 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:56:43 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:56:43 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:56:43 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:56:43 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:56:43 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:56:43 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:56:43 user nova-compute[71557]:       <nova:owner>
Apr 12 10:56:43 user nova-compute[71557]:         <nova:user uuid="f6576467073e41e9b497097d5a8dfd3d">tempest-AttachVolumeTestJSON-1953237893-project-member</nova:user>
Apr 12 10:56:43 user nova-compute[71557]:         <nova:project uuid="9878bfe34ceb4a6695b253ad161c4f7b">tempest-AttachVolumeTestJSON-1953237893</nova:project>
Apr 12 10:56:43 user nova-compute[71557]:       </nova:owner>
Apr 12 10:56:43 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:56:43 user nova-compute[71557]:       <nova:ports>
Apr 12 10:56:43 user nova-compute[71557]:         <nova:port uuid="8786a087-f036-403b-9b82-c75fc6dbb110">
Apr 12 10:56:43 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 10:56:43 user nova-compute[71557]:         </nova:port>
Apr 12 10:56:43 user nova-compute[71557]:       </nova:ports>
Apr 12 10:56:43 user nova-compute[71557]:     </nova:instance>
Apr 12 10:56:43 user nova-compute[71557]:   </metadata>
Apr 12 10:56:43 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:56:43 user nova-compute[71557]:     <system>
Apr 12 10:56:43 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:56:43 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:56:43 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:56:43 user nova-compute[71557]:       <entry name="serial">2aef35e7-5daf-4d41-b91b-a7ff4a481644</entry>
Apr 12 10:56:43 user nova-compute[71557]:       <entry name="uuid">2aef35e7-5daf-4d41-b91b-a7ff4a481644</entry>
Apr 12 10:56:43 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:56:43 user nova-compute[71557]:     </system>
Apr 12 10:56:43 user nova-compute[71557]:   </sysinfo>
Apr 12 10:56:43 user nova-compute[71557]:   <os>
Apr 12 10:56:43 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:56:43 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:56:43 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:56:43 user nova-compute[71557]:   </os>
Apr 12 10:56:43 user nova-compute[71557]:   <features>
Apr 12 10:56:43 user nova-compute[71557]:     <acpi/>
Apr 12 10:56:43 user nova-compute[71557]:     <apic/>
Apr 12 10:56:43 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:56:43 user nova-compute[71557]:   </features>
Apr 12 10:56:43 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:56:43 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:56:43 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:56:43 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:56:43 user nova-compute[71557]:   </clock>
Apr 12 10:56:43 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:56:43 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:56:43 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:56:43 user nova-compute[71557]:   </cpu>
Apr 12 10:56:43 user nova-compute[71557]:   <devices>
Apr 12 10:56:43 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:56:43 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:56:43 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk"/>
Apr 12 10:56:43 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:56:43 user nova-compute[71557]:     </disk>
Apr 12 10:56:43 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:56:43 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:56:43 user nova-compute[71557]:       <source dev="/dev/sdb"/>
Apr 12 10:56:43 user nova-compute[71557]:       <target dev="vdb" bus="virtio"/>
Apr 12 10:56:43 user nova-compute[71557]:       <serial>811e93eb-e600-41b9-ad7c-577a0f9938d1</serial>
Apr 12 10:56:43 user nova-compute[71557]:     </disk>
Apr 12 10:56:43 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:56:43 user nova-compute[71557]:       <mac address="fa:16:3e:59:45:ef"/>
Apr 12 10:56:43 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:56:43 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:56:43 user nova-compute[71557]:       <target dev="tap8786a087-f0"/>
Apr 12 10:56:43 user nova-compute[71557]:     </interface>
Apr 12 10:56:43 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:56:43 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/console.log" append="off"/>
Apr 12 10:56:43 user nova-compute[71557]:     </serial>
Apr 12 10:56:43 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:56:43 user nova-compute[71557]:     <video>
Apr 12 10:56:43 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:56:43 user nova-compute[71557]:     </video>
Apr 12 10:56:43 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:56:43 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:56:43 user nova-compute[71557]:     </rng>
Apr 12 10:56:43 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:56:43 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:56:43 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:56:43 user nova-compute[71557]:     </memballoon>
Apr 12 10:56:43 user nova-compute[71557]:   </devices>
Apr 12 10:56:43 user nova-compute[71557]: </domain>
Apr 12 10:56:43 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[888c0e8f-36df-44ce-aa52-8a8fc9b21488]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:56:43 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:56:43 user nova-compute[71557]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:56:43 user nova-compute[71557]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:56:43 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:56:43 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:56:43 user nova-compute[71557]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:56:43 user nova-compute[71557]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:56:43 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fe12d8310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9'): ({'sdc'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Removing single pathed devices sdc {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b467f6-f6c9-41ff-ae17-dfb0788aa0eb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21a2e2d-9199-4af7-9064-f11d4f2525ae]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flushing IO for device /dev/sdc {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7dd33b-6629-4590-a112-31f12ba61826]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5f3c47-ec1b-4568-b081-341ccbe104fa]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] SCSI volumes sdc have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fc90aa-b672-4839-829d-bded6da42332]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[773127f3-0825-461c-aa7b-8e73461a6b52]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9, portal: 172.16.0.220,3260]
Apr 12 10:56:43 user nova-compute[71557]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9, portal: 172.16.0.220,3260] successful.
Apr 12 10:56:43 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[634d14e1-793d-4c1e-bdf9-c427b6ce1419]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] <== disconnect_volume: return (602ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:56:43 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Deleting instance files /opt/stack/data/nova/instances/95469ca9-8f8d-4755-8a00-4e2f5689f3de_del
Apr 12 10:56:43 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Deletion of /opt/stack/data/nova/instances/95469ca9-8f8d-4755-8a00-4e2f5689f3de_del complete
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG nova.objects.instance [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:43 user nova-compute[71557]: INFO nova.compute.manager [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Took 1.49 seconds to destroy the instance on the hypervisor.
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.145s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Cannot resize image /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG nova.objects.instance [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'migration_context' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:52:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1710761960',display_name='tempest-AttachVolumeTestJSON-server-1710761960',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1710761960',id=38,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQLwZrl3jPnPhohKnRnR2qfd8ly9sETNwW4CsnbJ63gmB7R0QElmNz5jXYfSBpJs0XqGEZmxFm/4XJScQktvDrpb6FHDkQYZ7pSrXVh9P+kxqpboxMoLpeKxHkx0WwNzw==',key_name='tempest-keypair-1222347782',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:52:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='9878bfe34ceb4a6695b253ad161c4f7b',ramdisk_id='',reservation_id='r-u8xhdlhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1953237893',owner_user_name='tempest-AttachVolumeTestJSON-1953237893-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:54:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6576467073e41e9b497097d5a8dfd3d',uuid=2aef35e7-5daf-4d41-b91b-a7ff4a481644,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converting VIF {"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=8786a087-f036-403b-9b82-c75fc6dbb110,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8786a087-f0') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG os_vif [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=8786a087-f036-403b-9b82-c75fc6dbb110,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8786a087-f0') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8786a087-f0, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8786a087-f0, col_values=(('external_ids', {'iface-id': '8786a087-f036-403b-9b82-c75fc6dbb110', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:45:ef', 'vm-uuid': '2aef35e7-5daf-4d41-b91b-a7ff4a481644'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:56:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:43 user nova-compute[71557]: INFO os_vif [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=8786a087-f036-403b-9b82-c75fc6dbb110,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8786a087-f0')
Apr 12 10:56:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:56:44 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Took 0.98 seconds to deallocate network for instance.
Apr 12 10:56:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-3823279f-e050-48cd-87fe-fa5d2ed38d84 req-69fef239-9e3a-48fa-94c3-883b57e7c216 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Received event network-vif-deleted-f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:56:44 user nova-compute[71557]: INFO nova.compute.manager [req-3823279f-e050-48cd-87fe-fa5d2ed38d84 req-69fef239-9e3a-48fa-94c3-883b57e7c216 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Neutron deleted interface f3314b2f-1470-40cb-9699-71a5020d2bff; detaching it from the instance and deleting it from the info cache
Apr 12 10:56:44 user nova-compute[71557]: DEBUG nova.network.neutron [req-3823279f-e050-48cd-87fe-fa5d2ed38d84 req-69fef239-9e3a-48fa-94c3-883b57e7c216 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Received event network-vif-plugged-f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Acquiring lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] No waiting events found dispatching network-vif-plugged-f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:56:44 user nova-compute[71557]: WARNING nova.compute.manager [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Received unexpected event network-vif-plugged-f3314b2f-1470-40cb-9699-71a5020d2bff for instance with vm_state active and task_state deleting.
Apr 12 10:56:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Received event network-vif-plugged-f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Acquiring lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] No waiting events found dispatching network-vif-plugged-f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:56:44 user nova-compute[71557]: WARNING nova.compute.manager [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Received unexpected event network-vif-plugged-f3314b2f-1470-40cb-9699-71a5020d2bff for instance with vm_state active and task_state deleting.
Apr 12 10:56:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Received event network-vif-plugged-f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Acquiring lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] No waiting events found dispatching network-vif-plugged-f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:56:44 user nova-compute[71557]: WARNING nova.compute.manager [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Received unexpected event network-vif-plugged-f3314b2f-1470-40cb-9699-71a5020d2bff for instance with vm_state active and task_state deleting.
Apr 12 10:56:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Received event network-vif-unplugged-f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Acquiring lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] No waiting events found dispatching network-vif-unplugged-f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Received event network-vif-unplugged-f3314b2f-1470-40cb-9699-71a5020d2bff for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Received event network-vif-plugged-f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Acquiring lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] Lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:56:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] No waiting events found dispatching network-vif-plugged-f3314b2f-1470-40cb-9699-71a5020d2bff {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:56:44 user nova-compute[71557]: WARNING nova.compute.manager [req-5ecd63ef-c38a-493c-8aa7-f60c52488392 req-52cdb553-1949-4804-b2ff-f9ec424aba60 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Received unexpected event network-vif-plugged-f3314b2f-1470-40cb-9699-71a5020d2bff for instance with vm_state active and task_state deleting.
Apr 12 10:56:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-3823279f-e050-48cd-87fe-fa5d2ed38d84 req-69fef239-9e3a-48fa-94c3-883b57e7c216 service nova] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Detach interface failed, port_id=f3314b2f-1470-40cb-9699-71a5020d2bff, reason: Instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de could not be found. {{(pid=71557) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 10:56:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:45 user nova-compute[71557]: INFO nova.compute.manager [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Took 0.95 seconds to detach 1 volumes for instance.
Apr 12 10:56:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:56:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:56:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:45 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:56:45 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:56:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:56:45 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Deleted allocations for instance 95469ca9-8f8d-4755-8a00-4e2f5689f3de
Apr 12 10:56:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bab9bc60-d862-44fb-b583-ade08fb7dd98 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "95469ca9-8f8d-4755-8a00-4e2f5689f3de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.036s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:56:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-4b5d24e3-a231-4815-be6d-9d1fd07da310 req-c9cc6565-5f5c-4673-ac65-b947644b73d8 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received event network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:56:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4b5d24e3-a231-4815-be6d-9d1fd07da310 req-c9cc6565-5f5c-4673-ac65-b947644b73d8 service nova] Acquiring lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:56:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4b5d24e3-a231-4815-be6d-9d1fd07da310 req-c9cc6565-5f5c-4673-ac65-b947644b73d8 service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:56:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4b5d24e3-a231-4815-be6d-9d1fd07da310 req-c9cc6565-5f5c-4673-ac65-b947644b73d8 service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:56:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-4b5d24e3-a231-4815-be6d-9d1fd07da310 req-c9cc6565-5f5c-4673-ac65-b947644b73d8 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] No waiting events found dispatching network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:56:46 user nova-compute[71557]: WARNING nova.compute.manager [req-4b5d24e3-a231-4815-be6d-9d1fd07da310 req-c9cc6565-5f5c-4673-ac65-b947644b73d8 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received unexpected event network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 for instance with vm_state stopped and task_state powering-on.
Apr 12 10:56:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-4b5d24e3-a231-4815-be6d-9d1fd07da310 req-c9cc6565-5f5c-4673-ac65-b947644b73d8 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received event network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:56:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4b5d24e3-a231-4815-be6d-9d1fd07da310 req-c9cc6565-5f5c-4673-ac65-b947644b73d8 service nova] Acquiring lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:56:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4b5d24e3-a231-4815-be6d-9d1fd07da310 req-c9cc6565-5f5c-4673-ac65-b947644b73d8 service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:56:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-4b5d24e3-a231-4815-be6d-9d1fd07da310 req-c9cc6565-5f5c-4673-ac65-b947644b73d8 service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:56:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-4b5d24e3-a231-4815-be6d-9d1fd07da310 req-c9cc6565-5f5c-4673-ac65-b947644b73d8 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] No waiting events found dispatching network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:56:46 user nova-compute[71557]: WARNING nova.compute.manager [req-4b5d24e3-a231-4815-be6d-9d1fd07da310 req-c9cc6565-5f5c-4673-ac65-b947644b73d8 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received unexpected event network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 for instance with vm_state stopped and task_state powering-on.
Apr 12 10:56:47 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681297007.3566442, 2aef35e7-5daf-4d41-b91b-a7ff4a481644 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:56:47 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] VM Resumed (Lifecycle Event)
Apr 12 10:56:47 user nova-compute[71557]: DEBUG nova.compute.manager [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:56:47 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Instance rebooted successfully.
Apr 12 10:56:47 user nova-compute[71557]: DEBUG nova.compute.manager [None req-e7d45c89-5cd8-430c-9499-9cfd9f3e78aa tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:56:47 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:56:47 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:56:47 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 12 10:56:47 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681297007.3580475, 2aef35e7-5daf-4d41-b91b-a7ff4a481644 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:56:47 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] VM Started (Lifecycle Event)
Apr 12 10:56:47 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:56:47 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:56:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:56 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:57 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681297002.7756903, 95469ca9-8f8d-4755-8a00-4e2f5689f3de => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:56:57 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] VM Stopped (Lifecycle Event)
Apr 12 10:56:57 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0e366c64-da8a-4132-9297-5038e9ca8214 None None] [instance: 95469ca9-8f8d-4755-8a00-4e2f5689f3de] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:56:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:56:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:03 user nova-compute[71557]: DEBUG nova.compute.manager [req-843c53e2-d1d9-406b-ba74-d04a3bf1fd65 req-0450a45f-9071-42ec-ad98-68c51bf4b417 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received event network-changed-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:57:03 user nova-compute[71557]: DEBUG nova.compute.manager [req-843c53e2-d1d9-406b-ba74-d04a3bf1fd65 req-0450a45f-9071-42ec-ad98-68c51bf4b417 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Refreshing instance network info cache due to event network-changed-46213af2-2a93-4502-9f35-eda3d5b9f7fc. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:57:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-843c53e2-d1d9-406b-ba74-d04a3bf1fd65 req-0450a45f-9071-42ec-ad98-68c51bf4b417 service nova] Acquiring lock "refresh_cache-faa11b52-f2b6-45aa-937f-7468095ddb22" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:57:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-843c53e2-d1d9-406b-ba74-d04a3bf1fd65 req-0450a45f-9071-42ec-ad98-68c51bf4b417 service nova] Acquired lock "refresh_cache-faa11b52-f2b6-45aa-937f-7468095ddb22" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:57:03 user nova-compute[71557]: DEBUG nova.network.neutron [req-843c53e2-d1d9-406b-ba74-d04a3bf1fd65 req-0450a45f-9071-42ec-ad98-68c51bf4b417 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Refreshing network info cache for port 46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:57:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "faa11b52-f2b6-45aa-937f-7468095ddb22" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:57:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:57:03 user nova-compute[71557]: INFO nova.compute.manager [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Detaching volume e7d3b210-cbed-4d4a-8f47-f68cd0560193
Apr 12 10:57:03 user nova-compute[71557]: INFO nova.virt.block_device [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Attempting to driver detach volume e7d3b210-cbed-4d4a-8f47-f68cd0560193 from mountpoint /dev/vdb
Apr 12 10:57:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Attempting to detach device vdb from instance faa11b52-f2b6-45aa-937f-7468095ddb22 from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 10:57:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:57:03 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:57:03 user nova-compute[71557]:   <source dev="/dev/sdf"/>
Apr 12 10:57:03 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:57:03 user nova-compute[71557]:   <serial>e7d3b210-cbed-4d4a-8f47-f68cd0560193</serial>
Apr 12 10:57:03 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:57:03 user nova-compute[71557]: </disk>
Apr 12 10:57:03 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:57:03 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Successfully detached device vdb from instance faa11b52-f2b6-45aa-937f-7468095ddb22 from the persistent domain config.
Apr 12 10:57:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance faa11b52-f2b6-45aa-937f-7468095ddb22 from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 10:57:03 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:57:03 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:57:03 user nova-compute[71557]:   <source dev="/dev/sdf"/>
Apr 12 10:57:03 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:57:03 user nova-compute[71557]:   <serial>e7d3b210-cbed-4d4a-8f47-f68cd0560193</serial>
Apr 12 10:57:03 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:57:03 user nova-compute[71557]: </disk>
Apr 12 10:57:03 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:57:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:03 user nova-compute[71557]: DEBUG nova.network.neutron [req-843c53e2-d1d9-406b-ba74-d04a3bf1fd65 req-0450a45f-9071-42ec-ad98-68c51bf4b417 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Updated VIF entry in instance network info cache for port 46213af2-2a93-4502-9f35-eda3d5b9f7fc. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:57:03 user nova-compute[71557]: DEBUG nova.network.neutron [req-843c53e2-d1d9-406b-ba74-d04a3bf1fd65 req-0450a45f-9071-42ec-ad98-68c51bf4b417 service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Updating instance_info_cache with network_info: [{"id": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "address": "fa:16:3e:c9:da:1c", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46213af2-2a", "ovs_interfaceid": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:57:03 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-843c53e2-d1d9-406b-ba74-d04a3bf1fd65 req-0450a45f-9071-42ec-ad98-68c51bf4b417 service nova] Releasing lock "refresh_cache-faa11b52-f2b6-45aa-937f-7468095ddb22" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681297024.129357, faa11b52-f2b6-45aa-937f-7468095ddb22 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance faa11b52-f2b6-45aa-937f-7468095ddb22 {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 10:57:04 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Successfully detached device vdb from instance faa11b52-f2b6-45aa-937f-7468095ddb22 from the live domain config.
Apr 12 10:57:04 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AklEFjuH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:57:04 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:57:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1022097-7b99-4ac4-85f3-c934b1c77a8c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:57:04 user nova-compute[71557]: No targets found.
Apr 12 10:57:04 user nova-compute[71557]: iSNS:
Apr 12 10:57:04 user nova-compute[71557]: No targets found.
Apr 12 10:57:04 user nova-compute[71557]: STATIC:
Apr 12 10:57:04 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193
Apr 12 10:57:04 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:57:04 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:57:04 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1
Apr 12 10:57:04 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:57:04 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:57:04 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4
Apr 12 10:57:04 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:57:04 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:57:04 user nova-compute[71557]: FIRMWARE:
Apr 12 10:57:04 user nova-compute[71557]: No targets found.
Apr 12 10:57:04 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:57:04 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:57:04 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7e2afc-c437-4fa7-a2b6-7e511c1ec77f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d58e8b8-dc17-47f7-88e4-299659bb07a4]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:57:04 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:57:04 user nova-compute[71557]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:57:04 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 (non-flash)
Apr 12 10:57:04 user nova-compute[71557]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:57:04 user nova-compute[71557]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:57:04 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fa4542830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193'): ({'sdf'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Removing single pathed devices sdf {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0169bfa0-c7db-4cc5-8f11-d1592c60361c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1159fa-4349-4992-af53-81d638589b5a]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Flushing IO for device /dev/sdf {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10bbccf-fb5f-4917-9ebc-2bf5f96d7c6f]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ca42a6-1c17-4911-97d6-24e8e367ea52]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] SCSI volumes sdf have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[27050bac-df09-4540-a4c2-85d2164669fa]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d7d62e-134d-46e0-a971-1e025aab5152]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193, portal: 172.16.0.220,3260]
Apr 12 10:57:04 user nova-compute[71557]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193, portal: 172.16.0.220,3260] successful.
Apr 12 10:57:04 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7d3b210-cbed-4d4a-8f47-f68cd0560193 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4049ec3f-0186-4116-b7eb-d3c5fb4c1117]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] <== disconnect_volume: return (336ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:57:04 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:57:05 user nova-compute[71557]: DEBUG nova.objects.instance [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'flavor' on Instance uuid faa11b52-f2b6-45aa-937f-7468095ddb22 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:57:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-1c147f19-a455-4a27-85f6-a4581039e729 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.783s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:57:05 user nova-compute[71557]: DEBUG nova.compute.manager [req-8bbe9b07-cb33-4f5b-a1f6-84693ac795ba req-7c248d46-d472-43bb-9220-0cd6d8aae5da service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received event network-changed-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:57:05 user nova-compute[71557]: DEBUG nova.compute.manager [req-8bbe9b07-cb33-4f5b-a1f6-84693ac795ba req-7c248d46-d472-43bb-9220-0cd6d8aae5da service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Refreshing instance network info cache due to event network-changed-46213af2-2a93-4502-9f35-eda3d5b9f7fc. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:57:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8bbe9b07-cb33-4f5b-a1f6-84693ac795ba req-7c248d46-d472-43bb-9220-0cd6d8aae5da service nova] Acquiring lock "refresh_cache-faa11b52-f2b6-45aa-937f-7468095ddb22" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:57:05 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8bbe9b07-cb33-4f5b-a1f6-84693ac795ba req-7c248d46-d472-43bb-9220-0cd6d8aae5da service nova] Acquired lock "refresh_cache-faa11b52-f2b6-45aa-937f-7468095ddb22" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:57:05 user nova-compute[71557]: DEBUG nova.network.neutron [req-8bbe9b07-cb33-4f5b-a1f6-84693ac795ba req-7c248d46-d472-43bb-9220-0cd6d8aae5da service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Refreshing network info cache for port 46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:57:06 user nova-compute[71557]: DEBUG nova.network.neutron [req-8bbe9b07-cb33-4f5b-a1f6-84693ac795ba req-7c248d46-d472-43bb-9220-0cd6d8aae5da service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Updated VIF entry in instance network info cache for port 46213af2-2a93-4502-9f35-eda3d5b9f7fc. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:57:06 user nova-compute[71557]: DEBUG nova.network.neutron [req-8bbe9b07-cb33-4f5b-a1f6-84693ac795ba req-7c248d46-d472-43bb-9220-0cd6d8aae5da service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Updating instance_info_cache with network_info: [{"id": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "address": "fa:16:3e:c9:da:1c", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46213af2-2a", "ovs_interfaceid": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:57:06 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-8bbe9b07-cb33-4f5b-a1f6-84693ac795ba req-7c248d46-d472-43bb-9220-0cd6d8aae5da service nova] Releasing lock "refresh_cache-faa11b52-f2b6-45aa-937f-7468095ddb22" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:57:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:57:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:57:18 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:57:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:57:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:57:18 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:57:18 user nova-compute[71557]: INFO nova.compute.claims [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Claim successful on node user
Apr 12 10:57:18 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:57:19 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:57:19 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG nova.policy [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aed741675f5944f1882c097c411437f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0f2b52a1a04769803c3a44a924ff00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:57:19 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Creating image(s)
Apr 12 10:57:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "/opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "/opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "/opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.139s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk 1073741824" returned: 0 in 0.055s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.142s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Checking if we can resize image /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Cannot resize image /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG nova.objects.instance [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lazy-loading 'migration_context' on Instance uuid faf5e629-c914-43a1-bd73-ce4adfafe9d6 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Ensure instance console log exists: /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:57:19 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Successfully created port: f43a5f64-a4b2-481b-9785-6a556a795d0a {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:57:20 user nova-compute[71557]: INFO nova.compute.manager [None req-b12fe0ab-e860-4b15-bb24-edea38d85dd4 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Get console output
Apr 12 10:57:20 user nova-compute[71557]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Successfully updated port: f43a5f64-a4b2-481b-9785-6a556a795d0a {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "refresh_cache-faf5e629-c914-43a1-bd73-ce4adfafe9d6" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquired lock "refresh_cache-faf5e629-c914-43a1-bd73-ce4adfafe9d6" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-33c7e505-f32c-459d-a931-01def868d567 req-5331fe70-07da-4412-840b-e08225a8dba6 service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Received event network-changed-f43a5f64-a4b2-481b-9785-6a556a795d0a {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-33c7e505-f32c-459d-a931-01def868d567 req-5331fe70-07da-4412-840b-e08225a8dba6 service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Refreshing instance network info cache due to event network-changed-f43a5f64-a4b2-481b-9785-6a556a795d0a. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-33c7e505-f32c-459d-a931-01def868d567 req-5331fe70-07da-4412-840b-e08225a8dba6 service nova] Acquiring lock "refresh_cache-faf5e629-c914-43a1-bd73-ce4adfafe9d6" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.network.neutron [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Updating instance_info_cache with network_info: [{"id": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "address": "fa:16:3e:f6:ad:69", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a5f64-a4", "ovs_interfaceid": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Releasing lock "refresh_cache-faf5e629-c914-43a1-bd73-ce4adfafe9d6" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Instance network_info: |[{"id": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "address": "fa:16:3e:f6:ad:69", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a5f64-a4", "ovs_interfaceid": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-33c7e505-f32c-459d-a931-01def868d567 req-5331fe70-07da-4412-840b-e08225a8dba6 service nova] Acquired lock "refresh_cache-faf5e629-c914-43a1-bd73-ce4adfafe9d6" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.network.neutron [req-33c7e505-f32c-459d-a931-01def868d567 req-5331fe70-07da-4412-840b-e08225a8dba6 service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Refreshing network info cache for port f43a5f64-a4b2-481b-9785-6a556a795d0a {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Start _get_guest_xml network_info=[{"id": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "address": "fa:16:3e:f6:ad:69", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a5f64-a4", "ovs_interfaceid": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:57:21 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:57:21 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:57:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1949196284',display_name='tempest-TestStampPattern-server-1949196284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1949196284',id=41,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaPyHRbcEnu+5+do5qHU+1eCHNMIdz7T58VS5Bcnzn0CUjwp6yQ03Ax3lmuZopCNO8dTcA62ZaKwisDZe976PqRTMzRs8Ozd6zeLPjLajysiE4TI0dVucPHR8mu4N+YIQ==',key_name='tempest-TestStampPattern-1731935486',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a0f2b52a1a04769803c3a44a924ff00',ramdisk_id='',reservation_id='r-nw28101f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1356820597',owner_user_name='tempest-TestStampPattern-1356820597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:57:19Z,user_data=None,user_id='aed741675f5944f1882c097c411437f6',uuid=faf5e629-c914-43a1-bd73-ce4adfafe9d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "address": "fa:16:3e:f6:ad:69", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a5f64-a4", "ovs_interfaceid": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Converting VIF {"id": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "address": "fa:16:3e:f6:ad:69", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a5f64-a4", "ovs_interfaceid": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ad:69,bridge_name='br-int',has_traffic_filtering=True,id=f43a5f64-a4b2-481b-9785-6a556a795d0a,network=Network(b1da98cc-b18c-477c-9e03-df8190b944d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43a5f64-a4') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.objects.instance [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lazy-loading 'pci_devices' on Instance uuid faf5e629-c914-43a1-bd73-ce4adfafe9d6 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:57:21 user nova-compute[71557]:   <uuid>faf5e629-c914-43a1-bd73-ce4adfafe9d6</uuid>
Apr 12 10:57:21 user nova-compute[71557]:   <name>instance-00000029</name>
Apr 12 10:57:21 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:57:21 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:57:21 user nova-compute[71557]:   <metadata>
Apr 12 10:57:21 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:57:21 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:57:21 user nova-compute[71557]:       <nova:name>tempest-TestStampPattern-server-1949196284</nova:name>
Apr 12 10:57:21 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:57:21</nova:creationTime>
Apr 12 10:57:21 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:57:21 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:57:21 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:57:21 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:57:21 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:57:21 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:57:21 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:57:21 user nova-compute[71557]:       <nova:owner>
Apr 12 10:57:21 user nova-compute[71557]:         <nova:user uuid="aed741675f5944f1882c097c411437f6">tempest-TestStampPattern-1356820597-project-member</nova:user>
Apr 12 10:57:21 user nova-compute[71557]:         <nova:project uuid="4a0f2b52a1a04769803c3a44a924ff00">tempest-TestStampPattern-1356820597</nova:project>
Apr 12 10:57:21 user nova-compute[71557]:       </nova:owner>
Apr 12 10:57:21 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:57:21 user nova-compute[71557]:       <nova:ports>
Apr 12 10:57:21 user nova-compute[71557]:         <nova:port uuid="f43a5f64-a4b2-481b-9785-6a556a795d0a">
Apr 12 10:57:21 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 10:57:21 user nova-compute[71557]:         </nova:port>
Apr 12 10:57:21 user nova-compute[71557]:       </nova:ports>
Apr 12 10:57:21 user nova-compute[71557]:     </nova:instance>
Apr 12 10:57:21 user nova-compute[71557]:   </metadata>
Apr 12 10:57:21 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:57:21 user nova-compute[71557]:     <system>
Apr 12 10:57:21 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:57:21 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:57:21 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:57:21 user nova-compute[71557]:       <entry name="serial">faf5e629-c914-43a1-bd73-ce4adfafe9d6</entry>
Apr 12 10:57:21 user nova-compute[71557]:       <entry name="uuid">faf5e629-c914-43a1-bd73-ce4adfafe9d6</entry>
Apr 12 10:57:21 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:57:21 user nova-compute[71557]:     </system>
Apr 12 10:57:21 user nova-compute[71557]:   </sysinfo>
Apr 12 10:57:21 user nova-compute[71557]:   <os>
Apr 12 10:57:21 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:57:21 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:57:21 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:57:21 user nova-compute[71557]:   </os>
Apr 12 10:57:21 user nova-compute[71557]:   <features>
Apr 12 10:57:21 user nova-compute[71557]:     <acpi/>
Apr 12 10:57:21 user nova-compute[71557]:     <apic/>
Apr 12 10:57:21 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:57:21 user nova-compute[71557]:   </features>
Apr 12 10:57:21 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:57:21 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:57:21 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:57:21 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:57:21 user nova-compute[71557]:   </clock>
Apr 12 10:57:21 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:57:21 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:57:21 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:57:21 user nova-compute[71557]:   </cpu>
Apr 12 10:57:21 user nova-compute[71557]:   <devices>
Apr 12 10:57:21 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:57:21 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:57:21 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk"/>
Apr 12 10:57:21 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:57:21 user nova-compute[71557]:     </disk>
Apr 12 10:57:21 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:57:21 user nova-compute[71557]:       <mac address="fa:16:3e:f6:ad:69"/>
Apr 12 10:57:21 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:57:21 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:57:21 user nova-compute[71557]:       <target dev="tapf43a5f64-a4"/>
Apr 12 10:57:21 user nova-compute[71557]:     </interface>
Apr 12 10:57:21 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:57:21 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/console.log" append="off"/>
Apr 12 10:57:21 user nova-compute[71557]:     </serial>
Apr 12 10:57:21 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:57:21 user nova-compute[71557]:     <video>
Apr 12 10:57:21 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:57:21 user nova-compute[71557]:     </video>
Apr 12 10:57:21 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:57:21 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:57:21 user nova-compute[71557]:     </rng>
Apr 12 10:57:21 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:57:21 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:57:21 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:57:21 user nova-compute[71557]:     </memballoon>
Apr 12 10:57:21 user nova-compute[71557]:   </devices>
Apr 12 10:57:21 user nova-compute[71557]: </domain>
Apr 12 10:57:21 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:57:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1949196284',display_name='tempest-TestStampPattern-server-1949196284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1949196284',id=41,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaPyHRbcEnu+5+do5qHU+1eCHNMIdz7T58VS5Bcnzn0CUjwp6yQ03Ax3lmuZopCNO8dTcA62ZaKwisDZe976PqRTMzRs8Ozd6zeLPjLajysiE4TI0dVucPHR8mu4N+YIQ==',key_name='tempest-TestStampPattern-1731935486',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a0f2b52a1a04769803c3a44a924ff00',ramdisk_id='',reservation_id='r-nw28101f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1356820597',owner_user_name='tempest-TestStampPattern-1356820597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:57:19Z,user_data=None,user_id='aed741675f5944f1882c097c411437f6',uuid=faf5e629-c914-43a1-bd73-ce4adfafe9d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "address": "fa:16:3e:f6:ad:69", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a5f64-a4", "ovs_interfaceid": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Converting VIF {"id": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "address": "fa:16:3e:f6:ad:69", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a5f64-a4", "ovs_interfaceid": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ad:69,bridge_name='br-int',has_traffic_filtering=True,id=f43a5f64-a4b2-481b-9785-6a556a795d0a,network=Network(b1da98cc-b18c-477c-9e03-df8190b944d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43a5f64-a4') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG os_vif [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ad:69,bridge_name='br-int',has_traffic_filtering=True,id=f43a5f64-a4b2-481b-9785-6a556a795d0a,network=Network(b1da98cc-b18c-477c-9e03-df8190b944d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43a5f64-a4') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf43a5f64-a4, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf43a5f64-a4, col_values=(('external_ids', {'iface-id': 'f43a5f64-a4b2-481b-9785-6a556a795d0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:ad:69', 'vm-uuid': 'faf5e629-c914-43a1-bd73-ce4adfafe9d6'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:21 user nova-compute[71557]: INFO os_vif [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ad:69,bridge_name='br-int',has_traffic_filtering=True,id=f43a5f64-a4b2-481b-9785-6a556a795d0a,network=Network(b1da98cc-b18c-477c-9e03-df8190b944d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43a5f64-a4')
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:57:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] No VIF found with MAC fa:16:3e:f6:ad:69, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:57:22 user nova-compute[71557]: DEBUG nova.network.neutron [req-33c7e505-f32c-459d-a931-01def868d567 req-5331fe70-07da-4412-840b-e08225a8dba6 service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Updated VIF entry in instance network info cache for port f43a5f64-a4b2-481b-9785-6a556a795d0a. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:57:22 user nova-compute[71557]: DEBUG nova.network.neutron [req-33c7e505-f32c-459d-a931-01def868d567 req-5331fe70-07da-4412-840b-e08225a8dba6 service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Updating instance_info_cache with network_info: [{"id": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "address": "fa:16:3e:f6:ad:69", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a5f64-a4", "ovs_interfaceid": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:57:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-33c7e505-f32c-459d-a931-01def868d567 req-5331fe70-07da-4412-840b-e08225a8dba6 service nova] Releasing lock "refresh_cache-faf5e629-c914-43a1-bd73-ce4adfafe9d6" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:57:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-10c702c1-0dab-41c5-9a50-522ca9016f42 req-083d5ca0-f6a5-4727-8b98-ed79afe74985 service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Received event network-vif-plugged-f43a5f64-a4b2-481b-9785-6a556a795d0a {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:57:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-10c702c1-0dab-41c5-9a50-522ca9016f42 req-083d5ca0-f6a5-4727-8b98-ed79afe74985 service nova] Acquiring lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:57:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-10c702c1-0dab-41c5-9a50-522ca9016f42 req-083d5ca0-f6a5-4727-8b98-ed79afe74985 service nova] Lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:57:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-10c702c1-0dab-41c5-9a50-522ca9016f42 req-083d5ca0-f6a5-4727-8b98-ed79afe74985 service nova] Lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:57:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-10c702c1-0dab-41c5-9a50-522ca9016f42 req-083d5ca0-f6a5-4727-8b98-ed79afe74985 service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] No waiting events found dispatching network-vif-plugged-f43a5f64-a4b2-481b-9785-6a556a795d0a {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:57:23 user nova-compute[71557]: WARNING nova.compute.manager [req-10c702c1-0dab-41c5-9a50-522ca9016f42 req-083d5ca0-f6a5-4727-8b98-ed79afe74985 service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Received unexpected event network-vif-plugged-f43a5f64-a4b2-481b-9785-6a556a795d0a for instance with vm_state building and task_state spawning.
Apr 12 10:57:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:25 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681297045.5033028, faf5e629-c914-43a1-bd73-ce4adfafe9d6 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:57:25 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] VM Resumed (Lifecycle Event)
Apr 12 10:57:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:57:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:57:25 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Instance spawned successfully.
Apr 12 10:57:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:57:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:57:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:57:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-d9ca2a76-25fe-4acc-bbd4-7d3c3631024f req-4e8d6114-9340-4800-9284-1b43f7916caa service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Received event network-vif-plugged-f43a5f64-a4b2-481b-9785-6a556a795d0a {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:57:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d9ca2a76-25fe-4acc-bbd4-7d3c3631024f req-4e8d6114-9340-4800-9284-1b43f7916caa service nova] Acquiring lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:57:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d9ca2a76-25fe-4acc-bbd4-7d3c3631024f req-4e8d6114-9340-4800-9284-1b43f7916caa service nova] Lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:57:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d9ca2a76-25fe-4acc-bbd4-7d3c3631024f req-4e8d6114-9340-4800-9284-1b43f7916caa service nova] Lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:57:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-d9ca2a76-25fe-4acc-bbd4-7d3c3631024f req-4e8d6114-9340-4800-9284-1b43f7916caa service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] No waiting events found dispatching network-vif-plugged-f43a5f64-a4b2-481b-9785-6a556a795d0a {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:57:25 user nova-compute[71557]: WARNING nova.compute.manager [req-d9ca2a76-25fe-4acc-bbd4-7d3c3631024f req-4e8d6114-9340-4800-9284-1b43f7916caa service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Received unexpected event network-vif-plugged-f43a5f64-a4b2-481b-9785-6a556a795d0a for instance with vm_state building and task_state spawning.
Apr 12 10:57:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:57:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:57:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:57:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:57:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:57:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:57:25 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:57:25 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681297045.5081463, faf5e629-c914-43a1-bd73-ce4adfafe9d6 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:57:25 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] VM Started (Lifecycle Event)
Apr 12 10:57:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:57:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:57:25 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:57:25 user nova-compute[71557]: INFO nova.compute.manager [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Took 6.43 seconds to spawn the instance on the hypervisor.
Apr 12 10:57:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:57:25 user nova-compute[71557]: INFO nova.compute.manager [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Took 7.24 seconds to build instance.
Apr 12 10:57:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-4451eb6f-852b-4159-80e3-481726f51b10 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.637s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:57:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:31 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:57:31 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:57:31 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:57:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:57:33 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:57:34 user nova-compute[71557]: INFO nova.compute.claims [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Claim successful on node user
Apr 12 10:57:34 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Refreshing inventories for resource provider 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Updating ProviderTree inventory for provider 24299bcb-a671-492d-9d13-df83697a8f87 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Updating inventory in ProviderTree for provider 24299bcb-a671-492d-9d13-df83697a8f87 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Refreshing aggregate associations for resource provider 24299bcb-a671-492d-9d13-df83697a8f87, aggregates: None {{(pid=71557) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Refreshing trait associations for resource provider 24299bcb-a671-492d-9d13-df83697a8f87, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=71557) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.557s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG nova.network.neutron [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:57:34 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:57:34 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:57:34 user nova-compute[71557]: INFO nova.virt.block_device [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Booting with volume 27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 at /dev/vda
Apr 12 10:57:34 user nova-compute[71557]: DEBUG nova.policy [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG os_brick.utils [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[25809a95-7338-48eb-b643-fdb76db5286f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f401ae-7ac6-421a-a945-bf2029280b52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f2c7e5-92a9-4d66-a67f-ca570b9a1a7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf9a114-d063-4f08-8012-25ca35f653c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:57:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:57:35 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:57:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[69506785-790d-4aa9-b8ae-04e1bba18dcc]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:57:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:57:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:57:35 user nova-compute[71557]: DEBUG os_brick.utils [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:57:35 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Updating existing volume attachment record: c59b879f-859b-420c-86e1-638e45364b4f {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:57:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:57:35 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:57:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:57:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:57:35 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:57:35 user nova-compute[71557]: DEBUG nova.network.neutron [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Successfully created port: f0316e9d-800d-42f6-9078-eafa6da69f0d {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:57:35 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Updating instance_info_cache with network_info: [{"id": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "address": "fa:16:3e:98:5d:7d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e0f8a4-96", "ovs_interfaceid": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:57:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:57:35 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:57:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:57:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:57:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:57:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:57:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:57:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:57:35 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG nova.network.neutron [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Successfully updated port: f0316e9d-800d-42f6-9078-eafa6da69f0d {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "refresh_cache-e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquired lock "refresh_cache-e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG nova.network.neutron [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-08967048-5157-47d4-af05-4c7d4418c020 req-c682e50c-3053-46a7-b64f-b79e0ac044c8 service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Received event network-changed-f0316e9d-800d-42f6-9078-eafa6da69f0d {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-08967048-5157-47d4-af05-4c7d4418c020 req-c682e50c-3053-46a7-b64f-b79e0ac044c8 service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Refreshing instance network info cache due to event network-changed-f0316e9d-800d-42f6-9078-eafa6da69f0d. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-08967048-5157-47d4-af05-4c7d4418c020 req-c682e50c-3053-46a7-b64f-b79e0ac044c8 service nova] Acquiring lock "refresh_cache-e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG nova.network.neutron [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG nova.network.neutron [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Updating instance_info_cache with network_info: [{"id": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "address": "fa:16:3e:00:68:fe", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0316e9d-80", "ovs_interfaceid": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Releasing lock "refresh_cache-e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Instance network_info: |[{"id": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "address": "fa:16:3e:00:68:fe", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0316e9d-80", "ovs_interfaceid": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-08967048-5157-47d4-af05-4c7d4418c020 req-c682e50c-3053-46a7-b64f-b79e0ac044c8 service nova] Acquired lock "refresh_cache-e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG nova.network.neutron [req-08967048-5157-47d4-af05-4c7d4418c020 req-c682e50c-3053-46a7-b64f-b79e0ac044c8 service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Refreshing network info cache for port f0316e9d-800d-42f6-9078-eafa6da69f0d {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:37 user nova-compute[71557]: DEBUG nova.network.neutron [req-08967048-5157-47d4-af05-4c7d4418c020 req-c682e50c-3053-46a7-b64f-b79e0ac044c8 service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Updated VIF entry in instance network info cache for port f0316e9d-800d-42f6-9078-eafa6da69f0d. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:57:37 user nova-compute[71557]: DEBUG nova.network.neutron [req-08967048-5157-47d4-af05-4c7d4418c020 req-c682e50c-3053-46a7-b64f-b79e0ac044c8 service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Updating instance_info_cache with network_info: [{"id": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "address": "fa:16:3e:00:68:fe", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0316e9d-80", "ovs_interfaceid": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:57:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-08967048-5157-47d4-af05-4c7d4418c020 req-c682e50c-3053-46a7-b64f-b79e0ac044c8 service nova] Releasing lock "refresh_cache-e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:57:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:57:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:57:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:38 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:57:38 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:57:38 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=8003MB free_disk=26.161705017089844GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:57:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:57:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:57:38 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:57:38 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 97bafe22-36bf-4939-baf8-9602551bad52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:57:38 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance faa11b52-f2b6-45aa-937f-7468095ddb22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 0cb22a78-94df-49fb-918c-32856e1b5136 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:57:39 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Creating image(s)
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Did not create local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Ensure instance console log exists: /opt/stack/data/nova/instances/e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Start _get_guest_xml network_info=[{"id": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "address": "fa:16:3e:00:68:fe", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0316e9d-80", "ovs_interfaceid": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'c59b879f-859b-420c-86e1-638e45364b4f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyTZNWEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280', 'attached_at': '', 'detached_at': '', 'volume_id': '27a37b7e-8277-4e8d-8d37-9fbc82af9ff9', 'serial': '27a37b7e-8277-4e8d-8d37-9fbc82af9ff9'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:57:39 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:57:39 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyTZNWEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:57:39 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:57:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:57:39 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:57:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:57:39 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f43448-9b85-4c88-8a8e-0dd6d14c2580]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:57:39 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaa88ea-a774-4e4f-b629-8e8d0832871a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9] added
Apr 12 10:57:39 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7563127-6e86-467d-ac17-a9ba0c9d2a19]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b48f62-e18f-4d32-afa3-bce083f661c4]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YyTZNWEp {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YyTZNWEp" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[36eb512e-181a-46f5-9ad1-c73c502eddc2]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YyTZNWEp'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7f166c-523e-4c94-b820-cb3f05d5c5a1]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc68b858-6610-451c-95a9-24e3a260e635]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:57:39 user nova-compute[71557]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:57:39 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:57:39 user nova-compute[71557]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:57:39 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[da708fa5-2337-4174-9f6b-3bcf0b7a7f83]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9, portal: 172.16.0.220,3260]
Apr 12 10:57:39 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9, portal: 172.16.0.220,3260] successful.
Apr 12 10:57:39 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[97068823-7dc3-4cf8-a861-baeee3e75b7f]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:57:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:40 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[14630e37-26c3-40b0-bfa9-c33c96cb802b]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:57:40 user nova-compute[71557]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:57:40 user nova-compute[71557]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:57:40 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:57:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:57:40 user nova-compute[71557]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:57:40 user nova-compute[71557]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:57:40 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:57:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:57:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:57:40 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:57:40 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:57:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:57:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:57:40 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8633cc4d-42da-4c62-aae1-69e67def921a]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:57:40 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:57:40 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyTZNWEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:57:40 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:57:40 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:57:40 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26137333730316234', 'path': '/dev/sdc'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137333730316234', 'path': '/dev/sdc'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:57:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-153844544',display_name='tempest-TestVolumeBootPattern-server-153844544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-153844544',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeNYUbBfSwdaJdVL2RMsgRRuPmOdMNSAwl/DHzaeVhE0fDjZe84+pAYZqsgenmNqm/u0yGuL1KeKxxwsT2FNR2LdwQFC7iIcZOaTovpAXdmD/5wx/0lhCQf7gPsmZ5xfg==',key_name='tempest-TestVolumeBootPattern-162796269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a67f3d23b8f74a9496d445c7fc75717e',ramdisk_id='',reservation_id='r-k64gcvv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-638607559',owner_user_name='tempest-TestVolumeBootPattern-638607559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:57:35Z,user_data=None,user_id='b914d7ca786f455baf120f98816abffd',uuid=e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "address": "fa:16:3e:00:68:fe", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0316e9d-80", "ovs_interfaceid": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converting VIF {"id": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "address": "fa:16:3e:00:68:fe", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0316e9d-80", "ovs_interfaceid": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:68:fe,bridge_name='br-int',has_traffic_filtering=True,id=f0316e9d-800d-42f6-9078-eafa6da69f0d,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0316e9d-80') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG nova.objects.instance [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lazy-loading 'pci_devices' on Instance uuid e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:57:41 user nova-compute[71557]:   <uuid>e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280</uuid>
Apr 12 10:57:41 user nova-compute[71557]:   <name>instance-0000002a</name>
Apr 12 10:57:41 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:57:41 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:57:41 user nova-compute[71557]:   <metadata>
Apr 12 10:57:41 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:57:41 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:57:41 user nova-compute[71557]:       <nova:name>tempest-TestVolumeBootPattern-server-153844544</nova:name>
Apr 12 10:57:41 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:57:39</nova:creationTime>
Apr 12 10:57:41 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:57:41 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:57:41 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:57:41 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:57:41 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:57:41 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:57:41 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:57:41 user nova-compute[71557]:       <nova:owner>
Apr 12 10:57:41 user nova-compute[71557]:         <nova:user uuid="b914d7ca786f455baf120f98816abffd">tempest-TestVolumeBootPattern-638607559-project-member</nova:user>
Apr 12 10:57:41 user nova-compute[71557]:         <nova:project uuid="a67f3d23b8f74a9496d445c7fc75717e">tempest-TestVolumeBootPattern-638607559</nova:project>
Apr 12 10:57:41 user nova-compute[71557]:       </nova:owner>
Apr 12 10:57:41 user nova-compute[71557]:       <nova:ports>
Apr 12 10:57:41 user nova-compute[71557]:         <nova:port uuid="f0316e9d-800d-42f6-9078-eafa6da69f0d">
Apr 12 10:57:41 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 10:57:41 user nova-compute[71557]:         </nova:port>
Apr 12 10:57:41 user nova-compute[71557]:       </nova:ports>
Apr 12 10:57:41 user nova-compute[71557]:     </nova:instance>
Apr 12 10:57:41 user nova-compute[71557]:   </metadata>
Apr 12 10:57:41 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:57:41 user nova-compute[71557]:     <system>
Apr 12 10:57:41 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:57:41 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:57:41 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:57:41 user nova-compute[71557]:       <entry name="serial">e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280</entry>
Apr 12 10:57:41 user nova-compute[71557]:       <entry name="uuid">e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280</entry>
Apr 12 10:57:41 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:57:41 user nova-compute[71557]:     </system>
Apr 12 10:57:41 user nova-compute[71557]:   </sysinfo>
Apr 12 10:57:41 user nova-compute[71557]:   <os>
Apr 12 10:57:41 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:57:41 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:57:41 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:57:41 user nova-compute[71557]:   </os>
Apr 12 10:57:41 user nova-compute[71557]:   <features>
Apr 12 10:57:41 user nova-compute[71557]:     <acpi/>
Apr 12 10:57:41 user nova-compute[71557]:     <apic/>
Apr 12 10:57:41 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:57:41 user nova-compute[71557]:   </features>
Apr 12 10:57:41 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:57:41 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:57:41 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:57:41 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:57:41 user nova-compute[71557]:   </clock>
Apr 12 10:57:41 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:57:41 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:57:41 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:57:41 user nova-compute[71557]:   </cpu>
Apr 12 10:57:41 user nova-compute[71557]:   <devices>
Apr 12 10:57:41 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:57:41 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:57:41 user nova-compute[71557]:       <source dev="/dev/sdc"/>
Apr 12 10:57:41 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:57:41 user nova-compute[71557]:       <serial>27a37b7e-8277-4e8d-8d37-9fbc82af9ff9</serial>
Apr 12 10:57:41 user nova-compute[71557]:     </disk>
Apr 12 10:57:41 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:57:41 user nova-compute[71557]:       <mac address="fa:16:3e:00:68:fe"/>
Apr 12 10:57:41 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:57:41 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:57:41 user nova-compute[71557]:       <target dev="tapf0316e9d-80"/>
Apr 12 10:57:41 user nova-compute[71557]:     </interface>
Apr 12 10:57:41 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:57:41 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280/console.log" append="off"/>
Apr 12 10:57:41 user nova-compute[71557]:     </serial>
Apr 12 10:57:41 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:57:41 user nova-compute[71557]:     <video>
Apr 12 10:57:41 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:57:41 user nova-compute[71557]:     </video>
Apr 12 10:57:41 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:57:41 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:57:41 user nova-compute[71557]:     </rng>
Apr 12 10:57:41 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:57:41 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:57:41 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:57:41 user nova-compute[71557]:     </memballoon>
Apr 12 10:57:41 user nova-compute[71557]:   </devices>
Apr 12 10:57:41 user nova-compute[71557]: </domain>
Apr 12 10:57:41 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:57:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-153844544',display_name='tempest-TestVolumeBootPattern-server-153844544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-153844544',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeNYUbBfSwdaJdVL2RMsgRRuPmOdMNSAwl/DHzaeVhE0fDjZe84+pAYZqsgenmNqm/u0yGuL1KeKxxwsT2FNR2LdwQFC7iIcZOaTovpAXdmD/5wx/0lhCQf7gPsmZ5xfg==',key_name='tempest-TestVolumeBootPattern-162796269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a67f3d23b8f74a9496d445c7fc75717e',ramdisk_id='',reservation_id='r-k64gcvv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-638607559',owner_user_name='tempest-TestVolumeBootPattern-638607559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:57:35Z,user_data=None,user_id='b914d7ca786f455baf120f98816abffd',uuid=e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "address": "fa:16:3e:00:68:fe", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0316e9d-80", "ovs_interfaceid": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converting VIF {"id": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "address": "fa:16:3e:00:68:fe", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0316e9d-80", "ovs_interfaceid": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:68:fe,bridge_name='br-int',has_traffic_filtering=True,id=f0316e9d-800d-42f6-9078-eafa6da69f0d,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0316e9d-80') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG os_vif [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:68:fe,bridge_name='br-int',has_traffic_filtering=True,id=f0316e9d-800d-42f6-9078-eafa6da69f0d,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0316e9d-80') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0316e9d-80, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf0316e9d-80, col_values=(('external_ids', {'iface-id': 'f0316e9d-800d-42f6-9078-eafa6da69f0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:68:fe', 'vm-uuid': 'e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:41 user nova-compute[71557]: INFO os_vif [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:68:fe,bridge_name='br-int',has_traffic_filtering=True,id=f0316e9d-800d-42f6-9078-eafa6da69f0d,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0316e9d-80')
Apr 12 10:57:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] No VIF found with MAC fa:16:3e:00:68:fe, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:57:41 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:57:42 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:57:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:42 user nova-compute[71557]: DEBUG nova.compute.manager [req-15e40d14-832e-4542-a221-fd273a6c637d req-b285a1ef-a8b3-4a59-b9d3-90a00b5c3914 service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Received event network-vif-plugged-f0316e9d-800d-42f6-9078-eafa6da69f0d {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:57:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-15e40d14-832e-4542-a221-fd273a6c637d req-b285a1ef-a8b3-4a59-b9d3-90a00b5c3914 service nova] Acquiring lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:57:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-15e40d14-832e-4542-a221-fd273a6c637d req-b285a1ef-a8b3-4a59-b9d3-90a00b5c3914 service nova] Lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:57:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-15e40d14-832e-4542-a221-fd273a6c637d req-b285a1ef-a8b3-4a59-b9d3-90a00b5c3914 service nova] Lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:57:42 user nova-compute[71557]: DEBUG nova.compute.manager [req-15e40d14-832e-4542-a221-fd273a6c637d req-b285a1ef-a8b3-4a59-b9d3-90a00b5c3914 service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] No waiting events found dispatching network-vif-plugged-f0316e9d-800d-42f6-9078-eafa6da69f0d {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:57:42 user nova-compute[71557]: WARNING nova.compute.manager [req-15e40d14-832e-4542-a221-fd273a6c637d req-b285a1ef-a8b3-4a59-b9d3-90a00b5c3914 service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Received unexpected event network-vif-plugged-f0316e9d-800d-42f6-9078-eafa6da69f0d for instance with vm_state building and task_state spawning.
Apr 12 10:57:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:44 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681297064.758734, e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:57:44 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] VM Resumed (Lifecycle Event)
Apr 12 10:57:44 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:57:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:57:44 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Instance spawned successfully.
Apr 12 10:57:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:57:44 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:57:44 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:57:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:57:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:57:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:57:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:57:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:57:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:57:44 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:57:44 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681297064.763249, e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:57:44 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] VM Started (Lifecycle Event)
Apr 12 10:57:44 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:57:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-9be14547-0059-43dd-b522-d1171bffc376 req-ecb7baa8-d92a-4e02-b94a-826d838b5533 service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Received event network-vif-plugged-f0316e9d-800d-42f6-9078-eafa6da69f0d {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:57:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9be14547-0059-43dd-b522-d1171bffc376 req-ecb7baa8-d92a-4e02-b94a-826d838b5533 service nova] Acquiring lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:57:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9be14547-0059-43dd-b522-d1171bffc376 req-ecb7baa8-d92a-4e02-b94a-826d838b5533 service nova] Lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:57:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9be14547-0059-43dd-b522-d1171bffc376 req-ecb7baa8-d92a-4e02-b94a-826d838b5533 service nova] Lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:57:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-9be14547-0059-43dd-b522-d1171bffc376 req-ecb7baa8-d92a-4e02-b94a-826d838b5533 service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] No waiting events found dispatching network-vif-plugged-f0316e9d-800d-42f6-9078-eafa6da69f0d {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:57:44 user nova-compute[71557]: WARNING nova.compute.manager [req-9be14547-0059-43dd-b522-d1171bffc376 req-ecb7baa8-d92a-4e02-b94a-826d838b5533 service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Received unexpected event network-vif-plugged-f0316e9d-800d-42f6-9078-eafa6da69f0d for instance with vm_state building and task_state spawning.
Apr 12 10:57:44 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:57:44 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:57:44 user nova-compute[71557]: INFO nova.compute.manager [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Took 5.19 seconds to spawn the instance on the hypervisor.
Apr 12 10:57:44 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:57:44 user nova-compute[71557]: INFO nova.compute.manager [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Took 10.97 seconds to build instance.
Apr 12 10:57:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ac9bf4ec-138c-488b-80fe-10dff9418298 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.090s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:57:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:51 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "faa11b52-f2b6-45aa-937f-7468095ddb22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:57:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:57:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:57:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:57:53 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:57:53 user nova-compute[71557]: INFO nova.compute.manager [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Terminating instance
Apr 12 10:57:53 user nova-compute[71557]: DEBUG nova.compute.manager [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:57:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:54 user nova-compute[71557]: DEBUG nova.compute.manager [req-6ba56424-44a6-4a4e-8a02-807def830dd3 req-cb0298ef-4547-4c4e-a8e3-9e1a6fb3b71b service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received event network-vif-unplugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:57:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6ba56424-44a6-4a4e-8a02-807def830dd3 req-cb0298ef-4547-4c4e-a8e3-9e1a6fb3b71b service nova] Acquiring lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:57:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6ba56424-44a6-4a4e-8a02-807def830dd3 req-cb0298ef-4547-4c4e-a8e3-9e1a6fb3b71b service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:57:54 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6ba56424-44a6-4a4e-8a02-807def830dd3 req-cb0298ef-4547-4c4e-a8e3-9e1a6fb3b71b service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:57:54 user nova-compute[71557]: DEBUG nova.compute.manager [req-6ba56424-44a6-4a4e-8a02-807def830dd3 req-cb0298ef-4547-4c4e-a8e3-9e1a6fb3b71b service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] No waiting events found dispatching network-vif-unplugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:57:54 user nova-compute[71557]: DEBUG nova.compute.manager [req-6ba56424-44a6-4a4e-8a02-807def830dd3 req-cb0298ef-4547-4c4e-a8e3-9e1a6fb3b71b service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received event network-vif-unplugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:57:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:54 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Instance destroyed successfully.
Apr 12 10:57:54 user nova-compute[71557]: DEBUG nova.objects.instance [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'resources' on Instance uuid faa11b52-f2b6-45aa-937f-7468095ddb22 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:57:54 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:51:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1704970245',display_name='tempest-ServerRescueNegativeTestJSON-server-1704970245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1704970245',id=36,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/YpGpY39pjPnnc5Woimceec0NAaa03OrDNhA1pvgsqwdaodbpAhPJh05gGMZMrWZbb/FVge7phkuwRvAKHKPJI+cKczayHgYAnGWdfu4mixptN5qgJSlvLfPCtJ2jZMw==',key_name='tempest-keypair-1748374270',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:53:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b39cd8e55b54a86a7784f2934273e20',ramdisk_id='',reservation_id='r-9v4ub20y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1632398833',owner_user_name='tempest-ServerRescueNegativeTestJSON-1632398833-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:55:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abdf772f2c7341c29159b6f1f2ce7ccb',uuid=faa11b52-f2b6-45aa-937f-7468095ddb22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "address": "fa:16:3e:c9:da:1c", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46213af2-2a", "ovs_interfaceid": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:57:54 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converting VIF {"id": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "address": "fa:16:3e:c9:da:1c", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46213af2-2a", "ovs_interfaceid": "46213af2-2a93-4502-9f35-eda3d5b9f7fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:57:54 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:da:1c,bridge_name='br-int',has_traffic_filtering=True,id=46213af2-2a93-4502-9f35-eda3d5b9f7fc,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46213af2-2a') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:57:54 user nova-compute[71557]: DEBUG os_vif [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:da:1c,bridge_name='br-int',has_traffic_filtering=True,id=46213af2-2a93-4502-9f35-eda3d5b9f7fc,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46213af2-2a') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:57:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46213af2-2a, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:57:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:57:54 user nova-compute[71557]: INFO os_vif [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:da:1c,bridge_name='br-int',has_traffic_filtering=True,id=46213af2-2a93-4502-9f35-eda3d5b9f7fc,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46213af2-2a')
Apr 12 10:57:54 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Deleting instance files /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22_del
Apr 12 10:57:54 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Deletion of /opt/stack/data/nova/instances/faa11b52-f2b6-45aa-937f-7468095ddb22_del complete
Apr 12 10:57:54 user nova-compute[71557]: INFO nova.compute.manager [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 10:57:54 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:57:54 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:57:54 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:57:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:55 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:57:55 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Took 0.77 seconds to deallocate network for instance.
Apr 12 10:57:55 user nova-compute[71557]: DEBUG nova.compute.manager [req-6966339e-8968-4c0b-8828-a43b11c1d6f9 req-3ef76f90-5ef6-4b9c-b992-9447e5a4a4da service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received event network-vif-deleted-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:57:55 user nova-compute[71557]: INFO nova.compute.manager [req-6966339e-8968-4c0b-8828-a43b11c1d6f9 req-3ef76f90-5ef6-4b9c-b992-9447e5a4a4da service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Neutron deleted interface 46213af2-2a93-4502-9f35-eda3d5b9f7fc; detaching it from the instance and deleting it from the info cache
Apr 12 10:57:55 user nova-compute[71557]: DEBUG nova.network.neutron [req-6966339e-8968-4c0b-8828-a43b11c1d6f9 req-3ef76f90-5ef6-4b9c-b992-9447e5a4a4da service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:57:55 user nova-compute[71557]: DEBUG nova.compute.manager [req-6966339e-8968-4c0b-8828-a43b11c1d6f9 req-3ef76f90-5ef6-4b9c-b992-9447e5a4a4da service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Detach interface failed, port_id=46213af2-2a93-4502-9f35-eda3d5b9f7fc, reason: Instance faa11b52-f2b6-45aa-937f-7468095ddb22 could not be found. {{(pid=71557) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 10:57:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:57:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:57:55 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:57:55 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:57:55 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:57:56 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Deleted allocations for instance faa11b52-f2b6-45aa-937f-7468095ddb22
Apr 12 10:57:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-736af41f-143c-4d4d-87b5-23803d5e341c tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.162s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:57:56 user nova-compute[71557]: DEBUG nova.compute.manager [req-2c7814b7-7b1a-4dab-a337-198621404b33 req-28113b81-3ccd-424c-9230-873c2d28718b service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received event network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:57:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2c7814b7-7b1a-4dab-a337-198621404b33 req-28113b81-3ccd-424c-9230-873c2d28718b service nova] Acquiring lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:57:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2c7814b7-7b1a-4dab-a337-198621404b33 req-28113b81-3ccd-424c-9230-873c2d28718b service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:57:56 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2c7814b7-7b1a-4dab-a337-198621404b33 req-28113b81-3ccd-424c-9230-873c2d28718b service nova] Lock "faa11b52-f2b6-45aa-937f-7468095ddb22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:57:56 user nova-compute[71557]: DEBUG nova.compute.manager [req-2c7814b7-7b1a-4dab-a337-198621404b33 req-28113b81-3ccd-424c-9230-873c2d28718b service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] No waiting events found dispatching network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:57:56 user nova-compute[71557]: WARNING nova.compute.manager [req-2c7814b7-7b1a-4dab-a337-198621404b33 req-28113b81-3ccd-424c-9230-873c2d28718b service nova] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Received unexpected event network-vif-plugged-46213af2-2a93-4502-9f35-eda3d5b9f7fc for instance with vm_state deleted and task_state None.
Apr 12 10:57:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:57:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:09 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681297074.7153604, faa11b52-f2b6-45aa-937f-7468095ddb22 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:58:09 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] VM Stopped (Lifecycle Event)
Apr 12 10:58:09 user nova-compute[71557]: DEBUG nova.compute.manager [None req-68a1e2d0-2be9-4e59-be68-85b85b0e69be None None] [instance: faa11b52-f2b6-45aa-937f-7468095ddb22] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:58:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "0cb22a78-94df-49fb-918c-32856e1b5136" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "0cb22a78-94df-49fb-918c-32856e1b5136" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:21 user nova-compute[71557]: INFO nova.compute.manager [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Terminating instance
Apr 12 10:58:21 user nova-compute[71557]: DEBUG nova.compute.manager [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-9a51624e-5718-4307-a85b-e5157d34e26a req-9578570e-b5ce-42da-aa1f-b837a1a90885 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Received event network-vif-unplugged-225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9a51624e-5718-4307-a85b-e5157d34e26a req-9578570e-b5ce-42da-aa1f-b837a1a90885 service nova] Acquiring lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9a51624e-5718-4307-a85b-e5157d34e26a req-9578570e-b5ce-42da-aa1f-b837a1a90885 service nova] Lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-9a51624e-5718-4307-a85b-e5157d34e26a req-9578570e-b5ce-42da-aa1f-b837a1a90885 service nova] Lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-9a51624e-5718-4307-a85b-e5157d34e26a req-9578570e-b5ce-42da-aa1f-b837a1a90885 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] No waiting events found dispatching network-vif-unplugged-225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-9a51624e-5718-4307-a85b-e5157d34e26a req-9578570e-b5ce-42da-aa1f-b837a1a90885 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Received event network-vif-unplugged-225efc65-26fe-4d54-93aa-35298d6ddd3f for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:21 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Instance destroyed successfully.
Apr 12 10:58:21 user nova-compute[71557]: DEBUG nova.objects.instance [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'resources' on Instance uuid 0cb22a78-94df-49fb-918c-32856e1b5136 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-465944081',display_name='tempest-ServerActionsTestJSON-server-465944081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-465944081',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSPzZAK4K6WfKgZv6ul+nJ2Lzppw5IMfK0+f9KuGByC6XjA59WQJmgMTCh01/yWlwW8qMjnx6gjYen9tQKzYmdVo3Z1KGqS/wGYHKKDRVeNNONzm9HfPYp2EDH6xyugDA==',key_name='tempest-keypair-1241183546',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:53:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32235c67d269474b879a58269c1bfb28',ramdisk_id='',reservation_id='r-u95j204e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2042231427',owner_user_name='tempest-ServerActionsTestJSON-2042231427-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:55:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0059d31539304ffcb5214b408751cd4f',uuid=0cb22a78-94df-49fb-918c-32856e1b5136,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "address": "fa:16:3e:e3:f1:6d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225efc65-26", "ovs_interfaceid": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converting VIF {"id": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "address": "fa:16:3e:e3:f1:6d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap225efc65-26", "ovs_interfaceid": "225efc65-26fe-4d54-93aa-35298d6ddd3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:f1:6d,bridge_name='br-int',has_traffic_filtering=True,id=225efc65-26fe-4d54-93aa-35298d6ddd3f,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225efc65-26') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG os_vif [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:f1:6d,bridge_name='br-int',has_traffic_filtering=True,id=225efc65-26fe-4d54-93aa-35298d6ddd3f,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225efc65-26') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap225efc65-26, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:58:21 user nova-compute[71557]: INFO os_vif [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:f1:6d,bridge_name='br-int',has_traffic_filtering=True,id=225efc65-26fe-4d54-93aa-35298d6ddd3f,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap225efc65-26')
Apr 12 10:58:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlepnzcC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:58:21 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:58:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9151da6-9fbc-4353-8993-bc55ffc55142]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:58:21 user nova-compute[71557]: No targets found.
Apr 12 10:58:21 user nova-compute[71557]: iSNS:
Apr 12 10:58:21 user nova-compute[71557]: No targets found.
Apr 12 10:58:21 user nova-compute[71557]: STATIC:
Apr 12 10:58:21 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1
Apr 12 10:58:21 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:58:21 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:58:21 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4
Apr 12 10:58:21 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:58:21 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:58:21 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9
Apr 12 10:58:21 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:58:21 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:58:21 user nova-compute[71557]: FIRMWARE:
Apr 12 10:58:21 user nova-compute[71557]: No targets found.
Apr 12 10:58:21 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:58:21 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:58:21 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dc1f3d-7967-411c-a6e8-372acf8195e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[41340868-4fd5-4da1-b046-3dd62c2141ab]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:58:22 user nova-compute[71557]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:58:22 user nova-compute[71557]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:58:22 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 (non-flash)
Apr 12 10:58:22 user nova-compute[71557]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:58:22 user nova-compute[71557]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:58:22 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fddfb5fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4'): ({'sdd'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Removing single pathed devices sdd {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8dbe92a-bcfa-4602-9cd9-b1174e4f2e9a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3476573-b676-4031-b311-8833257d03e8]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Flushing IO for device /dev/sdd {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fd744f-41bf-46d5-81ac-e7d166366405]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d62024d-67c1-4dc6-8cab-b37a118b138c]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] SCSI volumes sdd have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2b33b5e5-2790c23a39a0bd98', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2b33b5e5', '/dev/disk/by-id/scsi-23237393063323361') {{(pid=82009) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 10:58:22 user nova-compute[71557]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO2b33b5e5-2790c23a39a0bd98
Apr 12 10:58:22 user nova-compute[71557]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_2b33b5e5
Apr 12 10:58:22 user nova-compute[71557]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23237393063323361
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e17fcb-7722-49f6-b28c-79092ca67314]: (4, None) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b842b12-3d28-4695-9868-3d3f33fce7da]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[59578254-e46a-452b-ba63-919cbb07c8f1]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4, portal: 172.16.0.220,3260]
Apr 12 10:58:22 user nova-compute[71557]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4, portal: 172.16.0.220,3260] successful.
Apr 12 10:58:22 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa22aac8-82c0-4487-bc15-af046a4aa2b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f105315-91b2-4ef9-91fb-c58aaa4d0a61]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] <== disconnect_volume: return (316ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:58:22 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Deleting instance files /opt/stack/data/nova/instances/0cb22a78-94df-49fb-918c-32856e1b5136_del
Apr 12 10:58:22 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Deletion of /opt/stack/data/nova/instances/0cb22a78-94df-49fb-918c-32856e1b5136_del complete
Apr 12 10:58:22 user nova-compute[71557]: INFO nova.compute.manager [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:22 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:58:22 user nova-compute[71557]: INFO nova.compute.claims [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Claim successful on node user
Apr 12 10:58:23 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG nova.network.neutron [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:58:23 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:58:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG nova.policy [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '325a0abaf7b6485ca97e2d2af2bc9778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7541fb4f462b438dbef4ffe9be4725b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG nova.compute.manager [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:58:23 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Creating image(s)
Apr 12 10:58:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "/opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "/opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:23 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Took 0.99 seconds to deallocate network for instance.
Apr 12 10:58:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-b3715a98-9e14-4354-a16a-88c2d8c60fe6 req-09425434-6354-46d9-9e55-fa34c9b0fcc3 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Received event network-vif-deleted-225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.129s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk 1073741824" returned: 0 in 0.051s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.143s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Cannot resize image /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG nova.objects.instance [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lazy-loading 'migration_context' on Instance uuid ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Ensure instance console log exists: /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:24 user nova-compute[71557]: DEBUG nova.compute.manager [req-d248f754-c282-47c0-9b7f-6f7a3106e421 req-a06ecb19-064a-4490-a75c-b7e643c513b6 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Received event network-vif-plugged-225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:58:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d248f754-c282-47c0-9b7f-6f7a3106e421 req-a06ecb19-064a-4490-a75c-b7e643c513b6 service nova] Acquiring lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d248f754-c282-47c0-9b7f-6f7a3106e421 req-a06ecb19-064a-4490-a75c-b7e643c513b6 service nova] Lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d248f754-c282-47c0-9b7f-6f7a3106e421 req-a06ecb19-064a-4490-a75c-b7e643c513b6 service nova] Lock "0cb22a78-94df-49fb-918c-32856e1b5136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:24 user nova-compute[71557]: DEBUG nova.compute.manager [req-d248f754-c282-47c0-9b7f-6f7a3106e421 req-a06ecb19-064a-4490-a75c-b7e643c513b6 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] No waiting events found dispatching network-vif-plugged-225efc65-26fe-4d54-93aa-35298d6ddd3f {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:58:24 user nova-compute[71557]: WARNING nova.compute.manager [req-d248f754-c282-47c0-9b7f-6f7a3106e421 req-a06ecb19-064a-4490-a75c-b7e643c513b6 service nova] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Received unexpected event network-vif-plugged-225efc65-26fe-4d54-93aa-35298d6ddd3f for instance with vm_state active and task_state deleting.
Apr 12 10:58:24 user nova-compute[71557]: INFO nova.compute.manager [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Took 1.03 seconds to detach 1 volumes for instance.
Apr 12 10:58:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Deleting volume: aa22aac8-82c0-4487-bc15-af046a4aa2b4 {{(pid=71557) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 10:58:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:24 user nova-compute[71557]: DEBUG nova.network.neutron [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Successfully created port: 4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:58:24 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:58:24 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:58:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:24 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Deleted allocations for instance 0cb22a78-94df-49fb-918c-32856e1b5136
Apr 12 10:58:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-065f8944-5de6-411a-aeb6-1c7dabcad406 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "0cb22a78-94df-49fb-918c-32856e1b5136" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.760s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:25 user nova-compute[71557]: DEBUG nova.network.neutron [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Successfully updated port: 4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:58:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "refresh_cache-ca545a0c-89fd-4a04-9d87-c2698051ca87" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:58:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquired lock "refresh_cache-ca545a0c-89fd-4a04-9d87-c2698051ca87" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:58:25 user nova-compute[71557]: DEBUG nova.network.neutron [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:58:25 user nova-compute[71557]: DEBUG nova.network.neutron [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.compute.manager [req-0f776c80-f093-4699-afd1-1c26d0e36ee2 req-600cee84-7646-4967-83f2-db4b34ac2a1c service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Received event network-changed-4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.compute.manager [req-0f776c80-f093-4699-afd1-1c26d0e36ee2 req-600cee84-7646-4967-83f2-db4b34ac2a1c service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Refreshing instance network info cache due to event network-changed-4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0f776c80-f093-4699-afd1-1c26d0e36ee2 req-600cee84-7646-4967-83f2-db4b34ac2a1c service nova] Acquiring lock "refresh_cache-ca545a0c-89fd-4a04-9d87-c2698051ca87" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.network.neutron [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Updating instance_info_cache with network_info: [{"id": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "address": "fa:16:3e:f5:af:c7", "network": {"id": "5335fcd4-c9ce-4288-a2e9-4e9a1da25000", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612126582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7541fb4f462b438dbef4ffe9be4725b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4aee7d-5b", "ovs_interfaceid": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Releasing lock "refresh_cache-ca545a0c-89fd-4a04-9d87-c2698051ca87" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.compute.manager [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Instance network_info: |[{"id": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "address": "fa:16:3e:f5:af:c7", "network": {"id": "5335fcd4-c9ce-4288-a2e9-4e9a1da25000", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612126582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7541fb4f462b438dbef4ffe9be4725b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4aee7d-5b", "ovs_interfaceid": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0f776c80-f093-4699-afd1-1c26d0e36ee2 req-600cee84-7646-4967-83f2-db4b34ac2a1c service nova] Acquired lock "refresh_cache-ca545a0c-89fd-4a04-9d87-c2698051ca87" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.network.neutron [req-0f776c80-f093-4699-afd1-1c26d0e36ee2 req-600cee84-7646-4967-83f2-db4b34ac2a1c service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Refreshing network info cache for port 4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Start _get_guest_xml network_info=[{"id": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "address": "fa:16:3e:f5:af:c7", "network": {"id": "5335fcd4-c9ce-4288-a2e9-4e9a1da25000", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612126582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7541fb4f462b438dbef4ffe9be4725b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4aee7d-5b", "ovs_interfaceid": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:58:26 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:58:26 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:58:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-889710473',display_name='tempest-SnapshotDataIntegrityTests-server-889710473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-889710473',id=43,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwO2yVN0u4XlGH0M6pDTSgYUXsaaLN0zeC0aV1LGDSj49QfeGZM69qUPGAnK7OxkSIagJ6xwwO/GKxzZp+RcnTTv3Y+zrrV1Kux6mF8yggHb85/hY7NtDL0hDRxifjmA==',key_name='tempest-SnapshotDataIntegrityTests-1583885298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7541fb4f462b438dbef4ffe9be4725b5',ramdisk_id='',reservation_id='r-tlbyc3fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1196660338',owner_user_name='tempest-SnapshotDataIntegrityTests-1196660338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:58:23Z,user_data=None,user_id='325a0abaf7b6485ca97e2d2af2bc9778',uuid=ca545a0c-89fd-4a04-9d87-c2698051ca87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "address": "fa:16:3e:f5:af:c7", "network": {"id": "5335fcd4-c9ce-4288-a2e9-4e9a1da25000", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612126582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7541fb4f462b438dbef4ffe9be4725b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4aee7d-5b", "ovs_interfaceid": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Converting VIF {"id": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "address": "fa:16:3e:f5:af:c7", "network": {"id": "5335fcd4-c9ce-4288-a2e9-4e9a1da25000", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612126582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7541fb4f462b438dbef4ffe9be4725b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4aee7d-5b", "ovs_interfaceid": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:af:c7,bridge_name='br-int',has_traffic_filtering=True,id=4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74,network=Network(5335fcd4-c9ce-4288-a2e9-4e9a1da25000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4aee7d-5b') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.objects.instance [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lazy-loading 'pci_devices' on Instance uuid ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:58:26 user nova-compute[71557]:   <uuid>ca545a0c-89fd-4a04-9d87-c2698051ca87</uuid>
Apr 12 10:58:26 user nova-compute[71557]:   <name>instance-0000002b</name>
Apr 12 10:58:26 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:58:26 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:58:26 user nova-compute[71557]:   <metadata>
Apr 12 10:58:26 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:58:26 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:58:26 user nova-compute[71557]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-889710473</nova:name>
Apr 12 10:58:26 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:58:26</nova:creationTime>
Apr 12 10:58:26 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:58:26 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:58:26 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:58:26 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:58:26 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:58:26 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:58:26 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:58:26 user nova-compute[71557]:       <nova:owner>
Apr 12 10:58:26 user nova-compute[71557]:         <nova:user uuid="325a0abaf7b6485ca97e2d2af2bc9778">tempest-SnapshotDataIntegrityTests-1196660338-project-member</nova:user>
Apr 12 10:58:26 user nova-compute[71557]:         <nova:project uuid="7541fb4f462b438dbef4ffe9be4725b5">tempest-SnapshotDataIntegrityTests-1196660338</nova:project>
Apr 12 10:58:26 user nova-compute[71557]:       </nova:owner>
Apr 12 10:58:26 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 10:58:26 user nova-compute[71557]:       <nova:ports>
Apr 12 10:58:26 user nova-compute[71557]:         <nova:port uuid="4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74">
Apr 12 10:58:26 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 10:58:26 user nova-compute[71557]:         </nova:port>
Apr 12 10:58:26 user nova-compute[71557]:       </nova:ports>
Apr 12 10:58:26 user nova-compute[71557]:     </nova:instance>
Apr 12 10:58:26 user nova-compute[71557]:   </metadata>
Apr 12 10:58:26 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:58:26 user nova-compute[71557]:     <system>
Apr 12 10:58:26 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:58:26 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:58:26 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:58:26 user nova-compute[71557]:       <entry name="serial">ca545a0c-89fd-4a04-9d87-c2698051ca87</entry>
Apr 12 10:58:26 user nova-compute[71557]:       <entry name="uuid">ca545a0c-89fd-4a04-9d87-c2698051ca87</entry>
Apr 12 10:58:26 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:58:26 user nova-compute[71557]:     </system>
Apr 12 10:58:26 user nova-compute[71557]:   </sysinfo>
Apr 12 10:58:26 user nova-compute[71557]:   <os>
Apr 12 10:58:26 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:58:26 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:58:26 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:58:26 user nova-compute[71557]:   </os>
Apr 12 10:58:26 user nova-compute[71557]:   <features>
Apr 12 10:58:26 user nova-compute[71557]:     <acpi/>
Apr 12 10:58:26 user nova-compute[71557]:     <apic/>
Apr 12 10:58:26 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:58:26 user nova-compute[71557]:   </features>
Apr 12 10:58:26 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:58:26 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:58:26 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:58:26 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:58:26 user nova-compute[71557]:   </clock>
Apr 12 10:58:26 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:58:26 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:58:26 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:58:26 user nova-compute[71557]:   </cpu>
Apr 12 10:58:26 user nova-compute[71557]:   <devices>
Apr 12 10:58:26 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 10:58:26 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 10:58:26 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk"/>
Apr 12 10:58:26 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:58:26 user nova-compute[71557]:     </disk>
Apr 12 10:58:26 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:58:26 user nova-compute[71557]:       <mac address="fa:16:3e:f5:af:c7"/>
Apr 12 10:58:26 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:58:26 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:58:26 user nova-compute[71557]:       <target dev="tap4d4aee7d-5b"/>
Apr 12 10:58:26 user nova-compute[71557]:     </interface>
Apr 12 10:58:26 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:58:26 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/console.log" append="off"/>
Apr 12 10:58:26 user nova-compute[71557]:     </serial>
Apr 12 10:58:26 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:58:26 user nova-compute[71557]:     <video>
Apr 12 10:58:26 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:58:26 user nova-compute[71557]:     </video>
Apr 12 10:58:26 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:58:26 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:58:26 user nova-compute[71557]:     </rng>
Apr 12 10:58:26 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:58:26 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:58:26 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:58:26 user nova-compute[71557]:     </memballoon>
Apr 12 10:58:26 user nova-compute[71557]:   </devices>
Apr 12 10:58:26 user nova-compute[71557]: </domain>
Apr 12 10:58:26 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:58:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-889710473',display_name='tempest-SnapshotDataIntegrityTests-server-889710473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-889710473',id=43,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwO2yVN0u4XlGH0M6pDTSgYUXsaaLN0zeC0aV1LGDSj49QfeGZM69qUPGAnK7OxkSIagJ6xwwO/GKxzZp+RcnTTv3Y+zrrV1Kux6mF8yggHb85/hY7NtDL0hDRxifjmA==',key_name='tempest-SnapshotDataIntegrityTests-1583885298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7541fb4f462b438dbef4ffe9be4725b5',ramdisk_id='',reservation_id='r-tlbyc3fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1196660338',owner_user_name='tempest-SnapshotDataIntegrityTests-1196660338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:58:23Z,user_data=None,user_id='325a0abaf7b6485ca97e2d2af2bc9778',uuid=ca545a0c-89fd-4a04-9d87-c2698051ca87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "address": "fa:16:3e:f5:af:c7", "network": {"id": "5335fcd4-c9ce-4288-a2e9-4e9a1da25000", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612126582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7541fb4f462b438dbef4ffe9be4725b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4aee7d-5b", "ovs_interfaceid": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Converting VIF {"id": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "address": "fa:16:3e:f5:af:c7", "network": {"id": "5335fcd4-c9ce-4288-a2e9-4e9a1da25000", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612126582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7541fb4f462b438dbef4ffe9be4725b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4aee7d-5b", "ovs_interfaceid": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:af:c7,bridge_name='br-int',has_traffic_filtering=True,id=4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74,network=Network(5335fcd4-c9ce-4288-a2e9-4e9a1da25000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4aee7d-5b') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG os_vif [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:af:c7,bridge_name='br-int',has_traffic_filtering=True,id=4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74,network=Network(5335fcd4-c9ce-4288-a2e9-4e9a1da25000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4aee7d-5b') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d4aee7d-5b, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d4aee7d-5b, col_values=(('external_ids', {'iface-id': '4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:af:c7', 'vm-uuid': 'ca545a0c-89fd-4a04-9d87-c2698051ca87'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:26 user nova-compute[71557]: INFO os_vif [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:af:c7,bridge_name='br-int',has_traffic_filtering=True,id=4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74,network=Network(5335fcd4-c9ce-4288-a2e9-4e9a1da25000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4aee7d-5b')
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] No VIF found with MAC fa:16:3e:f5:af:c7, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.network.neutron [req-0f776c80-f093-4699-afd1-1c26d0e36ee2 req-600cee84-7646-4967-83f2-db4b34ac2a1c service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Updated VIF entry in instance network info cache for port 4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG nova.network.neutron [req-0f776c80-f093-4699-afd1-1c26d0e36ee2 req-600cee84-7646-4967-83f2-db4b34ac2a1c service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Updating instance_info_cache with network_info: [{"id": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "address": "fa:16:3e:f5:af:c7", "network": {"id": "5335fcd4-c9ce-4288-a2e9-4e9a1da25000", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612126582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7541fb4f462b438dbef4ffe9be4725b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4aee7d-5b", "ovs_interfaceid": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:58:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0f776c80-f093-4699-afd1-1c26d0e36ee2 req-600cee84-7646-4967-83f2-db4b34ac2a1c service nova] Releasing lock "refresh_cache-ca545a0c-89fd-4a04-9d87-c2698051ca87" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:58:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:28 user nova-compute[71557]: DEBUG nova.compute.manager [req-15fc3479-8e42-4e71-b2a7-cea6b82aba4c req-9de70aff-4e80-4405-9e06-79d2be62182e service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Received event network-vif-plugged-4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:58:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-15fc3479-8e42-4e71-b2a7-cea6b82aba4c req-9de70aff-4e80-4405-9e06-79d2be62182e service nova] Acquiring lock "ca545a0c-89fd-4a04-9d87-c2698051ca87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-15fc3479-8e42-4e71-b2a7-cea6b82aba4c req-9de70aff-4e80-4405-9e06-79d2be62182e service nova] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-15fc3479-8e42-4e71-b2a7-cea6b82aba4c req-9de70aff-4e80-4405-9e06-79d2be62182e service nova] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:28 user nova-compute[71557]: DEBUG nova.compute.manager [req-15fc3479-8e42-4e71-b2a7-cea6b82aba4c req-9de70aff-4e80-4405-9e06-79d2be62182e service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] No waiting events found dispatching network-vif-plugged-4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:58:28 user nova-compute[71557]: WARNING nova.compute.manager [req-15fc3479-8e42-4e71-b2a7-cea6b82aba4c req-9de70aff-4e80-4405-9e06-79d2be62182e service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Received unexpected event network-vif-plugged-4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 for instance with vm_state building and task_state spawning.
Apr 12 10:58:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:29 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681297109.9470804, ca545a0c-89fd-4a04-9d87-c2698051ca87 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:58:29 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] VM Resumed (Lifecycle Event)
Apr 12 10:58:29 user nova-compute[71557]: DEBUG nova.compute.manager [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:58:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:58:29 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Instance spawned successfully.
Apr 12 10:58:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:58:29 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:58:29 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:58:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:58:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:58:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:58:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:58:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:58:29 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:58:29 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:58:29 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681297109.9482715, ca545a0c-89fd-4a04-9d87-c2698051ca87 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:58:29 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] VM Started (Lifecycle Event)
Apr 12 10:58:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:58:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:58:30 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:58:30 user nova-compute[71557]: INFO nova.compute.manager [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Took 6.78 seconds to spawn the instance on the hypervisor.
Apr 12 10:58:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:58:30 user nova-compute[71557]: INFO nova.compute.manager [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Took 7.47 seconds to build instance.
Apr 12 10:58:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-afa2b8bc-4cf4-4537-b18a-5bc6bc999236 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.571s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:30 user nova-compute[71557]: DEBUG nova.compute.manager [req-aa3a5678-39c2-496c-9c9f-be69b60bfb86 req-0c8efb40-552c-4c41-9743-407db9d8291c service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Received event network-vif-plugged-4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:58:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-aa3a5678-39c2-496c-9c9f-be69b60bfb86 req-0c8efb40-552c-4c41-9743-407db9d8291c service nova] Acquiring lock "ca545a0c-89fd-4a04-9d87-c2698051ca87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-aa3a5678-39c2-496c-9c9f-be69b60bfb86 req-0c8efb40-552c-4c41-9743-407db9d8291c service nova] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-aa3a5678-39c2-496c-9c9f-be69b60bfb86 req-0c8efb40-552c-4c41-9743-407db9d8291c service nova] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:30 user nova-compute[71557]: DEBUG nova.compute.manager [req-aa3a5678-39c2-496c-9c9f-be69b60bfb86 req-0c8efb40-552c-4c41-9743-407db9d8291c service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] No waiting events found dispatching network-vif-plugged-4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:58:30 user nova-compute[71557]: WARNING nova.compute.manager [req-aa3a5678-39c2-496c-9c9f-be69b60bfb86 req-0c8efb40-552c-4c41-9743-407db9d8291c service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Received unexpected event network-vif-plugged-4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 for instance with vm_state active and task_state None.
Apr 12 10:58:31 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:31 user nova-compute[71557]: INFO nova.compute.manager [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Detaching volume 811e93eb-e600-41b9-ad7c-577a0f9938d1
Apr 12 10:58:31 user nova-compute[71557]: INFO nova.virt.block_device [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Attempting to driver detach volume 811e93eb-e600-41b9-ad7c-577a0f9938d1 from mountpoint /dev/vdb
Apr 12 10:58:31 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Attempting to detach device vdb from instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 10:58:31 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:58:31 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:58:31 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 10:58:31 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:58:31 user nova-compute[71557]:   <serial>811e93eb-e600-41b9-ad7c-577a0f9938d1</serial>
Apr 12 10:58:31 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 10:58:31 user nova-compute[71557]: </disk>
Apr 12 10:58:31 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:58:31 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Successfully detached device vdb from instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 from the persistent domain config.
Apr 12 10:58:31 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 10:58:31 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:58:31 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:58:31 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 10:58:31 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:58:31 user nova-compute[71557]:   <serial>811e93eb-e600-41b9-ad7c-577a0f9938d1</serial>
Apr 12 10:58:31 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 10:58:31 user nova-compute[71557]: </disk>
Apr 12 10:58:31 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681297112.0101938, 2aef35e7-5daf-4d41-b91b-a7ff4a481644 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 10:58:32 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Successfully detached device vdb from instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 from the live domain config.
Apr 12 10:58:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MndrmjNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:58:32 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:58:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3fcbfc-7f96-4981-9957-7f023f683b5d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:58:32 user nova-compute[71557]: No targets found.
Apr 12 10:58:32 user nova-compute[71557]: iSNS:
Apr 12 10:58:32 user nova-compute[71557]: No targets found.
Apr 12 10:58:32 user nova-compute[71557]: STATIC:
Apr 12 10:58:32 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1
Apr 12 10:58:32 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:58:32 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:58:32 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9
Apr 12 10:58:32 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:58:32 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:58:32 user nova-compute[71557]: FIRMWARE:
Apr 12 10:58:32 user nova-compute[71557]: No targets found.
Apr 12 10:58:32 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:58:32 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:58:32 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f89c9d4-23b6-451f-97ff-b132de76773f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[803cded9-4687-40b4-9a52-b841777ad37d]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:58:32 user nova-compute[71557]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:58:32 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 (non-flash)
Apr 12 10:58:32 user nova-compute[71557]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:58:32 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd4296b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1'): ({'sdb'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Removing single pathed devices sdb {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb9e6cd-9786-40e1-89fb-4c67af747ae2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ff5cc1-be20-41ba-9459-7aac57f5f8b8]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Flushing IO for device /dev/sdb {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dc85a1-dd9e-487a-aba5-19b592740056]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae26716-e64a-4ca7-890c-0783e00524d1]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[af660cb3-ce26-425d-bc10-b8bed9c9b4ba]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6273d1-1640-40e7-a98c-d499e2dc256b]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1, portal: 172.16.0.220,3260]
Apr 12 10:58:32 user nova-compute[71557]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1, portal: 172.16.0.220,3260] successful.
Apr 12 10:58:32 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e93eb-e600-41b9-ad7c-577a0f9938d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[096c305c-15c9-4daf-ad1d-e860e18509d0]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] <== disconnect_volume: return (300ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:58:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:58:33 user nova-compute[71557]: DEBUG nova.objects.instance [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'flavor' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:58:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-79aa8dee-887b-47e5-b362-2f30646fd630 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.756s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-05878093-8003-4d87-85e3-ec3ba68bbbd8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:33 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-05878093-8003-4d87-85e3-ec3ba68bbbd8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:33 user nova-compute[71557]: DEBUG nova.compute.manager [None req-05878093-8003-4d87-85e3-ec3ba68bbbd8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:58:33 user nova-compute[71557]: DEBUG nova.compute.manager [None req-05878093-8003-4d87-85e3-ec3ba68bbbd8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71557) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 12 10:58:33 user nova-compute[71557]: DEBUG nova.objects.instance [None req-05878093-8003-4d87-85e3-ec3ba68bbbd8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'flavor' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:58:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:34 user nova-compute[71557]: DEBUG nova.compute.manager [req-454cd19e-9a99-4cc4-90e9-4ef07ae229ec req-027fa4f0-a704-4b05-8440-3f38cf7b93b9 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received event network-vif-unplugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:58:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-454cd19e-9a99-4cc4-90e9-4ef07ae229ec req-027fa4f0-a704-4b05-8440-3f38cf7b93b9 service nova] Acquiring lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-454cd19e-9a99-4cc4-90e9-4ef07ae229ec req-027fa4f0-a704-4b05-8440-3f38cf7b93b9 service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-454cd19e-9a99-4cc4-90e9-4ef07ae229ec req-027fa4f0-a704-4b05-8440-3f38cf7b93b9 service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:34 user nova-compute[71557]: DEBUG nova.compute.manager [req-454cd19e-9a99-4cc4-90e9-4ef07ae229ec req-027fa4f0-a704-4b05-8440-3f38cf7b93b9 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] No waiting events found dispatching network-vif-unplugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:58:34 user nova-compute[71557]: WARNING nova.compute.manager [req-454cd19e-9a99-4cc4-90e9-4ef07ae229ec req-027fa4f0-a704-4b05-8440-3f38cf7b93b9 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received unexpected event network-vif-unplugged-8786a087-f036-403b-9b82-c75fc6dbb110 for instance with vm_state active and task_state powering-off.
Apr 12 10:58:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:34 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Instance destroyed successfully.
Apr 12 10:58:34 user nova-compute[71557]: DEBUG nova.compute.manager [None req-05878093-8003-4d87-85e3-ec3ba68bbbd8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:58:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-05878093-8003-4d87-85e3-ec3ba68bbbd8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.818s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:58:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:35 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:58:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-2681c131-1853-48c3-970c-8f1e5581e45c req-b8457a89-0c6f-492c-8534-10b29a3c5588 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received event network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:58:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2681c131-1853-48c3-970c-8f1e5581e45c req-b8457a89-0c6f-492c-8534-10b29a3c5588 service nova] Acquiring lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2681c131-1853-48c3-970c-8f1e5581e45c req-b8457a89-0c6f-492c-8534-10b29a3c5588 service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-2681c131-1853-48c3-970c-8f1e5581e45c req-b8457a89-0c6f-492c-8534-10b29a3c5588 service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:36 user nova-compute[71557]: DEBUG nova.compute.manager [req-2681c131-1853-48c3-970c-8f1e5581e45c req-b8457a89-0c6f-492c-8534-10b29a3c5588 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] No waiting events found dispatching network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:58:36 user nova-compute[71557]: WARNING nova.compute.manager [req-2681c131-1853-48c3-970c-8f1e5581e45c req-b8457a89-0c6f-492c-8534-10b29a3c5588 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received unexpected event network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 for instance with vm_state stopped and task_state None.
Apr 12 10:58:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:36 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681297101.910372, 0cb22a78-94df-49fb-918c-32856e1b5136 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:58:36 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] VM Stopped (Lifecycle Event)
Apr 12 10:58:36 user nova-compute[71557]: DEBUG nova.compute.manager [None req-42b81ffc-0d06-4ea1-99d0-f9016dffef84 None None] [instance: 0cb22a78-94df-49fb-918c-32856e1b5136] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:58:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:58:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:58:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:58:37 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:58:37 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:58:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=8039MB free_disk=26.14873504638672GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:58:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:58:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 97bafe22-36bf-4939-baf8-9602551bad52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:58:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:58:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:58:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:58:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:58:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance ca545a0c-89fd-4a04-9d87-c2698051ca87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:58:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:58:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:58:38 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:58:38 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:58:38 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:58:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.412s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:39 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:58:39 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:58:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:58:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-2aef35e7-5daf-4d41-b91b-a7ff4a481644" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:58:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-2aef35e7-5daf-4d41-b91b-a7ff4a481644" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:58:39 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:58:39 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Updating instance_info_cache with network_info: [{"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:58:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-2aef35e7-5daf-4d41-b91b-a7ff4a481644" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:58:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:58:39 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:58:39 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:58:39 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:58:40 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:58:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:42 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:58:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:49 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681297114.4329798, 2aef35e7-5daf-4d41-b91b-a7ff4a481644 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:58:49 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] VM Stopped (Lifecycle Event)
Apr 12 10:58:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-7e0f6a45-4188-41f8-8fc1-5059a36573b6 None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:58:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-7e0f6a45-4188-41f8-8fc1-5059a36573b6 None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:58:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "97bafe22-36bf-4939-baf8-9602551bad52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "97bafe22-36bf-4939-baf8-9602551bad52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "97bafe22-36bf-4939-baf8-9602551bad52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "97bafe22-36bf-4939-baf8-9602551bad52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "97bafe22-36bf-4939-baf8-9602551bad52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:49 user nova-compute[71557]: INFO nova.compute.manager [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Terminating instance
Apr 12 10:58:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:58:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:49 user nova-compute[71557]: DEBUG nova.compute.manager [req-47e7aba9-4933-47d3-831e-3ec74225936a req-da1d5435-94f3-494f-b976-204ccdac9888 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Received event network-vif-unplugged-580ed46e-ff10-494f-b864-42eda726a7ff {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:58:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-47e7aba9-4933-47d3-831e-3ec74225936a req-da1d5435-94f3-494f-b976-204ccdac9888 service nova] Acquiring lock "97bafe22-36bf-4939-baf8-9602551bad52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-47e7aba9-4933-47d3-831e-3ec74225936a req-da1d5435-94f3-494f-b976-204ccdac9888 service nova] Lock "97bafe22-36bf-4939-baf8-9602551bad52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-47e7aba9-4933-47d3-831e-3ec74225936a req-da1d5435-94f3-494f-b976-204ccdac9888 service nova] Lock "97bafe22-36bf-4939-baf8-9602551bad52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:49 user nova-compute[71557]: DEBUG nova.compute.manager [req-47e7aba9-4933-47d3-831e-3ec74225936a req-da1d5435-94f3-494f-b976-204ccdac9888 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] No waiting events found dispatching network-vif-unplugged-580ed46e-ff10-494f-b864-42eda726a7ff {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:58:49 user nova-compute[71557]: DEBUG nova.compute.manager [req-47e7aba9-4933-47d3-831e-3ec74225936a req-da1d5435-94f3-494f-b976-204ccdac9888 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Received event network-vif-unplugged-580ed46e-ff10-494f-b864-42eda726a7ff for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:58:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:50 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Instance destroyed successfully.
Apr 12 10:58:50 user nova-compute[71557]: DEBUG nova.objects.instance [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'resources' on Instance uuid 97bafe22-36bf-4939-baf8-9602551bad52 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:58:50 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-755364809',display_name='tempest-ServerRescueNegativeTestJSON-server-755364809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-755364809',id=23,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:44:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b39cd8e55b54a86a7784f2934273e20',ramdisk_id='',reservation_id='r-8rwff9ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1632398833',owner_user_name='tempest-ServerRescueNegativeTestJSON-1632398833-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:44:48Z,user_data=None,user_id='abdf772f2c7341c29159b6f1f2ce7ccb',uuid=97bafe22-36bf-4939-baf8-9602551bad52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "580ed46e-ff10-494f-b864-42eda726a7ff", "address": "fa:16:3e:a7:62:8b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580ed46e-ff", "ovs_interfaceid": "580ed46e-ff10-494f-b864-42eda726a7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:58:50 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converting VIF {"id": "580ed46e-ff10-494f-b864-42eda726a7ff", "address": "fa:16:3e:a7:62:8b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580ed46e-ff", "ovs_interfaceid": "580ed46e-ff10-494f-b864-42eda726a7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:58:50 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:62:8b,bridge_name='br-int',has_traffic_filtering=True,id=580ed46e-ff10-494f-b864-42eda726a7ff,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580ed46e-ff') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:58:50 user nova-compute[71557]: DEBUG os_vif [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:62:8b,bridge_name='br-int',has_traffic_filtering=True,id=580ed46e-ff10-494f-b864-42eda726a7ff,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580ed46e-ff') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:58:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap580ed46e-ff, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:58:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:58:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:50 user nova-compute[71557]: INFO os_vif [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:62:8b,bridge_name='br-int',has_traffic_filtering=True,id=580ed46e-ff10-494f-b864-42eda726a7ff,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580ed46e-ff')
Apr 12 10:58:50 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Deleting instance files /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52_del
Apr 12 10:58:50 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Deletion of /opt/stack/data/nova/instances/97bafe22-36bf-4939-baf8-9602551bad52_del complete
Apr 12 10:58:50 user nova-compute[71557]: INFO nova.compute.manager [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 12 10:58:50 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:58:50 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:58:50 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:58:50 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:58:50 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Took 0.48 seconds to deallocate network for instance.
Apr 12 10:58:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:51 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:58:51 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:58:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:51 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Deleted allocations for instance 97bafe22-36bf-4939-baf8-9602551bad52
Apr 12 10:58:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-6edf01a0-ab62-4766-a8f9-1fd273791d54 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "97bafe22-36bf-4939-baf8-9602551bad52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.833s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:51 user nova-compute[71557]: DEBUG nova.compute.manager [req-eed6b2d0-7b6a-43e2-9790-1a9144f723fa req-7ade8e5d-0c1c-4f73-b755-2eb5a066aa67 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Received event network-vif-plugged-580ed46e-ff10-494f-b864-42eda726a7ff {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:58:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-eed6b2d0-7b6a-43e2-9790-1a9144f723fa req-7ade8e5d-0c1c-4f73-b755-2eb5a066aa67 service nova] Acquiring lock "97bafe22-36bf-4939-baf8-9602551bad52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:58:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-eed6b2d0-7b6a-43e2-9790-1a9144f723fa req-7ade8e5d-0c1c-4f73-b755-2eb5a066aa67 service nova] Lock "97bafe22-36bf-4939-baf8-9602551bad52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:58:51 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-eed6b2d0-7b6a-43e2-9790-1a9144f723fa req-7ade8e5d-0c1c-4f73-b755-2eb5a066aa67 service nova] Lock "97bafe22-36bf-4939-baf8-9602551bad52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:58:51 user nova-compute[71557]: DEBUG nova.compute.manager [req-eed6b2d0-7b6a-43e2-9790-1a9144f723fa req-7ade8e5d-0c1c-4f73-b755-2eb5a066aa67 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] No waiting events found dispatching network-vif-plugged-580ed46e-ff10-494f-b864-42eda726a7ff {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:58:51 user nova-compute[71557]: WARNING nova.compute.manager [req-eed6b2d0-7b6a-43e2-9790-1a9144f723fa req-7ade8e5d-0c1c-4f73-b755-2eb5a066aa67 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Received unexpected event network-vif-plugged-580ed46e-ff10-494f-b864-42eda726a7ff for instance with vm_state deleted and task_state None.
Apr 12 10:58:51 user nova-compute[71557]: DEBUG nova.compute.manager [req-eed6b2d0-7b6a-43e2-9790-1a9144f723fa req-7ade8e5d-0c1c-4f73-b755-2eb5a066aa67 service nova] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Received event network-vif-deleted-580ed46e-ff10-494f-b864-42eda726a7ff {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:58:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:58:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:05 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681297130.3102305, 97bafe22-36bf-4939-baf8-9602551bad52 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:59:05 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] VM Stopped (Lifecycle Event)
Apr 12 10:59:05 user nova-compute[71557]: DEBUG nova.compute.manager [None req-9a25f3d4-20f7-4c7b-87f1-2ee8a2084f39 None None] [instance: 97bafe22-36bf-4939-baf8-9602551bad52] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:59:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:10 user nova-compute[71557]: DEBUG nova.compute.manager [req-d7611463-f441-449c-ab4f-58728b994fdf req-2832ad2e-37ef-4c03-9bf6-1269e8a15917 service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Received event network-changed-f43a5f64-a4b2-481b-9785-6a556a795d0a {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:59:10 user nova-compute[71557]: DEBUG nova.compute.manager [req-d7611463-f441-449c-ab4f-58728b994fdf req-2832ad2e-37ef-4c03-9bf6-1269e8a15917 service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Refreshing instance network info cache due to event network-changed-f43a5f64-a4b2-481b-9785-6a556a795d0a. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:59:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d7611463-f441-449c-ab4f-58728b994fdf req-2832ad2e-37ef-4c03-9bf6-1269e8a15917 service nova] Acquiring lock "refresh_cache-faf5e629-c914-43a1-bd73-ce4adfafe9d6" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:59:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d7611463-f441-449c-ab4f-58728b994fdf req-2832ad2e-37ef-4c03-9bf6-1269e8a15917 service nova] Acquired lock "refresh_cache-faf5e629-c914-43a1-bd73-ce4adfafe9d6" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:59:10 user nova-compute[71557]: DEBUG nova.network.neutron [req-d7611463-f441-449c-ab4f-58728b994fdf req-2832ad2e-37ef-4c03-9bf6-1269e8a15917 service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Refreshing network info cache for port f43a5f64-a4b2-481b-9785-6a556a795d0a {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:59:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:59:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:59:10 user nova-compute[71557]: DEBUG nova.objects.instance [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lazy-loading 'flavor' on Instance uuid faf5e629-c914-43a1-bd73-ce4adfafe9d6 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:59:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:59:11 user nova-compute[71557]: INFO nova.compute.manager [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Attaching volume fc49aa26-cc0b-43ef-98df-a709f5ba48f5 to /dev/vdb
Apr 12 10:59:11 user nova-compute[71557]: DEBUG os_brick.utils [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dabe827-13ae-4df5-9542-163402e8790e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8639c36-8549-42c2-8387-50992f378ee6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[829fad89-8625-4884-b016-dd10354715a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG nova.network.neutron [req-d7611463-f441-449c-ab4f-58728b994fdf req-2832ad2e-37ef-4c03-9bf6-1269e8a15917 service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Updated VIF entry in instance network info cache for port f43a5f64-a4b2-481b-9785-6a556a795d0a. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG nova.network.neutron [req-d7611463-f441-449c-ab4f-58728b994fdf req-2832ad2e-37ef-4c03-9bf6-1269e8a15917 service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Updating instance_info_cache with network_info: [{"id": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "address": "fa:16:3e:f6:ad:69", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a5f64-a4", "ovs_interfaceid": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee72742-186c-4397-b0ac-166b3a5bbc82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d7611463-f441-449c-ab4f-58728b994fdf req-2832ad2e-37ef-4c03-9bf6-1269e8a15917 service nova] Releasing lock "refresh_cache-faf5e629-c914-43a1-bd73-ce4adfafe9d6" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:59:11 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9223e1c-464d-4e3b-906b-bfff85ecafdc]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG os_brick.utils [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Updating existing volume attachment record: 0b7f5e66-72f3-4c85-b0ad-4f4ff967cd0c {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:59:11 user nova-compute[71557]: INFO nova.compute.manager [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Terminating instance
Apr 12 10:59:11 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:12 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Instance destroyed successfully.
Apr 12 10:59:12 user nova-compute[71557]: DEBUG nova.objects.instance [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lazy-loading 'resources' on Instance uuid a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:59:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2106762264',display_name='tempest-ServerActionsTestJSON-server-2106762264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2106762264',id=33,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSPzZAK4K6WfKgZv6ul+nJ2Lzppw5IMfK0+f9KuGByC6XjA59WQJmgMTCh01/yWlwW8qMjnx6gjYen9tQKzYmdVo3Z1KGqS/wGYHKKDRVeNNONzm9HfPYp2EDH6xyugDA==',key_name='tempest-keypair-1241183546',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:50:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32235c67d269474b879a58269c1bfb28',ramdisk_id='',reservation_id='r-7fentnxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2042231427',owner_user_name='tempest-ServerActionsTestJSON-2042231427-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:50:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0059d31539304ffcb5214b408751cd4f',uuid=a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "address": "fa:16:3e:98:5d:7d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e0f8a4-96", "ovs_interfaceid": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:59:12 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converting VIF {"id": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "address": "fa:16:3e:98:5d:7d", "network": {"id": "f246d51a-9d0f-483e-858e-7f71be8b6085", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-707748820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32235c67d269474b879a58269c1bfb28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e0f8a4-96", "ovs_interfaceid": "59e0f8a4-966b-46f3-921d-be0c6f15f281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:59:12 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:5d:7d,bridge_name='br-int',has_traffic_filtering=True,id=59e0f8a4-966b-46f3-921d-be0c6f15f281,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59e0f8a4-96') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:59:12 user nova-compute[71557]: DEBUG os_vif [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:5d:7d,bridge_name='br-int',has_traffic_filtering=True,id=59e0f8a4-966b-46f3-921d-be0c6f15f281,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59e0f8a4-96') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:59:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59e0f8a4-96, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:59:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:59:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:12 user nova-compute[71557]: INFO os_vif [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:5d:7d,bridge_name='br-int',has_traffic_filtering=True,id=59e0f8a4-966b-46f3-921d-be0c6f15f281,network=Network(f246d51a-9d0f-483e-858e-7f71be8b6085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59e0f8a4-96')
Apr 12 10:59:12 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Deleting instance files /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23_del
Apr 12 10:59:12 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Deletion of /opt/stack/data/nova/instances/a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23_del complete
Apr 12 10:59:12 user nova-compute[71557]: INFO nova.compute.manager [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 10:59:12 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:59:12 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:59:12 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:59:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-ebfd0bfa-b209-4e1e-96ff-254ce7b87e58 req-f98d2a0a-fc17-4f45-91e3-cbc91d40b7eb service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Received event network-vif-unplugged-59e0f8a4-966b-46f3-921d-be0c6f15f281 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:59:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ebfd0bfa-b209-4e1e-96ff-254ce7b87e58 req-f98d2a0a-fc17-4f45-91e3-cbc91d40b7eb service nova] Acquiring lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:59:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ebfd0bfa-b209-4e1e-96ff-254ce7b87e58 req-f98d2a0a-fc17-4f45-91e3-cbc91d40b7eb service nova] Lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:59:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ebfd0bfa-b209-4e1e-96ff-254ce7b87e58 req-f98d2a0a-fc17-4f45-91e3-cbc91d40b7eb service nova] Lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:59:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-ebfd0bfa-b209-4e1e-96ff-254ce7b87e58 req-f98d2a0a-fc17-4f45-91e3-cbc91d40b7eb service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] No waiting events found dispatching network-vif-unplugged-59e0f8a4-966b-46f3-921d-be0c6f15f281 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:59:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-ebfd0bfa-b209-4e1e-96ff-254ce7b87e58 req-f98d2a0a-fc17-4f45-91e3-cbc91d40b7eb service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Received event network-vif-unplugged-59e0f8a4-966b-46f3-921d-be0c6f15f281 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:59:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-ebfd0bfa-b209-4e1e-96ff-254ce7b87e58 req-f98d2a0a-fc17-4f45-91e3-cbc91d40b7eb service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Received event network-vif-plugged-59e0f8a4-966b-46f3-921d-be0c6f15f281 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:59:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ebfd0bfa-b209-4e1e-96ff-254ce7b87e58 req-f98d2a0a-fc17-4f45-91e3-cbc91d40b7eb service nova] Acquiring lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:59:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ebfd0bfa-b209-4e1e-96ff-254ce7b87e58 req-f98d2a0a-fc17-4f45-91e3-cbc91d40b7eb service nova] Lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:59:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-ebfd0bfa-b209-4e1e-96ff-254ce7b87e58 req-f98d2a0a-fc17-4f45-91e3-cbc91d40b7eb service nova] Lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:59:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-ebfd0bfa-b209-4e1e-96ff-254ce7b87e58 req-f98d2a0a-fc17-4f45-91e3-cbc91d40b7eb service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] No waiting events found dispatching network-vif-plugged-59e0f8a4-966b-46f3-921d-be0c6f15f281 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:59:12 user nova-compute[71557]: WARNING nova.compute.manager [req-ebfd0bfa-b209-4e1e-96ff-254ce7b87e58 req-f98d2a0a-fc17-4f45-91e3-cbc91d40b7eb service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Received unexpected event network-vif-plugged-59e0f8a4-966b-46f3-921d-be0c6f15f281 for instance with vm_state active and task_state deleting.
Apr 12 10:59:12 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:59:12 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Took 0.47 seconds to deallocate network for instance.
Apr 12 10:59:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-c9dc0658-1589-4949-8c1a-3a60cf7f0085 req-8592b09b-cb1d-4e53-aa5c-f8e662faa9bc service nova] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Received event network-vif-deleted-59e0f8a4-966b-46f3-921d-be0c6f15f281 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:59:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:59:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:59:13 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:59:13 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:59:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:59:13 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Deleted allocations for instance a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23
Apr 12 10:59:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f0115d04-09e5-4b42-ac2a-4e1acac9f763 tempest-ServerActionsTestJSON-2042231427 tempest-ServerActionsTestJSON-2042231427-project-member] Lock "a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.740s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:59:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwzlsdPA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:59:15 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:59:15 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:59:15 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e3e1cc-3f8c-4f90-8c99-fe6a75e934d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:59:15 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[268f6f55-5986-4540-a744-bf8ba1c5a0a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5] added
Apr 12 10:59:15 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ace3b3-9420-4978-9c7c-f8b6a9334519]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd190af-3607-4f13-ac2f-8674249a6db2]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwzlsdPA {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwzlsdPA" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b15af8-aeee-49f9-9aef-2817260312a2]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fwzlsdPA'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df939c9-1586-4985-abee-7f5dcaebe470]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58bd232-3e18-465c-b5b2-5e9b4718baea]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:59:15 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:59:15 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[780c8291-bdae-41f5-baf0-1b0833b20058]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5, portal: 172.16.0.220,3260]
Apr 12 10:59:15 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5, portal: 172.16.0.220,3260] successful.
Apr 12 10:59:15 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa0ab68-2e24-4221-a84f-7bc382d2981d]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50bb3db-cd73-47f0-8694-46139feb324c]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:59:15 user nova-compute[71557]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 (non-flash)
Apr 12 10:59:15 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:59:15 user nova-compute[71557]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 (non-flash)
Apr 12 10:59:15 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69b9651-a5de-47e4-8d89-ddb783598399]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:59:15 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwzlsdPA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:59:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:59:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26663366532343332', 'path': '/dev/sdb'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:59:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663366532343332', 'path': '/dev/sdb'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:59:16 user nova-compute[71557]: DEBUG nova.objects.instance [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lazy-loading 'flavor' on Instance uuid faf5e629-c914-43a1-bd73-ce4adfafe9d6 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:59:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 10:59:16 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:59:16 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 10:59:16 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:59:16 user nova-compute[71557]:   <serial>fc49aa26-cc0b-43ef-98df-a709f5ba48f5</serial>
Apr 12 10:59:16 user nova-compute[71557]: </disk>
Apr 12 10:59:16 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 10:59:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:59:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:59:17 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] No VIF found with MAC fa:16:3e:f6:ad:69, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:59:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b413d918-dce1-426b-bd66-fd6123445804 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.223s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:59:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:59:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:59:18 user nova-compute[71557]: INFO nova.compute.manager [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Detaching volume fc49aa26-cc0b-43ef-98df-a709f5ba48f5
Apr 12 10:59:18 user nova-compute[71557]: INFO nova.virt.block_device [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Attempting to driver detach volume fc49aa26-cc0b-43ef-98df-a709f5ba48f5 from mountpoint /dev/vdb
Apr 12 10:59:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Attempting to detach device vdb from instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 10:59:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:59:18 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:59:18 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 10:59:18 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:59:18 user nova-compute[71557]:   <serial>fc49aa26-cc0b-43ef-98df-a709f5ba48f5</serial>
Apr 12 10:59:18 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:59:18 user nova-compute[71557]: </disk>
Apr 12 10:59:18 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:59:18 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Successfully detached device vdb from instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 from the persistent domain config.
Apr 12 10:59:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 10:59:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 10:59:18 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:59:18 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 10:59:18 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 10:59:18 user nova-compute[71557]:   <serial>fc49aa26-cc0b-43ef-98df-a709f5ba48f5</serial>
Apr 12 10:59:18 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 10:59:18 user nova-compute[71557]: </disk>
Apr 12 10:59:18 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681297159.3694956, faf5e629-c914-43a1-bd73-ce4adfafe9d6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 10:59:19 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Successfully detached device vdb from instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 from the live domain config.
Apr 12 10:59:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwzlsdPA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:59:19 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:59:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4750b7ba-1d87-40ee-916f-d04fe6658a32]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:59:19 user nova-compute[71557]: No targets found.
Apr 12 10:59:19 user nova-compute[71557]: iSNS:
Apr 12 10:59:19 user nova-compute[71557]: No targets found.
Apr 12 10:59:19 user nova-compute[71557]: STATIC:
Apr 12 10:59:19 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5
Apr 12 10:59:19 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:59:19 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:59:19 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9
Apr 12 10:59:19 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:59:19 user nova-compute[71557]:                 Iface Name: default
Apr 12 10:59:19 user nova-compute[71557]: FIRMWARE:
Apr 12 10:59:19 user nova-compute[71557]: No targets found.
Apr 12 10:59:19 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:59:19 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:59:19 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c10299e-f78a-4a1b-aa2b-a4e2a4649ece]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c10c35-8c08-4584-a051-d95dfd9fe9ee]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:59:19 user nova-compute[71557]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 (non-flash)
Apr 12 10:59:19 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:59:19 user nova-compute[71557]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 (non-flash)
Apr 12 10:59:19 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd4295ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5'): ({'sdb'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Removing single pathed devices sdb {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3da834-69f2-4a9a-ac8f-302321ef5d02]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aa0130-39ae-4afd-a011-1d855ab50484]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Flushing IO for device /dev/sdb {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f33eaf-446c-41dd-b1c5-78808f5ebe0f]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d514b21e-8860-4ccc-a93e-482cb8bd0978]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[090eb462-5fea-4271-8f91-37de2500d126]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a3aa81-f344-4ffa-9a01-67a69c91c635]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5, portal: 172.16.0.220,3260]
Apr 12 10:59:19 user nova-compute[71557]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5, portal: 172.16.0.220,3260] successful.
Apr 12 10:59:19 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc49aa26-cc0b-43ef-98df-a709f5ba48f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2279905d-f638-4e96-a81c-87b89227c3cc]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] <== disconnect_volume: return (283ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:59:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:59:20 user nova-compute[71557]: DEBUG nova.objects.instance [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lazy-loading 'flavor' on Instance uuid faf5e629-c914-43a1-bd73-ce4adfafe9d6 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:59:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-fa655efe-f73d-46a4-b833-20bc370ab61c tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.632s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:59:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-96a1a0c5-0dee-4998-b980-a2e1af6eee73 req-0ae6b4f5-f590-4325-b08d-1204bc5e6b53 service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Received event network-changed-f0316e9d-800d-42f6-9078-eafa6da69f0d {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:59:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-96a1a0c5-0dee-4998-b980-a2e1af6eee73 req-0ae6b4f5-f590-4325-b08d-1204bc5e6b53 service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Refreshing instance network info cache due to event network-changed-f0316e9d-800d-42f6-9078-eafa6da69f0d. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:59:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-96a1a0c5-0dee-4998-b980-a2e1af6eee73 req-0ae6b4f5-f590-4325-b08d-1204bc5e6b53 service nova] Acquiring lock "refresh_cache-e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:59:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-96a1a0c5-0dee-4998-b980-a2e1af6eee73 req-0ae6b4f5-f590-4325-b08d-1204bc5e6b53 service nova] Acquired lock "refresh_cache-e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:59:25 user nova-compute[71557]: DEBUG nova.network.neutron [req-96a1a0c5-0dee-4998-b980-a2e1af6eee73 req-0ae6b4f5-f590-4325-b08d-1204bc5e6b53 service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Refreshing network info cache for port f0316e9d-800d-42f6-9078-eafa6da69f0d {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:59:26 user nova-compute[71557]: DEBUG nova.network.neutron [req-96a1a0c5-0dee-4998-b980-a2e1af6eee73 req-0ae6b4f5-f590-4325-b08d-1204bc5e6b53 service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Updated VIF entry in instance network info cache for port f0316e9d-800d-42f6-9078-eafa6da69f0d. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:59:26 user nova-compute[71557]: DEBUG nova.network.neutron [req-96a1a0c5-0dee-4998-b980-a2e1af6eee73 req-0ae6b4f5-f590-4325-b08d-1204bc5e6b53 service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Updating instance_info_cache with network_info: [{"id": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "address": "fa:16:3e:00:68:fe", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0316e9d-80", "ovs_interfaceid": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:59:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-96a1a0c5-0dee-4998-b980-a2e1af6eee73 req-0ae6b4f5-f590-4325-b08d-1204bc5e6b53 service nova] Releasing lock "refresh_cache-e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:59:27 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681297152.426772, a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:59:27 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] VM Stopped (Lifecycle Event)
Apr 12 10:59:27 user nova-compute[71557]: DEBUG nova.compute.manager [None req-a8b03f2a-ea25-47d4-b5d7-bc3ea7847268 None None] [instance: a586eb69-cf6d-4e4b-b3fa-dc1775bbbb23] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:59:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:59:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "948c893b-1292-4b9a-8c77-0e23c94387ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "948c893b-1292-4b9a-8c77-0e23c94387ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG nova.compute.manager [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 10:59:32 user nova-compute[71557]: INFO nova.compute.claims [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Claim successful on node user
Apr 12 10:59:32 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG nova.compute.manager [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG nova.compute.manager [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG nova.network.neutron [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 10:59:32 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 10:59:32 user nova-compute[71557]: DEBUG nova.compute.manager [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 10:59:32 user nova-compute[71557]: INFO nova.virt.block_device [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Booting with volume 3e779651-b7b5-4fa7-8451-d72ec750c44d at /dev/vda
Apr 12 10:59:32 user nova-compute[71557]: DEBUG nova.policy [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b914d7ca786f455baf120f98816abffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67f3d23b8f74a9496d445c7fc75717e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG os_brick.utils [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f92d3c-7bf6-4c53-a247-a6dcb7066f52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[645ac9b4-97a4-4914-b145-7e334832f9e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2dc5ec-08e3-426f-8082-9129d3137ea2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2580d7-6519-4420-b90c-c5121e413549]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 10:59:32 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 10:59:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f37fd0b-0a03-44b2-aa2a-bbb39d182797]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG os_brick.utils [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:59:32 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Updating existing volume attachment record: 06d31877-ee81-4bbb-a387-48dbed260f3c {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 10:59:33 user nova-compute[71557]: DEBUG nova.network.neutron [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Successfully created port: 7c976cd8-54d9-4233-be62-1cecf9cc63c6 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 10:59:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:34 user nova-compute[71557]: DEBUG nova.network.neutron [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Successfully updated port: 7c976cd8-54d9-4233-be62-1cecf9cc63c6 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 10:59:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "refresh_cache-948c893b-1292-4b9a-8c77-0e23c94387ae" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:59:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquired lock "refresh_cache-948c893b-1292-4b9a-8c77-0e23c94387ae" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:59:34 user nova-compute[71557]: DEBUG nova.network.neutron [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 10:59:34 user nova-compute[71557]: DEBUG nova.compute.manager [req-3ccc97f5-4cdc-4023-9b92-acc4ab9cbdc5 req-c723e3e3-a7e4-49f3-a826-2131e43058d3 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Received event network-changed-7c976cd8-54d9-4233-be62-1cecf9cc63c6 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:59:34 user nova-compute[71557]: DEBUG nova.compute.manager [req-3ccc97f5-4cdc-4023-9b92-acc4ab9cbdc5 req-c723e3e3-a7e4-49f3-a826-2131e43058d3 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Refreshing instance network info cache due to event network-changed-7c976cd8-54d9-4233-be62-1cecf9cc63c6. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:59:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3ccc97f5-4cdc-4023-9b92-acc4ab9cbdc5 req-c723e3e3-a7e4-49f3-a826-2131e43058d3 service nova] Acquiring lock "refresh_cache-948c893b-1292-4b9a-8c77-0e23c94387ae" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:59:34 user nova-compute[71557]: DEBUG nova.network.neutron [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 10:59:34 user nova-compute[71557]: DEBUG nova.network.neutron [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Updating instance_info_cache with network_info: [{"id": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "address": "fa:16:3e:93:c3:a8", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c976cd8-54", "ovs_interfaceid": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:59:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Releasing lock "refresh_cache-948c893b-1292-4b9a-8c77-0e23c94387ae" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:59:34 user nova-compute[71557]: DEBUG nova.compute.manager [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Instance network_info: |[{"id": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "address": "fa:16:3e:93:c3:a8", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c976cd8-54", "ovs_interfaceid": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 10:59:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3ccc97f5-4cdc-4023-9b92-acc4ab9cbdc5 req-c723e3e3-a7e4-49f3-a826-2131e43058d3 service nova] Acquired lock "refresh_cache-948c893b-1292-4b9a-8c77-0e23c94387ae" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:59:34 user nova-compute[71557]: DEBUG nova.network.neutron [req-3ccc97f5-4cdc-4023-9b92-acc4ab9cbdc5 req-c723e3e3-a7e4-49f3-a826-2131e43058d3 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Refreshing network info cache for port 7c976cd8-54d9-4233-be62-1cecf9cc63c6 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:59:35 user nova-compute[71557]: DEBUG nova.network.neutron [req-3ccc97f5-4cdc-4023-9b92-acc4ab9cbdc5 req-c723e3e3-a7e4-49f3-a826-2131e43058d3 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Updated VIF entry in instance network info cache for port 7c976cd8-54d9-4233-be62-1cecf9cc63c6. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:59:35 user nova-compute[71557]: DEBUG nova.network.neutron [req-3ccc97f5-4cdc-4023-9b92-acc4ab9cbdc5 req-c723e3e3-a7e4-49f3-a826-2131e43058d3 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Updating instance_info_cache with network_info: [{"id": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "address": "fa:16:3e:93:c3:a8", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c976cd8-54", "ovs_interfaceid": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:59:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3ccc97f5-4cdc-4023-9b92-acc4ab9cbdc5 req-c723e3e3-a7e4-49f3-a826-2131e43058d3 service nova] Releasing lock "refresh_cache-948c893b-1292-4b9a-8c77-0e23c94387ae" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:59:36 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:59:36 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:59:36 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Didn't find any instances for network info cache update. {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 10:59:36 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG nova.compute.manager [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 10:59:37 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Creating image(s)
Apr 12 10:59:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Did not create local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Ensure instance console log exists: /opt/stack/data/nova/instances/948c893b-1292-4b9a-8c77-0e23c94387ae/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Start _get_guest_xml network_info=[{"id": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "address": "fa:16:3e:93:c3:a8", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c976cd8-54", "ovs_interfaceid": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'attachment_id': '06d31877-ee81-4bbb-a387-48dbed260f3c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OSMsbAGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '948c893b-1292-4b9a-8c77-0e23c94387ae', 'attached_at': '', 'detached_at': '', 'volume_id': '3e779651-b7b5-4fa7-8451-d72ec750c44d', 'serial': '3e779651-b7b5-4fa7-8451-d72ec750c44d'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 10:59:37 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:59:37 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:59:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OSMsbAGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:59:37 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:59:37 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:59:37 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[14282e08-24ad-4ace-919c-ae51bafc92eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 10:59:37 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76d8d45-a3d4-4ee6-a83f-bfbd29b2c9a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d] added
Apr 12 10:59:37 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae3252b-5428-4c64-bcc2-6dd8d46bfbdc]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0813b93b-da3c-4622-9583-4bf4ac0516c7]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OSMsbAGV {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OSMsbAGV" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aac263-0a23-46bc-a779-780064646e00]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OSMsbAGV'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[011d4292-bc53-4e75-83fb-3cc882b2586e]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae2e888-b13f-430a-9179-17994b77123e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:59:37 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:59:37 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaf30ba-9512-437f-9f48-a3d0acea3a87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d, portal: 172.16.0.220,3260]
Apr 12 10:59:37 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d, portal: 172.16.0.220,3260] successful.
Apr 12 10:59:37 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f86d219-4267-41b5-a12b-736638978394]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[26851ac1-7d3c-4812-87fa-fc5e2d9efe1c]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:59:37 user nova-compute[71557]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d (non-flash)
Apr 12 10:59:37 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 10:59:37 user nova-compute[71557]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d (non-flash)
Apr 12 10:59:37 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d799a8-4897-4a42-9b1a-3c75ac238971]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 10:59:37 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OSMsbAGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 10:59:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:59:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:59:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.454s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] <== connect_volume: return (1455ms) {'type': 'block', 'scsi_wwn': '26466393562666564', 'path': '/dev/sdb'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466393562666564', 'path': '/dev/sdb'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 10:59:39 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:59:39 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=8265MB free_disk=26.18533706665039GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1577337770',display_name='tempest-TestVolumeBootPattern-server-1577337770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1577337770',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeNYUbBfSwdaJdVL2RMsgRRuPmOdMNSAwl/DHzaeVhE0fDjZe84+pAYZqsgenmNqm/u0yGuL1KeKxxwsT2FNR2LdwQFC7iIcZOaTovpAXdmD/5wx/0lhCQf7gPsmZ5xfg==',key_name='tempest-TestVolumeBootPattern-162796269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a67f3d23b8f74a9496d445c7fc75717e',ramdisk_id='',reservation_id='r-l1it6cib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-638607559',owner_user_name='tempest-TestVolumeBootPattern-638607559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:59:33Z,user_data=None,user_id='b914d7ca786f455baf120f98816abffd',uuid=948c893b-1292-4b9a-8c77-0e23c94387ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "address": "fa:16:3e:93:c3:a8", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c976cd8-54", "ovs_interfaceid": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converting VIF {"id": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "address": "fa:16:3e:93:c3:a8", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c976cd8-54", "ovs_interfaceid": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:c3:a8,bridge_name='br-int',has_traffic_filtering=True,id=7c976cd8-54d9-4233-be62-1cecf9cc63c6,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c976cd8-54') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.objects.instance [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lazy-loading 'pci_devices' on Instance uuid 948c893b-1292-4b9a-8c77-0e23c94387ae {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] End _get_guest_xml xml=<domain type="kvm">
Apr 12 10:59:39 user nova-compute[71557]:   <uuid>948c893b-1292-4b9a-8c77-0e23c94387ae</uuid>
Apr 12 10:59:39 user nova-compute[71557]:   <name>instance-0000002c</name>
Apr 12 10:59:39 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 10:59:39 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 10:59:39 user nova-compute[71557]:   <metadata>
Apr 12 10:59:39 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 10:59:39 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 10:59:39 user nova-compute[71557]:       <nova:name>tempest-TestVolumeBootPattern-server-1577337770</nova:name>
Apr 12 10:59:39 user nova-compute[71557]:       <nova:creationTime>2023-04-12 10:59:37</nova:creationTime>
Apr 12 10:59:39 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 10:59:39 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 10:59:39 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 10:59:39 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 10:59:39 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 10:59:39 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 10:59:39 user nova-compute[71557]:       </nova:flavor>
Apr 12 10:59:39 user nova-compute[71557]:       <nova:owner>
Apr 12 10:59:39 user nova-compute[71557]:         <nova:user uuid="b914d7ca786f455baf120f98816abffd">tempest-TestVolumeBootPattern-638607559-project-member</nova:user>
Apr 12 10:59:39 user nova-compute[71557]:         <nova:project uuid="a67f3d23b8f74a9496d445c7fc75717e">tempest-TestVolumeBootPattern-638607559</nova:project>
Apr 12 10:59:39 user nova-compute[71557]:       </nova:owner>
Apr 12 10:59:39 user nova-compute[71557]:       <nova:ports>
Apr 12 10:59:39 user nova-compute[71557]:         <nova:port uuid="7c976cd8-54d9-4233-be62-1cecf9cc63c6">
Apr 12 10:59:39 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 10:59:39 user nova-compute[71557]:         </nova:port>
Apr 12 10:59:39 user nova-compute[71557]:       </nova:ports>
Apr 12 10:59:39 user nova-compute[71557]:     </nova:instance>
Apr 12 10:59:39 user nova-compute[71557]:   </metadata>
Apr 12 10:59:39 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 10:59:39 user nova-compute[71557]:     <system>
Apr 12 10:59:39 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 10:59:39 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 10:59:39 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 10:59:39 user nova-compute[71557]:       <entry name="serial">948c893b-1292-4b9a-8c77-0e23c94387ae</entry>
Apr 12 10:59:39 user nova-compute[71557]:       <entry name="uuid">948c893b-1292-4b9a-8c77-0e23c94387ae</entry>
Apr 12 10:59:39 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 10:59:39 user nova-compute[71557]:     </system>
Apr 12 10:59:39 user nova-compute[71557]:   </sysinfo>
Apr 12 10:59:39 user nova-compute[71557]:   <os>
Apr 12 10:59:39 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 10:59:39 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 10:59:39 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 10:59:39 user nova-compute[71557]:   </os>
Apr 12 10:59:39 user nova-compute[71557]:   <features>
Apr 12 10:59:39 user nova-compute[71557]:     <acpi/>
Apr 12 10:59:39 user nova-compute[71557]:     <apic/>
Apr 12 10:59:39 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 10:59:39 user nova-compute[71557]:   </features>
Apr 12 10:59:39 user nova-compute[71557]:   <clock offset="utc">
Apr 12 10:59:39 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 10:59:39 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 10:59:39 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 10:59:39 user nova-compute[71557]:   </clock>
Apr 12 10:59:39 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 10:59:39 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 10:59:39 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 10:59:39 user nova-compute[71557]:   </cpu>
Apr 12 10:59:39 user nova-compute[71557]:   <devices>
Apr 12 10:59:39 user nova-compute[71557]:     <disk type="block" device="disk">
Apr 12 10:59:39 user nova-compute[71557]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 10:59:39 user nova-compute[71557]:       <source dev="/dev/sdb"/>
Apr 12 10:59:39 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 10:59:39 user nova-compute[71557]:       <serial>3e779651-b7b5-4fa7-8451-d72ec750c44d</serial>
Apr 12 10:59:39 user nova-compute[71557]:     </disk>
Apr 12 10:59:39 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 10:59:39 user nova-compute[71557]:       <mac address="fa:16:3e:93:c3:a8"/>
Apr 12 10:59:39 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:59:39 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 10:59:39 user nova-compute[71557]:       <target dev="tap7c976cd8-54"/>
Apr 12 10:59:39 user nova-compute[71557]:     </interface>
Apr 12 10:59:39 user nova-compute[71557]:     <serial type="pty">
Apr 12 10:59:39 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/948c893b-1292-4b9a-8c77-0e23c94387ae/console.log" append="off"/>
Apr 12 10:59:39 user nova-compute[71557]:     </serial>
Apr 12 10:59:39 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 10:59:39 user nova-compute[71557]:     <video>
Apr 12 10:59:39 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 10:59:39 user nova-compute[71557]:     </video>
Apr 12 10:59:39 user nova-compute[71557]:     <rng model="virtio">
Apr 12 10:59:39 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 10:59:39 user nova-compute[71557]:     </rng>
Apr 12 10:59:39 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 10:59:39 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 10:59:39 user nova-compute[71557]:       <stats period="10"/>
Apr 12 10:59:39 user nova-compute[71557]:     </memballoon>
Apr 12 10:59:39 user nova-compute[71557]:   </devices>
Apr 12 10:59:39 user nova-compute[71557]: </domain>
Apr 12 10:59:39 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1577337770',display_name='tempest-TestVolumeBootPattern-server-1577337770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1577337770',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeNYUbBfSwdaJdVL2RMsgRRuPmOdMNSAwl/DHzaeVhE0fDjZe84+pAYZqsgenmNqm/u0yGuL1KeKxxwsT2FNR2LdwQFC7iIcZOaTovpAXdmD/5wx/0lhCQf7gPsmZ5xfg==',key_name='tempest-TestVolumeBootPattern-162796269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a67f3d23b8f74a9496d445c7fc75717e',ramdisk_id='',reservation_id='r-l1it6cib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-638607559',owner_user_name='tempest-TestVolumeBootPattern-638607559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:59:33Z,user_data=None,user_id='b914d7ca786f455baf120f98816abffd',uuid=948c893b-1292-4b9a-8c77-0e23c94387ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "address": "fa:16:3e:93:c3:a8", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c976cd8-54", "ovs_interfaceid": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converting VIF {"id": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "address": "fa:16:3e:93:c3:a8", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c976cd8-54", "ovs_interfaceid": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:c3:a8,bridge_name='br-int',has_traffic_filtering=True,id=7c976cd8-54d9-4233-be62-1cecf9cc63c6,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c976cd8-54') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG os_vif [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:c3:a8,bridge_name='br-int',has_traffic_filtering=True,id=7c976cd8-54d9-4233-be62-1cecf9cc63c6,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c976cd8-54') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c976cd8-54, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c976cd8-54, col_values=(('external_ids', {'iface-id': '7c976cd8-54d9-4233-be62-1cecf9cc63c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:c3:a8', 'vm-uuid': '948c893b-1292-4b9a-8c77-0e23c94387ae'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:39 user nova-compute[71557]: INFO os_vif [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:c3:a8,bridge_name='br-int',has_traffic_filtering=True,id=7c976cd8-54d9-4233-be62-1cecf9cc63c6,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c976cd8-54')
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance ca545a0c-89fd-4a04-9d87-c2698051ca87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 948c893b-1292-4b9a-8c77-0e23c94387ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] No VIF found with MAC fa:16:3e:93:c3:a8, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:59:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "be3f67e5-420d-42a2-b68a-7cadff22fa48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:59:40 user nova-compute[71557]: INFO nova.compute.manager [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Terminating instance
Apr 12 10:59:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG nova.compute.manager [req-3bdabee0-c37f-4188-adf7-6cbb76480f7c req-551d1718-94f6-46ea-932c-1ad5f4fb32ad service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received event network-vif-unplugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3bdabee0-c37f-4188-adf7-6cbb76480f7c req-551d1718-94f6-46ea-932c-1ad5f4fb32ad service nova] Acquiring lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3bdabee0-c37f-4188-adf7-6cbb76480f7c req-551d1718-94f6-46ea-932c-1ad5f4fb32ad service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3bdabee0-c37f-4188-adf7-6cbb76480f7c req-551d1718-94f6-46ea-932c-1ad5f4fb32ad service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG nova.compute.manager [req-3bdabee0-c37f-4188-adf7-6cbb76480f7c req-551d1718-94f6-46ea-932c-1ad5f4fb32ad service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] No waiting events found dispatching network-vif-unplugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG nova.compute.manager [req-3bdabee0-c37f-4188-adf7-6cbb76480f7c req-551d1718-94f6-46ea-932c-1ad5f4fb32ad service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received event network-vif-unplugged-943dbed4-3180-4221-b27c-710c0118b7cf for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:41 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Instance destroyed successfully.
Apr 12 10:59:41 user nova-compute[71557]: DEBUG nova.objects.instance [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lazy-loading 'resources' on Instance uuid be3f67e5-420d-42a2-b68a-7cadff22fa48 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:59:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1871933050',display_name='tempest-ServerRescueNegativeTestJSON-server-1871933050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1871933050',id=22,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:47:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b39cd8e55b54a86a7784f2934273e20',ramdisk_id='',reservation_id='r-14dvps6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1632398833',owner_user_name='tempest-ServerRescueNegativeTestJSON-1632398833-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:49:31Z,user_data=None,user_id='abdf772f2c7341c29159b6f1f2ce7ccb',uuid=be3f67e5-420d-42a2-b68a-7cadff22fa48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "943dbed4-3180-4221-b27c-710c0118b7cf", "address": "fa:16:3e:d5:a9:3b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap943dbed4-31", "ovs_interfaceid": "943dbed4-3180-4221-b27c-710c0118b7cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:59:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converting VIF {"id": "943dbed4-3180-4221-b27c-710c0118b7cf", "address": "fa:16:3e:d5:a9:3b", "network": {"id": "98c9dc65-829b-425d-8645-c7e8998720cc", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1236020589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b39cd8e55b54a86a7784f2934273e20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap943dbed4-31", "ovs_interfaceid": "943dbed4-3180-4221-b27c-710c0118b7cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:59:41 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a9:3b,bridge_name='br-int',has_traffic_filtering=True,id=943dbed4-3180-4221-b27c-710c0118b7cf,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap943dbed4-31') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:59:41 user nova-compute[71557]: DEBUG os_vif [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a9:3b,bridge_name='br-int',has_traffic_filtering=True,id=943dbed4-3180-4221-b27c-710c0118b7cf,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap943dbed4-31') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:59:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap943dbed4-31, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:59:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:59:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:41 user nova-compute[71557]: INFO os_vif [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a9:3b,bridge_name='br-int',has_traffic_filtering=True,id=943dbed4-3180-4221-b27c-710c0118b7cf,network=Network(98c9dc65-829b-425d-8645-c7e8998720cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap943dbed4-31')
Apr 12 10:59:41 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Deleting instance files /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48_del
Apr 12 10:59:41 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Deletion of /opt/stack/data/nova/instances/be3f67e5-420d-42a2-b68a-7cadff22fa48_del complete
Apr 12 10:59:41 user nova-compute[71557]: INFO nova.compute.manager [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 12 10:59:41 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:59:41 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:59:41 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:59:41 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:59:41 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Took 0.50 seconds to deallocate network for instance.
Apr 12 10:59:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-dece4af9-1ab0-471c-b558-8336096bc966 req-b80c1db4-e63a-40b8-9da7-3cc4e9dc6539 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received event network-vif-deleted-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:59:41 user nova-compute[71557]: INFO nova.compute.manager [req-dece4af9-1ab0-471c-b558-8336096bc966 req-b80c1db4-e63a-40b8-9da7-3cc4e9dc6539 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Neutron deleted interface 943dbed4-3180-4221-b27c-710c0118b7cf; detaching it from the instance and deleting it from the info cache
Apr 12 10:59:41 user nova-compute[71557]: DEBUG nova.network.neutron [req-dece4af9-1ab0-471c-b558-8336096bc966 req-b80c1db4-e63a-40b8-9da7-3cc4e9dc6539 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:59:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-dece4af9-1ab0-471c-b558-8336096bc966 req-b80c1db4-e63a-40b8-9da7-3cc4e9dc6539 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Detach interface failed, port_id=943dbed4-3180-4221-b27c-710c0118b7cf, reason: Instance be3f67e5-420d-42a2-b68a-7cadff22fa48 could not be found. {{(pid=71557) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 10:59:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:59:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:59:41 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:59:41 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:59:42 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Deleted allocations for instance be3f67e5-420d-42a2-b68a-7cadff22fa48
Apr 12 10:59:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-fcf5f6fe-0ff9-417c-889a-ae441ea66ea2 tempest-ServerRescueNegativeTestJSON-1632398833 tempest-ServerRescueNegativeTestJSON-1632398833-project-member] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.069s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG nova.compute.manager [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received event network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] Acquiring lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] Lock "be3f67e5-420d-42a2-b68a-7cadff22fa48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG nova.compute.manager [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] No waiting events found dispatching network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:59:42 user nova-compute[71557]: WARNING nova.compute.manager [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Received unexpected event network-vif-plugged-943dbed4-3180-4221-b27c-710c0118b7cf for instance with vm_state deleted and task_state None.
Apr 12 10:59:42 user nova-compute[71557]: DEBUG nova.compute.manager [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Received event network-vif-plugged-7c976cd8-54d9-4233-be62-1cecf9cc63c6 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] Acquiring lock "948c893b-1292-4b9a-8c77-0e23c94387ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] Lock "948c893b-1292-4b9a-8c77-0e23c94387ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] Lock "948c893b-1292-4b9a-8c77-0e23c94387ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG nova.compute.manager [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] No waiting events found dispatching network-vif-plugged-7c976cd8-54d9-4233-be62-1cecf9cc63c6 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:59:42 user nova-compute[71557]: WARNING nova.compute.manager [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Received unexpected event network-vif-plugged-7c976cd8-54d9-4233-be62-1cecf9cc63c6 for instance with vm_state building and task_state spawning.
Apr 12 10:59:42 user nova-compute[71557]: DEBUG nova.compute.manager [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Received event network-vif-plugged-7c976cd8-54d9-4233-be62-1cecf9cc63c6 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] Acquiring lock "948c893b-1292-4b9a-8c77-0e23c94387ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] Lock "948c893b-1292-4b9a-8c77-0e23c94387ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] Lock "948c893b-1292-4b9a-8c77-0e23c94387ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG nova.compute.manager [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] No waiting events found dispatching network-vif-plugged-7c976cd8-54d9-4233-be62-1cecf9cc63c6 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:59:42 user nova-compute[71557]: WARNING nova.compute.manager [req-57f81dff-4aa9-4556-8ae3-f2bebfc41b39 req-09d015df-84d3-45c5-8282-de3093dfc671 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Received unexpected event network-vif-plugged-7c976cd8-54d9-4233-be62-1cecf9cc63c6 for instance with vm_state building and task_state spawning.
Apr 12 10:59:42 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681297182.91289, 948c893b-1292-4b9a-8c77-0e23c94387ae => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:59:42 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] VM Resumed (Lifecycle Event)
Apr 12 10:59:42 user nova-compute[71557]: DEBUG nova.compute.manager [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:59:42 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Instance spawned successfully.
Apr 12 10:59:42 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 10:59:42 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:59:42 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681297182.9157019, 948c893b-1292-4b9a-8c77-0e23c94387ae => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:59:42 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] VM Started (Lifecycle Event)
Apr 12 10:59:42 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:59:42 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:59:43 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:59:43 user nova-compute[71557]: INFO nova.compute.manager [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Took 5.48 seconds to spawn the instance on the hypervisor.
Apr 12 10:59:43 user nova-compute[71557]: DEBUG nova.compute.manager [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:59:43 user nova-compute[71557]: INFO nova.compute.manager [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Took 10.88 seconds to build instance.
Apr 12 10:59:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-91b8423f-d648-4148-913e-5f2e18c5669a tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "948c893b-1292-4b9a-8c77-0e23c94387ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.966s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:59:43 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:59:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:45 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:59:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:51 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:56 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681297181.0974898, be3f67e5-420d-42a2-b68a-7cadff22fa48 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:59:56 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] VM Stopped (Lifecycle Event)
Apr 12 10:59:56 user nova-compute[71557]: DEBUG nova.compute.manager [None req-1c18fe28-b132-4c3c-b852-d3802663387d None None] [instance: be3f67e5-420d-42a2-b68a-7cadff22fa48] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:59:56 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:59:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 11:00:12 user nova-compute[71557]: INFO nova.compute.manager [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] instance snapshotting
Apr 12 11:00:12 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Beginning live snapshot process
Apr 12 11:00:12 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json -f qcow2 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:12 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json -f qcow2" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:12 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json -f qcow2 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:12 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json -f qcow2" returned: 0 in 0.146s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:12 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.149s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf3ui7jv_/a913a59f9787407dbf40e91be9a69435.delta 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf3ui7jv_/a913a59f9787407dbf40e91be9a69435.delta 1073741824" returned: 0 in 0.047s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:13 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 11:00:13 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 11:00:14 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71557) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 11:00:14 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 11:00:14 user nova-compute[71557]: DEBUG nova.privsep.utils [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71557) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 11:00:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf3ui7jv_/a913a59f9787407dbf40e91be9a69435.delta /opt/stack/data/nova/instances/snapshots/tmpf3ui7jv_/a913a59f9787407dbf40e91be9a69435 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:14 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf3ui7jv_/a913a59f9787407dbf40e91be9a69435.delta /opt/stack/data/nova/instances/snapshots/tmpf3ui7jv_/a913a59f9787407dbf40e91be9a69435" returned: 0 in 0.398s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:14 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Snapshot extracted, beginning image upload
Apr 12 11:00:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-db4f8660-5e7d-4bf5-a8e8-7febbf36035d req-e3799251-b489-4be4-85c8-b2623dfb4336 service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Received event network-changed-4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:00:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-db4f8660-5e7d-4bf5-a8e8-7febbf36035d req-e3799251-b489-4be4-85c8-b2623dfb4336 service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Refreshing instance network info cache due to event network-changed-4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 11:00:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-db4f8660-5e7d-4bf5-a8e8-7febbf36035d req-e3799251-b489-4be4-85c8-b2623dfb4336 service nova] Acquiring lock "refresh_cache-ca545a0c-89fd-4a04-9d87-c2698051ca87" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 11:00:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-db4f8660-5e7d-4bf5-a8e8-7febbf36035d req-e3799251-b489-4be4-85c8-b2623dfb4336 service nova] Acquired lock "refresh_cache-ca545a0c-89fd-4a04-9d87-c2698051ca87" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 11:00:15 user nova-compute[71557]: DEBUG nova.network.neutron [req-db4f8660-5e7d-4bf5-a8e8-7febbf36035d req-e3799251-b489-4be4-85c8-b2623dfb4336 service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Refreshing network info cache for port 4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG nova.objects.instance [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lazy-loading 'flavor' on Instance uuid ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:00:16 user nova-compute[71557]: INFO nova.compute.manager [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Attaching volume 135f653f-dd8f-429b-8d7a-d8830a8d0bfb to /dev/vdb
Apr 12 11:00:16 user nova-compute[71557]: DEBUG os_brick.utils [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14a2f15-20ba-4073-ba2e-0c0541d068cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee1bca9-d46e-4ad2-94a9-a114a1a370aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG nova.network.neutron [req-db4f8660-5e7d-4bf5-a8e8-7febbf36035d req-e3799251-b489-4be4-85c8-b2623dfb4336 service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Updated VIF entry in instance network info cache for port 4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG nova.network.neutron [req-db4f8660-5e7d-4bf5-a8e8-7febbf36035d req-e3799251-b489-4be4-85c8-b2623dfb4336 service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Updating instance_info_cache with network_info: [{"id": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "address": "fa:16:3e:f5:af:c7", "network": {"id": "5335fcd4-c9ce-4288-a2e9-4e9a1da25000", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612126582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7541fb4f462b438dbef4ffe9be4725b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4aee7d-5b", "ovs_interfaceid": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[721f8c7c-268b-47bf-a3c5-6cc18f763ddf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0797c95c-8788-4220-a75f-7339590eaa3f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-db4f8660-5e7d-4bf5-a8e8-7febbf36035d req-e3799251-b489-4be4-85c8-b2623dfb4336 service nova] Releasing lock "refresh_cache-ca545a0c-89fd-4a04-9d87-c2698051ca87" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 11:00:16 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 11:00:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a03342-ac44-4b9d-bb0a-98ecdc681942]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG os_brick.utils [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:00:16 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Updating existing volume attachment record: 4478be51-c948-4b90-94aa-3009221054ac {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 11:00:17 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Snapshot image upload complete
Apr 12 11:00:17 user nova-compute[71557]: INFO nova.compute.manager [None req-0c6fa1df-94ad-468f-aa2c-c8e687bc119f tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Took 4.87 seconds to snapshot the instance on the hypervisor.
Apr 12 11:00:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG nova.compute.manager [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 11:00:21 user nova-compute[71557]: INFO nova.compute.claims [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Claim successful on node user
Apr 12 11:00:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnEtomdF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:00:21 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:00:21 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:00:21 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f424eb3-88dc-493f-b030-6b78cffc848d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 11:00:21 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4658cb54-b1a2-46e2-b6c4-172b4556e0f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb] added
Apr 12 11:00:21 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa23471-ff7b-4891-8780-ea3cee86b475]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ec558e-3af9-4bc8-b109-764af91397af]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hnEtomdF {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hnEtomdF" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dd4931-fb67-46fb-ac02-1c1071bdd7e3]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hnEtomdF'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81b4ee0-3ed8-46a3-8778-1f0d8316c35f]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bc9914-845a-440f-bd8c-d2f8a5249131]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 11:00:21 user nova-compute[71557]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d (non-flash)
Apr 12 11:00:21 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 11:00:21 user nova-compute[71557]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d (non-flash)
Apr 12 11:00:21 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG nova.compute.manager [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ac4e2c-b9be-4b8b-978e-5fb48d19f696]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb, portal: 172.16.0.220,3260]
Apr 12 11:00:21 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb, portal: 172.16.0.220,3260] successful.
Apr 12 11:00:21 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d641b73-6310-4982-93a3-7395e8cdb1cd]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG nova.compute.manager [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG nova.network.neutron [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 11:00:21 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[49950b9c-cb87-409a-b419-f77d09abc498]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 11:00:21 user nova-compute[71557]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d (non-flash)
Apr 12 11:00:21 user nova-compute[71557]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb (non-flash)
Apr 12 11:00:21 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 11:00:21 user nova-compute[71557]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d (non-flash)
Apr 12 11:00:21 user nova-compute[71557]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb (non-flash)
Apr 12 11:00:21 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG nova.compute.manager [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4cd196-a0e4-418e-9114-0e155ebb15bf]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnEtomdF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 11:00:21 user nova-compute[71557]: DEBUG nova.policy [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aed741675f5944f1882c097c411437f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0f2b52a1a04769803c3a44a924ff00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 11:00:22 user nova-compute[71557]: DEBUG nova.compute.manager [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 11:00:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 11:00:22 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Creating image(s)
Apr 12 11:00:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "/opt/stack/data/nova/instances/eec82dbf-d946-4aca-9320-8fd0c197e1c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:00:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "/opt/stack/data/nova/instances/eec82dbf-d946-4aca-9320-8fd0c197e1c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:00:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "/opt/stack/data/nova/instances/eec82dbf-d946-4aca-9320-8fd0c197e1c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:00:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "da3bfb2df57359597928dc6127eeec424478eccf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:00:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "da3bfb2df57359597928dc6127eeec424478eccf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:00:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3bfb2df57359597928dc6127eeec424478eccf.part --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.533s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:00:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] <== connect_volume: return (1536ms) {'type': 'block', 'scsi_wwn': '23366623133303036', 'path': '/dev/sdd'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:00:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366623133303036', 'path': '/dev/sdd'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 11:00:22 user nova-compute[71557]: DEBUG nova.network.neutron [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Successfully created port: 619a1e09-7376-4439-a5bb-72a26f4865ad {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 11:00:22 user nova-compute[71557]: DEBUG nova.objects.instance [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lazy-loading 'flavor' on Instance uuid ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:00:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 11:00:22 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 11:00:22 user nova-compute[71557]:   <source dev="/dev/sdd"/>
Apr 12 11:00:22 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 11:00:22 user nova-compute[71557]:   <serial>135f653f-dd8f-429b-8d7a-d8830a8d0bfb</serial>
Apr 12 11:00:22 user nova-compute[71557]: </disk>
Apr 12 11:00:22 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3bfb2df57359597928dc6127eeec424478eccf.part --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG nova.virt.images [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 7c91e395-34dd-4893-b9af-62553efd7311 was qcow2, converting to raw {{(pid=71557) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG nova.privsep.utils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71557) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/da3bfb2df57359597928dc6127eeec424478eccf.part /opt/stack/data/nova/instances/_base/da3bfb2df57359597928dc6127eeec424478eccf.converted {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/da3bfb2df57359597928dc6127eeec424478eccf.part /opt/stack/data/nova/instances/_base/da3bfb2df57359597928dc6127eeec424478eccf.converted" returned: 0 in 0.468s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3bfb2df57359597928dc6127eeec424478eccf.converted --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] No VIF found with MAC fa:16:3e:f5:af:c7, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3bfb2df57359597928dc6127eeec424478eccf.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "da3bfb2df57359597928dc6127eeec424478eccf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.547s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3bfb2df57359597928dc6127eeec424478eccf --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-71e688b3-ade5-4c2c-9edf-e9f8e34161c4 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.505s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3bfb2df57359597928dc6127eeec424478eccf --force-share --output=json" returned: 0 in 0.129s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "da3bfb2df57359597928dc6127eeec424478eccf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "da3bfb2df57359597928dc6127eeec424478eccf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3bfb2df57359597928dc6127eeec424478eccf --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG nova.network.neutron [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Successfully updated port: 619a1e09-7376-4439-a5bb-72a26f4865ad {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "refresh_cache-eec82dbf-d946-4aca-9320-8fd0c197e1c0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquired lock "refresh_cache-eec82dbf-d946-4aca-9320-8fd0c197e1c0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG nova.network.neutron [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-b16f6a1f-33f7-493a-a23a-a09b1f655509 req-880006e5-03b5-48a1-b848-9e2bf7560335 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Received event network-changed-619a1e09-7376-4439-a5bb-72a26f4865ad {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-b16f6a1f-33f7-493a-a23a-a09b1f655509 req-880006e5-03b5-48a1-b848-9e2bf7560335 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Refreshing instance network info cache due to event network-changed-619a1e09-7376-4439-a5bb-72a26f4865ad. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 11:00:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b16f6a1f-33f7-493a-a23a-a09b1f655509 req-880006e5-03b5-48a1-b848-9e2bf7560335 service nova] Acquiring lock "refresh_cache-eec82dbf-d946-4aca-9320-8fd0c197e1c0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3bfb2df57359597928dc6127eeec424478eccf --force-share --output=json" returned: 0 in 0.155s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3bfb2df57359597928dc6127eeec424478eccf,backing_fmt=raw /opt/stack/data/nova/instances/eec82dbf-d946-4aca-9320-8fd0c197e1c0/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3bfb2df57359597928dc6127eeec424478eccf,backing_fmt=raw /opt/stack/data/nova/instances/eec82dbf-d946-4aca-9320-8fd0c197e1c0/disk 1073741824" returned: 0 in 0.057s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "da3bfb2df57359597928dc6127eeec424478eccf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3bfb2df57359597928dc6127eeec424478eccf --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3bfb2df57359597928dc6127eeec424478eccf --force-share --output=json" returned: 0 in 0.157s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.objects.instance [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lazy-loading 'migration_context' on Instance uuid eec82dbf-d946-4aca-9320-8fd0c197e1c0 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Ensure instance console log exists: /opt/stack/data/nova/instances/eec82dbf-d946-4aca-9320-8fd0c197e1c0/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.network.neutron [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.objects.instance [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'flavor' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "refresh_cache-2aef35e7-5daf-4d41-b91b-a7ff4a481644" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquired lock "refresh_cache-2aef35e7-5daf-4d41-b91b-a7ff4a481644" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.network.neutron [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.objects.instance [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'info_cache' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.network.neutron [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Updating instance_info_cache with network_info: [{"id": "619a1e09-7376-4439-a5bb-72a26f4865ad", "address": "fa:16:3e:30:0e:e5", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a1e09-73", "ovs_interfaceid": "619a1e09-7376-4439-a5bb-72a26f4865ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Releasing lock "refresh_cache-eec82dbf-d946-4aca-9320-8fd0c197e1c0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Instance network_info: |[{"id": "619a1e09-7376-4439-a5bb-72a26f4865ad", "address": "fa:16:3e:30:0e:e5", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a1e09-73", "ovs_interfaceid": "619a1e09-7376-4439-a5bb-72a26f4865ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b16f6a1f-33f7-493a-a23a-a09b1f655509 req-880006e5-03b5-48a1-b848-9e2bf7560335 service nova] Acquired lock "refresh_cache-eec82dbf-d946-4aca-9320-8fd0c197e1c0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.network.neutron [req-b16f6a1f-33f7-493a-a23a-a09b1f655509 req-880006e5-03b5-48a1-b848-9e2bf7560335 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Refreshing network info cache for port 619a1e09-7376-4439-a5bb-72a26f4865ad {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Start _get_guest_xml network_info=[{"id": "619a1e09-7376-4439-a5bb-72a26f4865ad", "address": "fa:16:3e:30:0e:e5", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a1e09-73", "ovs_interfaceid": "619a1e09-7376-4439-a5bb-72a26f4865ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='7b0a02c89bc4dcd67bfc9b6339fe68d8',container_format='bare',created_at=2023-04-12T11:00:12Z,direct_url=<?>,disk_format='qcow2',id=7c91e395-34dd-4893-b9af-62553efd7311,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-395754952',owner='4a0f2b52a1a04769803c3a44a924ff00',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-12T11:00:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '7c91e395-34dd-4893-b9af-62553efd7311'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 11:00:24 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:00:24 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7b0a02c89bc4dcd67bfc9b6339fe68d8',container_format='bare',created_at=2023-04-12T11:00:12Z,direct_url=<?>,disk_format='qcow2',id=7c91e395-34dd-4893-b9af-62553efd7311,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-395754952',owner='4a0f2b52a1a04769803c3a44a924ff00',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-12T11:00:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T11:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1353198364',display_name='tempest-TestStampPattern-server-1353198364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1353198364',id=45,image_ref='7c91e395-34dd-4893-b9af-62553efd7311',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaPyHRbcEnu+5+do5qHU+1eCHNMIdz7T58VS5Bcnzn0CUjwp6yQ03Ax3lmuZopCNO8dTcA62ZaKwisDZe976PqRTMzRs8Ozd6zeLPjLajysiE4TI0dVucPHR8mu4N+YIQ==',key_name='tempest-TestStampPattern-1731935486',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a0f2b52a1a04769803c3a44a924ff00',ramdisk_id='',reservation_id='r-hl9ae9hm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='faf5e629-c914-43a1-bd73-ce4adfafe9d6',image_min_disk='1',image_min_ram='0',image_owner_id='4a0f2b52a1a04769803c3a44a924ff00',image_owner_project_name='tempest-TestStampPattern-1356820597',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1356820597-project-member',image_user_id='aed741675f5944f1882c097c411437f6',network_allocated='True',owner_project_name='tempest-TestStampPattern-1356820597',owner_user_name='tempest-TestStampPattern-1356820597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T11:00:22Z,user_data=None,user_id='aed741675f5944f1882c097c411437f6',uuid=eec82dbf-d946-4aca-9320-8fd0c197e1c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "619a1e09-7376-4439-a5bb-72a26f4865ad", "address": "fa:16:3e:30:0e:e5", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a1e09-73", "ovs_interfaceid": "619a1e09-7376-4439-a5bb-72a26f4865ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Converting VIF {"id": "619a1e09-7376-4439-a5bb-72a26f4865ad", "address": "fa:16:3e:30:0e:e5", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a1e09-73", "ovs_interfaceid": "619a1e09-7376-4439-a5bb-72a26f4865ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:0e:e5,bridge_name='br-int',has_traffic_filtering=True,id=619a1e09-7376-4439-a5bb-72a26f4865ad,network=Network(b1da98cc-b18c-477c-9e03-df8190b944d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap619a1e09-73') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 11:00:24 user nova-compute[71557]: DEBUG nova.objects.instance [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lazy-loading 'pci_devices' on Instance uuid eec82dbf-d946-4aca-9320-8fd0c197e1c0 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] End _get_guest_xml xml=<domain type="kvm">
Apr 12 11:00:25 user nova-compute[71557]:   <uuid>eec82dbf-d946-4aca-9320-8fd0c197e1c0</uuid>
Apr 12 11:00:25 user nova-compute[71557]:   <name>instance-0000002d</name>
Apr 12 11:00:25 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 11:00:25 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 11:00:25 user nova-compute[71557]:   <metadata>
Apr 12 11:00:25 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 11:00:25 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 11:00:25 user nova-compute[71557]:       <nova:name>tempest-TestStampPattern-server-1353198364</nova:name>
Apr 12 11:00:25 user nova-compute[71557]:       <nova:creationTime>2023-04-12 11:00:24</nova:creationTime>
Apr 12 11:00:25 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 11:00:25 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 11:00:25 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 11:00:25 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 11:00:25 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 11:00:25 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 11:00:25 user nova-compute[71557]:       </nova:flavor>
Apr 12 11:00:25 user nova-compute[71557]:       <nova:owner>
Apr 12 11:00:25 user nova-compute[71557]:         <nova:user uuid="aed741675f5944f1882c097c411437f6">tempest-TestStampPattern-1356820597-project-member</nova:user>
Apr 12 11:00:25 user nova-compute[71557]:         <nova:project uuid="4a0f2b52a1a04769803c3a44a924ff00">tempest-TestStampPattern-1356820597</nova:project>
Apr 12 11:00:25 user nova-compute[71557]:       </nova:owner>
Apr 12 11:00:25 user nova-compute[71557]:       <nova:root type="image" uuid="7c91e395-34dd-4893-b9af-62553efd7311"/>
Apr 12 11:00:25 user nova-compute[71557]:       <nova:ports>
Apr 12 11:00:25 user nova-compute[71557]:         <nova:port uuid="619a1e09-7376-4439-a5bb-72a26f4865ad">
Apr 12 11:00:25 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 11:00:25 user nova-compute[71557]:         </nova:port>
Apr 12 11:00:25 user nova-compute[71557]:       </nova:ports>
Apr 12 11:00:25 user nova-compute[71557]:     </nova:instance>
Apr 12 11:00:25 user nova-compute[71557]:   </metadata>
Apr 12 11:00:25 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 11:00:25 user nova-compute[71557]:     <system>
Apr 12 11:00:25 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 11:00:25 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 11:00:25 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 11:00:25 user nova-compute[71557]:       <entry name="serial">eec82dbf-d946-4aca-9320-8fd0c197e1c0</entry>
Apr 12 11:00:25 user nova-compute[71557]:       <entry name="uuid">eec82dbf-d946-4aca-9320-8fd0c197e1c0</entry>
Apr 12 11:00:25 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 11:00:25 user nova-compute[71557]:     </system>
Apr 12 11:00:25 user nova-compute[71557]:   </sysinfo>
Apr 12 11:00:25 user nova-compute[71557]:   <os>
Apr 12 11:00:25 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 11:00:25 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 11:00:25 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 11:00:25 user nova-compute[71557]:   </os>
Apr 12 11:00:25 user nova-compute[71557]:   <features>
Apr 12 11:00:25 user nova-compute[71557]:     <acpi/>
Apr 12 11:00:25 user nova-compute[71557]:     <apic/>
Apr 12 11:00:25 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 11:00:25 user nova-compute[71557]:   </features>
Apr 12 11:00:25 user nova-compute[71557]:   <clock offset="utc">
Apr 12 11:00:25 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 11:00:25 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 11:00:25 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 11:00:25 user nova-compute[71557]:   </clock>
Apr 12 11:00:25 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 11:00:25 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 11:00:25 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 11:00:25 user nova-compute[71557]:   </cpu>
Apr 12 11:00:25 user nova-compute[71557]:   <devices>
Apr 12 11:00:25 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 11:00:25 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 11:00:25 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/eec82dbf-d946-4aca-9320-8fd0c197e1c0/disk"/>
Apr 12 11:00:25 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 11:00:25 user nova-compute[71557]:     </disk>
Apr 12 11:00:25 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 11:00:25 user nova-compute[71557]:       <mac address="fa:16:3e:30:0e:e5"/>
Apr 12 11:00:25 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 11:00:25 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 11:00:25 user nova-compute[71557]:       <target dev="tap619a1e09-73"/>
Apr 12 11:00:25 user nova-compute[71557]:     </interface>
Apr 12 11:00:25 user nova-compute[71557]:     <serial type="pty">
Apr 12 11:00:25 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/eec82dbf-d946-4aca-9320-8fd0c197e1c0/console.log" append="off"/>
Apr 12 11:00:25 user nova-compute[71557]:     </serial>
Apr 12 11:00:25 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 11:00:25 user nova-compute[71557]:     <video>
Apr 12 11:00:25 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 11:00:25 user nova-compute[71557]:     </video>
Apr 12 11:00:25 user nova-compute[71557]:     <rng model="virtio">
Apr 12 11:00:25 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 11:00:25 user nova-compute[71557]:     </rng>
Apr 12 11:00:25 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 11:00:25 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 11:00:25 user nova-compute[71557]:       <stats period="10"/>
Apr 12 11:00:25 user nova-compute[71557]:     </memballoon>
Apr 12 11:00:25 user nova-compute[71557]:   </devices>
Apr 12 11:00:25 user nova-compute[71557]: </domain>
Apr 12 11:00:25 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T11:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1353198364',display_name='tempest-TestStampPattern-server-1353198364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1353198364',id=45,image_ref='7c91e395-34dd-4893-b9af-62553efd7311',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaPyHRbcEnu+5+do5qHU+1eCHNMIdz7T58VS5Bcnzn0CUjwp6yQ03Ax3lmuZopCNO8dTcA62ZaKwisDZe976PqRTMzRs8Ozd6zeLPjLajysiE4TI0dVucPHR8mu4N+YIQ==',key_name='tempest-TestStampPattern-1731935486',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a0f2b52a1a04769803c3a44a924ff00',ramdisk_id='',reservation_id='r-hl9ae9hm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='faf5e629-c914-43a1-bd73-ce4adfafe9d6',image_min_disk='1',image_min_ram='0',image_owner_id='4a0f2b52a1a04769803c3a44a924ff00',image_owner_project_name='tempest-TestStampPattern-1356820597',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1356820597-project-member',image_user_id='aed741675f5944f1882c097c411437f6',network_allocated='True',owner_project_name='tempest-TestStampPattern-1356820597',owner_user_name='tempest-TestStampPattern-1356820597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T11:00:22Z,user_data=None,user_id='aed741675f5944f1882c097c411437f6',uuid=eec82dbf-d946-4aca-9320-8fd0c197e1c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "619a1e09-7376-4439-a5bb-72a26f4865ad", "address": "fa:16:3e:30:0e:e5", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a1e09-73", "ovs_interfaceid": "619a1e09-7376-4439-a5bb-72a26f4865ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Converting VIF {"id": "619a1e09-7376-4439-a5bb-72a26f4865ad", "address": "fa:16:3e:30:0e:e5", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a1e09-73", "ovs_interfaceid": "619a1e09-7376-4439-a5bb-72a26f4865ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:0e:e5,bridge_name='br-int',has_traffic_filtering=True,id=619a1e09-7376-4439-a5bb-72a26f4865ad,network=Network(b1da98cc-b18c-477c-9e03-df8190b944d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap619a1e09-73') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG os_vif [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:0e:e5,bridge_name='br-int',has_traffic_filtering=True,id=619a1e09-7376-4439-a5bb-72a26f4865ad,network=Network(b1da98cc-b18c-477c-9e03-df8190b944d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap619a1e09-73') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap619a1e09-73, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap619a1e09-73, col_values=(('external_ids', {'iface-id': '619a1e09-7376-4439-a5bb-72a26f4865ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:0e:e5', 'vm-uuid': 'eec82dbf-d946-4aca-9320-8fd0c197e1c0'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:25 user nova-compute[71557]: INFO os_vif [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:0e:e5,bridge_name='br-int',has_traffic_filtering=True,id=619a1e09-7376-4439-a5bb-72a26f4865ad,network=Network(b1da98cc-b18c-477c-9e03-df8190b944d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap619a1e09-73')
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] No VIF found with MAC fa:16:3e:30:0e:e5, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.network.neutron [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Updating instance_info_cache with network_info: [{"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Releasing lock "refresh_cache-2aef35e7-5daf-4d41-b91b-a7ff4a481644" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 11:00:25 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Instance destroyed successfully.
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.objects.instance [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'resources' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:52:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1710761960',display_name='tempest-AttachVolumeTestJSON-server-1710761960',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1710761960',id=38,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQLwZrl3jPnPhohKnRnR2qfd8ly9sETNwW4CsnbJ63gmB7R0QElmNz5jXYfSBpJs0XqGEZmxFm/4XJScQktvDrpb6FHDkQYZ7pSrXVh9P+kxqpboxMoLpeKxHkx0WwNzw==',key_name='tempest-keypair-1222347782',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:52:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9878bfe34ceb4a6695b253ad161c4f7b',ramdisk_id='',reservation_id='r-u8xhdlhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1953237893',owner_user_name='tempest-AttachVolumeTestJSON-1953237893-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:58:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6576467073e41e9b497097d5a8dfd3d',uuid=2aef35e7-5daf-4d41-b91b-a7ff4a481644,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converting VIF {"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=8786a087-f036-403b-9b82-c75fc6dbb110,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8786a087-f0') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG os_vif [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=8786a087-f036-403b-9b82-c75fc6dbb110,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8786a087-f0') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8786a087-f0, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:25 user nova-compute[71557]: INFO os_vif [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=8786a087-f036-403b-9b82-c75fc6dbb110,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8786a087-f0')
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Start _get_guest_xml network_info=[{"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.objects.instance [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'numa_topology' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:00:25 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:00:25 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.objects.instance [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:52:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1710761960',display_name='tempest-AttachVolumeTestJSON-server-1710761960',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1710761960',id=38,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQLwZrl3jPnPhohKnRnR2qfd8ly9sETNwW4CsnbJ63gmB7R0QElmNz5jXYfSBpJs0XqGEZmxFm/4XJScQktvDrpb6FHDkQYZ7pSrXVh9P+kxqpboxMoLpeKxHkx0WwNzw==',key_name='tempest-keypair-1222347782',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:52:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9878bfe34ceb4a6695b253ad161c4f7b',ramdisk_id='',reservation_id='r-u8xhdlhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1953237893',owner_user_name='tempest-AttachVolumeTestJSON-1953237893-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:58:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6576467073e41e9b497097d5a8dfd3d',uuid=2aef35e7-5daf-4d41-b91b-a7ff4a481644,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converting VIF {"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=8786a087-f036-403b-9b82-c75fc6dbb110,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8786a087-f0') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.objects.instance [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'pci_devices' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] End _get_guest_xml xml=<domain type="kvm">
Apr 12 11:00:25 user nova-compute[71557]:   <uuid>2aef35e7-5daf-4d41-b91b-a7ff4a481644</uuid>
Apr 12 11:00:25 user nova-compute[71557]:   <name>instance-00000026</name>
Apr 12 11:00:25 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 11:00:25 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 11:00:25 user nova-compute[71557]:   <metadata>
Apr 12 11:00:25 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 11:00:25 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 11:00:25 user nova-compute[71557]:       <nova:name>tempest-AttachVolumeTestJSON-server-1710761960</nova:name>
Apr 12 11:00:25 user nova-compute[71557]:       <nova:creationTime>2023-04-12 11:00:25</nova:creationTime>
Apr 12 11:00:25 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 11:00:25 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 11:00:25 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 11:00:25 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 11:00:25 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 11:00:25 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 11:00:25 user nova-compute[71557]:       </nova:flavor>
Apr 12 11:00:25 user nova-compute[71557]:       <nova:owner>
Apr 12 11:00:25 user nova-compute[71557]:         <nova:user uuid="f6576467073e41e9b497097d5a8dfd3d">tempest-AttachVolumeTestJSON-1953237893-project-member</nova:user>
Apr 12 11:00:25 user nova-compute[71557]:         <nova:project uuid="9878bfe34ceb4a6695b253ad161c4f7b">tempest-AttachVolumeTestJSON-1953237893</nova:project>
Apr 12 11:00:25 user nova-compute[71557]:       </nova:owner>
Apr 12 11:00:25 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 11:00:25 user nova-compute[71557]:       <nova:ports>
Apr 12 11:00:25 user nova-compute[71557]:         <nova:port uuid="8786a087-f036-403b-9b82-c75fc6dbb110">
Apr 12 11:00:25 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 11:00:25 user nova-compute[71557]:         </nova:port>
Apr 12 11:00:25 user nova-compute[71557]:       </nova:ports>
Apr 12 11:00:25 user nova-compute[71557]:     </nova:instance>
Apr 12 11:00:25 user nova-compute[71557]:   </metadata>
Apr 12 11:00:25 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 11:00:25 user nova-compute[71557]:     <system>
Apr 12 11:00:25 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 11:00:25 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 11:00:25 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 11:00:25 user nova-compute[71557]:       <entry name="serial">2aef35e7-5daf-4d41-b91b-a7ff4a481644</entry>
Apr 12 11:00:25 user nova-compute[71557]:       <entry name="uuid">2aef35e7-5daf-4d41-b91b-a7ff4a481644</entry>
Apr 12 11:00:25 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 11:00:25 user nova-compute[71557]:     </system>
Apr 12 11:00:25 user nova-compute[71557]:   </sysinfo>
Apr 12 11:00:25 user nova-compute[71557]:   <os>
Apr 12 11:00:25 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 11:00:25 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 11:00:25 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 11:00:25 user nova-compute[71557]:   </os>
Apr 12 11:00:25 user nova-compute[71557]:   <features>
Apr 12 11:00:25 user nova-compute[71557]:     <acpi/>
Apr 12 11:00:25 user nova-compute[71557]:     <apic/>
Apr 12 11:00:25 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 11:00:25 user nova-compute[71557]:   </features>
Apr 12 11:00:25 user nova-compute[71557]:   <clock offset="utc">
Apr 12 11:00:25 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 11:00:25 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 11:00:25 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 11:00:25 user nova-compute[71557]:   </clock>
Apr 12 11:00:25 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 11:00:25 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 11:00:25 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 11:00:25 user nova-compute[71557]:   </cpu>
Apr 12 11:00:25 user nova-compute[71557]:   <devices>
Apr 12 11:00:25 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 11:00:25 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 11:00:25 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk"/>
Apr 12 11:00:25 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 11:00:25 user nova-compute[71557]:     </disk>
Apr 12 11:00:25 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 11:00:25 user nova-compute[71557]:       <mac address="fa:16:3e:59:45:ef"/>
Apr 12 11:00:25 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 11:00:25 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 11:00:25 user nova-compute[71557]:       <target dev="tap8786a087-f0"/>
Apr 12 11:00:25 user nova-compute[71557]:     </interface>
Apr 12 11:00:25 user nova-compute[71557]:     <serial type="pty">
Apr 12 11:00:25 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/console.log" append="off"/>
Apr 12 11:00:25 user nova-compute[71557]:     </serial>
Apr 12 11:00:25 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 11:00:25 user nova-compute[71557]:     <video>
Apr 12 11:00:25 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 11:00:25 user nova-compute[71557]:     </video>
Apr 12 11:00:25 user nova-compute[71557]:     <rng model="virtio">
Apr 12 11:00:25 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 11:00:25 user nova-compute[71557]:     </rng>
Apr 12 11:00:25 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 11:00:25 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 11:00:25 user nova-compute[71557]:       <stats period="10"/>
Apr 12 11:00:25 user nova-compute[71557]:     </memballoon>
Apr 12 11:00:25 user nova-compute[71557]:   </devices>
Apr 12 11:00:25 user nova-compute[71557]: </domain>
Apr 12 11:00:25 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.network.neutron [req-b16f6a1f-33f7-493a-a23a-a09b1f655509 req-880006e5-03b5-48a1-b848-9e2bf7560335 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Updated VIF entry in instance network info cache for port 619a1e09-7376-4439-a5bb-72a26f4865ad. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.network.neutron [req-b16f6a1f-33f7-493a-a23a-a09b1f655509 req-880006e5-03b5-48a1-b848-9e2bf7560335 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Updating instance_info_cache with network_info: [{"id": "619a1e09-7376-4439-a5bb-72a26f4865ad", "address": "fa:16:3e:30:0e:e5", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a1e09-73", "ovs_interfaceid": "619a1e09-7376-4439-a5bb-72a26f4865ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-b16f6a1f-33f7-493a-a23a-a09b1f655509 req-880006e5-03b5-48a1-b848-9e2bf7560335 service nova] Releasing lock "refresh_cache-eec82dbf-d946-4aca-9320-8fd0c197e1c0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG nova.objects.instance [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:00:25 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.168s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:26 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 11:00:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:26 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Cannot resize image /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 11:00:26 user nova-compute[71557]: DEBUG nova.objects.instance [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'migration_context' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:00:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:52:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1710761960',display_name='tempest-AttachVolumeTestJSON-server-1710761960',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1710761960',id=38,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQLwZrl3jPnPhohKnRnR2qfd8ly9sETNwW4CsnbJ63gmB7R0QElmNz5jXYfSBpJs0XqGEZmxFm/4XJScQktvDrpb6FHDkQYZ7pSrXVh9P+kxqpboxMoLpeKxHkx0WwNzw==',key_name='tempest-keypair-1222347782',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:52:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='9878bfe34ceb4a6695b253ad161c4f7b',ramdisk_id='',reservation_id='r-u8xhdlhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1953237893',owner_user_name='tempest-AttachVolumeTestJSON-1953237893-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T10:58:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6576467073e41e9b497097d5a8dfd3d',uuid=2aef35e7-5daf-4d41-b91b-a7ff4a481644,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 11:00:26 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converting VIF {"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 11:00:26 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=8786a087-f036-403b-9b82-c75fc6dbb110,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8786a087-f0') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 11:00:26 user nova-compute[71557]: DEBUG os_vif [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=8786a087-f036-403b-9b82-c75fc6dbb110,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8786a087-f0') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 11:00:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 11:00:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 11:00:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8786a087-f0, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 11:00:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8786a087-f0, col_values=(('external_ids', {'iface-id': '8786a087-f036-403b-9b82-c75fc6dbb110', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:45:ef', 'vm-uuid': '2aef35e7-5daf-4d41-b91b-a7ff4a481644'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 11:00:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:00:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:26 user nova-compute[71557]: INFO os_vif [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=8786a087-f036-403b-9b82-c75fc6dbb110,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8786a087-f0')
Apr 12 11:00:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:27 user nova-compute[71557]: DEBUG nova.compute.manager [req-0af2c90e-2c69-4811-934c-f245e9623ba4 req-4e65dc7b-b10f-46d7-bf56-4c28c106c357 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Received event network-vif-plugged-619a1e09-7376-4439-a5bb-72a26f4865ad {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:00:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0af2c90e-2c69-4811-934c-f245e9623ba4 req-4e65dc7b-b10f-46d7-bf56-4c28c106c357 service nova] Acquiring lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:00:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0af2c90e-2c69-4811-934c-f245e9623ba4 req-4e65dc7b-b10f-46d7-bf56-4c28c106c357 service nova] Lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:00:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0af2c90e-2c69-4811-934c-f245e9623ba4 req-4e65dc7b-b10f-46d7-bf56-4c28c106c357 service nova] Lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:00:27 user nova-compute[71557]: DEBUG nova.compute.manager [req-0af2c90e-2c69-4811-934c-f245e9623ba4 req-4e65dc7b-b10f-46d7-bf56-4c28c106c357 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] No waiting events found dispatching network-vif-plugged-619a1e09-7376-4439-a5bb-72a26f4865ad {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:00:27 user nova-compute[71557]: WARNING nova.compute.manager [req-0af2c90e-2c69-4811-934c-f245e9623ba4 req-4e65dc7b-b10f-46d7-bf56-4c28c106c357 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Received unexpected event network-vif-plugged-619a1e09-7376-4439-a5bb-72a26f4865ad for instance with vm_state building and task_state spawning.
Apr 12 11:00:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:28 user nova-compute[71557]: DEBUG nova.compute.manager [req-38b62fb1-8d6c-464b-b7e2-9d80b0072259 req-55d1149f-bdb2-4670-9bc7-ebe40e8c09ed service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received event network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:00:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-38b62fb1-8d6c-464b-b7e2-9d80b0072259 req-55d1149f-bdb2-4670-9bc7-ebe40e8c09ed service nova] Acquiring lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:00:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-38b62fb1-8d6c-464b-b7e2-9d80b0072259 req-55d1149f-bdb2-4670-9bc7-ebe40e8c09ed service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:00:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-38b62fb1-8d6c-464b-b7e2-9d80b0072259 req-55d1149f-bdb2-4670-9bc7-ebe40e8c09ed service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:00:28 user nova-compute[71557]: DEBUG nova.compute.manager [req-38b62fb1-8d6c-464b-b7e2-9d80b0072259 req-55d1149f-bdb2-4670-9bc7-ebe40e8c09ed service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] No waiting events found dispatching network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:00:28 user nova-compute[71557]: WARNING nova.compute.manager [req-38b62fb1-8d6c-464b-b7e2-9d80b0072259 req-55d1149f-bdb2-4670-9bc7-ebe40e8c09ed service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received unexpected event network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 for instance with vm_state stopped and task_state powering-on.
Apr 12 11:00:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:29 user nova-compute[71557]: DEBUG nova.compute.manager [req-7f9e6524-14e5-436b-9b06-70608056b6da req-22388cd0-6df0-4be1-9847-df9e963191b1 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Received event network-vif-plugged-619a1e09-7376-4439-a5bb-72a26f4865ad {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:00:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7f9e6524-14e5-436b-9b06-70608056b6da req-22388cd0-6df0-4be1-9847-df9e963191b1 service nova] Acquiring lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:00:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7f9e6524-14e5-436b-9b06-70608056b6da req-22388cd0-6df0-4be1-9847-df9e963191b1 service nova] Lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:00:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7f9e6524-14e5-436b-9b06-70608056b6da req-22388cd0-6df0-4be1-9847-df9e963191b1 service nova] Lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:00:29 user nova-compute[71557]: DEBUG nova.compute.manager [req-7f9e6524-14e5-436b-9b06-70608056b6da req-22388cd0-6df0-4be1-9847-df9e963191b1 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] No waiting events found dispatching network-vif-plugged-619a1e09-7376-4439-a5bb-72a26f4865ad {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:00:29 user nova-compute[71557]: WARNING nova.compute.manager [req-7f9e6524-14e5-436b-9b06-70608056b6da req-22388cd0-6df0-4be1-9847-df9e963191b1 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Received unexpected event network-vif-plugged-619a1e09-7376-4439-a5bb-72a26f4865ad for instance with vm_state building and task_state spawning.
Apr 12 11:00:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 11:00:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 11:00:30 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681297230.2950583, eec82dbf-d946-4aca-9320-8fd0c197e1c0 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 11:00:30 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] VM Resumed (Lifecycle Event)
Apr 12 11:00:30 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Instance spawned successfully.
Apr 12 11:00:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 11:00:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 11:00:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 11:00:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 11:00:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 11:00:30 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 11:00:30 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681297230.2952123, eec82dbf-d946-4aca-9320-8fd0c197e1c0 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 11:00:30 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] VM Started (Lifecycle Event)
Apr 12 11:00:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 11:00:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 11:00:30 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 11:00:30 user nova-compute[71557]: INFO nova.compute.manager [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Took 8.38 seconds to spawn the instance on the hypervisor.
Apr 12 11:00:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 11:00:30 user nova-compute[71557]: INFO nova.compute.manager [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Took 9.40 seconds to build instance.
Apr 12 11:00:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b1823f40-bbda-4cde-b12c-1751dcb7a288 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.494s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:00:30 user nova-compute[71557]: DEBUG nova.compute.manager [req-d19e249e-9a88-48b7-923c-b75fb34b386c req-c046b93a-805a-4502-a671-3d04ddac08c5 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received event network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:00:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d19e249e-9a88-48b7-923c-b75fb34b386c req-c046b93a-805a-4502-a671-3d04ddac08c5 service nova] Acquiring lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:00:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d19e249e-9a88-48b7-923c-b75fb34b386c req-c046b93a-805a-4502-a671-3d04ddac08c5 service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:00:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d19e249e-9a88-48b7-923c-b75fb34b386c req-c046b93a-805a-4502-a671-3d04ddac08c5 service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:00:30 user nova-compute[71557]: DEBUG nova.compute.manager [req-d19e249e-9a88-48b7-923c-b75fb34b386c req-c046b93a-805a-4502-a671-3d04ddac08c5 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] No waiting events found dispatching network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:00:30 user nova-compute[71557]: WARNING nova.compute.manager [req-d19e249e-9a88-48b7-923c-b75fb34b386c req-c046b93a-805a-4502-a671-3d04ddac08c5 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received unexpected event network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 for instance with vm_state stopped and task_state powering-on.
Apr 12 11:00:30 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681297230.759149, 2aef35e7-5daf-4d41-b91b-a7ff4a481644 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 11:00:30 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] VM Resumed (Lifecycle Event)
Apr 12 11:00:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 11:00:30 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Instance rebooted successfully.
Apr 12 11:00:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-06ad124c-6cff-4a2e-879e-034e1414924a tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 11:00:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 11:00:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 11:00:30 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 12 11:00:30 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681297230.761883, 2aef35e7-5daf-4d41-b91b-a7ff4a481644 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 11:00:30 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] VM Started (Lifecycle Event)
Apr 12 11:00:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 11:00:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 11:00:31 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:00:34 user nova-compute[71557]: INFO nova.compute.manager [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Detaching volume 135f653f-dd8f-429b-8d7a-d8830a8d0bfb
Apr 12 11:00:34 user nova-compute[71557]: INFO nova.virt.block_device [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Attempting to driver detach volume 135f653f-dd8f-429b-8d7a-d8830a8d0bfb from mountpoint /dev/vdb
Apr 12 11:00:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Attempting to detach device vdb from instance ca545a0c-89fd-4a04-9d87-c2698051ca87 from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 11:00:34 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 11:00:34 user nova-compute[71557]:   <source dev="/dev/sdd"/>
Apr 12 11:00:34 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 11:00:34 user nova-compute[71557]:   <serial>135f653f-dd8f-429b-8d7a-d8830a8d0bfb</serial>
Apr 12 11:00:34 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 11:00:34 user nova-compute[71557]: </disk>
Apr 12 11:00:34 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 11:00:34 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Successfully detached device vdb from instance ca545a0c-89fd-4a04-9d87-c2698051ca87 from the persistent domain config.
Apr 12 11:00:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ca545a0c-89fd-4a04-9d87-c2698051ca87 from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 11:00:34 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 11:00:34 user nova-compute[71557]:   <source dev="/dev/sdd"/>
Apr 12 11:00:34 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 11:00:34 user nova-compute[71557]:   <serial>135f653f-dd8f-429b-8d7a-d8830a8d0bfb</serial>
Apr 12 11:00:34 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 11:00:34 user nova-compute[71557]: </disk>
Apr 12 11:00:34 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681297234.6273031, ca545a0c-89fd-4a04-9d87-c2698051ca87 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 11:00:34 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Successfully detached device vdb from instance ca545a0c-89fd-4a04-9d87-c2698051ca87 from the live domain config.
Apr 12 11:00:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnEtomdF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:00:34 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:00:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4759e99-26c5-4e6d-9239-20483217feb6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 11:00:34 user nova-compute[71557]: No targets found.
Apr 12 11:00:34 user nova-compute[71557]: iSNS:
Apr 12 11:00:34 user nova-compute[71557]: No targets found.
Apr 12 11:00:34 user nova-compute[71557]: STATIC:
Apr 12 11:00:34 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d
Apr 12 11:00:34 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 11:00:34 user nova-compute[71557]:                 Iface Name: default
Apr 12 11:00:34 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb
Apr 12 11:00:34 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 11:00:34 user nova-compute[71557]:                 Iface Name: default
Apr 12 11:00:34 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9
Apr 12 11:00:34 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 11:00:34 user nova-compute[71557]:                 Iface Name: default
Apr 12 11:00:34 user nova-compute[71557]: FIRMWARE:
Apr 12 11:00:34 user nova-compute[71557]: No targets found.
Apr 12 11:00:34 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 11:00:34 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 11:00:34 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd299afe-9f7b-4cbe-95db-2fc3432e3002]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[538ff687-e968-4c42-a787-5c59e7245011]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 11:00:34 user nova-compute[71557]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d (non-flash)
Apr 12 11:00:34 user nova-compute[71557]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb (non-flash)
Apr 12 11:00:34 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 11:00:34 user nova-compute[71557]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d (non-flash)
Apr 12 11:00:34 user nova-compute[71557]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb (non-flash)
Apr 12 11:00:34 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fc4134f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb'): ({'sdd'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Removing single pathed devices sdd {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8913c09a-a656-4636-88c7-3a8f9a38e952]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9003c550-946b-4733-8df0-b75c37a10159]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Flushing IO for device /dev/sdd {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb45a827-3011-4336-b31f-8b02b7ae32f9]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbff073a-6ab5-4737-bc06-3bfaf91a3e5c]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] SCSI volumes sdd have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ffeaff-a7f2-453f-a86e-31a665e61e89]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eea4beb-191b-427a-bc5f-228fdbbc6aa9]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb, portal: 172.16.0.220,3260]
Apr 12 11:00:34 user nova-compute[71557]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb, portal: 172.16.0.220,3260] successful.
Apr 12 11:00:34 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:135f653f-dd8f-429b-8d7a-d8830a8d0bfb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[088b4738-55f3-4c5e-aeae-fbc7704288fe]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] <== disconnect_volume: return (331ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:00:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 11:00:35 user nova-compute[71557]: DEBUG nova.objects.instance [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lazy-loading 'flavor' on Instance uuid ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:00:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-26c342a9-421e-4567-be4d-9dca93be9ed3 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.898s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:00:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:36 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:00:38 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:00:38 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 11:00:38 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Rebuilding the list of instances to heal {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 11:00:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-2aef35e7-5daf-4d41-b91b-a7ff4a481644" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 11:00:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-2aef35e7-5daf-4d41-b91b-a7ff4a481644" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 11:00:38 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 11:00:38 user nova-compute[71557]: DEBUG nova.objects.instance [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lazy-loading 'info_cache' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:00:39 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Updating instance_info_cache with network_info: [{"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:00:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-2aef35e7-5daf-4d41-b91b-a7ff4a481644" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 11:00:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 11:00:39 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:00:39 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:00:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:00:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:00:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:00:39 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 11:00:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:39 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 11:00:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 11:00:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec82dbf-d946-4aca-9320-8fd0c197e1c0/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec82dbf-d946-4aca-9320-8fd0c197e1c0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec82dbf-d946-4aca-9320-8fd0c197e1c0/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:00:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec82dbf-d946-4aca-9320-8fd0c197e1c0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:00:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:41 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:00:41 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:00:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=8059MB free_disk=26.08574676513672GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 11:00:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:00:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:00:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 11:00:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 11:00:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 11:00:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance ca545a0c-89fd-4a04-9d87-c2698051ca87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 11:00:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 948c893b-1292-4b9a-8c77-0e23c94387ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 11:00:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance eec82dbf-d946-4aca-9320-8fd0c197e1c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 11:00:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 11:00:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 11:00:41 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 11:00:41 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 11:00:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 11:00:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.420s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:00:42 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:00:42 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:00:42 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:00:44 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:00:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:51 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:56 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:00:56 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:56 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:00:56 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:00:56 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:00:56 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:00:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:01:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:01:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:01:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:01:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:01:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:01:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:18 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:24 user nova-compute[71557]: DEBUG nova.compute.manager [req-31b98e25-586f-485c-989b-d5c0e43db849 req-59faeff1-00da-4067-bfd8-2165d1ccc85c service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Received event network-changed-7c976cd8-54d9-4233-be62-1cecf9cc63c6 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:01:24 user nova-compute[71557]: DEBUG nova.compute.manager [req-31b98e25-586f-485c-989b-d5c0e43db849 req-59faeff1-00da-4067-bfd8-2165d1ccc85c service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Refreshing instance network info cache due to event network-changed-7c976cd8-54d9-4233-be62-1cecf9cc63c6. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 11:01:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-31b98e25-586f-485c-989b-d5c0e43db849 req-59faeff1-00da-4067-bfd8-2165d1ccc85c service nova] Acquiring lock "refresh_cache-948c893b-1292-4b9a-8c77-0e23c94387ae" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 11:01:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-31b98e25-586f-485c-989b-d5c0e43db849 req-59faeff1-00da-4067-bfd8-2165d1ccc85c service nova] Acquired lock "refresh_cache-948c893b-1292-4b9a-8c77-0e23c94387ae" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 11:01:24 user nova-compute[71557]: DEBUG nova.network.neutron [req-31b98e25-586f-485c-989b-d5c0e43db849 req-59faeff1-00da-4067-bfd8-2165d1ccc85c service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Refreshing network info cache for port 7c976cd8-54d9-4233-be62-1cecf9cc63c6 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 11:01:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:24 user nova-compute[71557]: DEBUG nova.network.neutron [req-31b98e25-586f-485c-989b-d5c0e43db849 req-59faeff1-00da-4067-bfd8-2165d1ccc85c service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Updated VIF entry in instance network info cache for port 7c976cd8-54d9-4233-be62-1cecf9cc63c6. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 11:01:24 user nova-compute[71557]: DEBUG nova.network.neutron [req-31b98e25-586f-485c-989b-d5c0e43db849 req-59faeff1-00da-4067-bfd8-2165d1ccc85c service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Updating instance_info_cache with network_info: [{"id": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "address": "fa:16:3e:93:c3:a8", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c976cd8-54", "ovs_interfaceid": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:01:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-31b98e25-586f-485c-989b-d5c0e43db849 req-59faeff1-00da-4067-bfd8-2165d1ccc85c service nova] Releasing lock "refresh_cache-948c893b-1292-4b9a-8c77-0e23c94387ae" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 11:01:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "948c893b-1292-4b9a-8c77-0e23c94387ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:01:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "948c893b-1292-4b9a-8c77-0e23c94387ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:01:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "948c893b-1292-4b9a-8c77-0e23c94387ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:01:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "948c893b-1292-4b9a-8c77-0e23c94387ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:01:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "948c893b-1292-4b9a-8c77-0e23c94387ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:01:25 user nova-compute[71557]: INFO nova.compute.manager [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Terminating instance
Apr 12 11:01:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 11:01:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:26 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Instance destroyed successfully.
Apr 12 11:01:26 user nova-compute[71557]: DEBUG nova.objects.instance [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lazy-loading 'resources' on Instance uuid 948c893b-1292-4b9a-8c77-0e23c94387ae {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1577337770',display_name='tempest-TestVolumeBootPattern-server-1577337770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1577337770',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeNYUbBfSwdaJdVL2RMsgRRuPmOdMNSAwl/DHzaeVhE0fDjZe84+pAYZqsgenmNqm/u0yGuL1KeKxxwsT2FNR2LdwQFC7iIcZOaTovpAXdmD/5wx/0lhCQf7gPsmZ5xfg==',key_name='tempest-TestVolumeBootPattern-162796269',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:59:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a67f3d23b8f74a9496d445c7fc75717e',ramdisk_id='',reservation_id='r-l1it6cib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-638607559',owner_user_name='tempest-TestVolumeBootPattern-638607559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:59:43Z,user_data=None,user_id='b914d7ca786f455baf120f98816abffd',uuid=948c893b-1292-4b9a-8c77-0e23c94387ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "address": "fa:16:3e:93:c3:a8", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c976cd8-54", "ovs_interfaceid": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converting VIF {"id": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "address": "fa:16:3e:93:c3:a8", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c976cd8-54", "ovs_interfaceid": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:c3:a8,bridge_name='br-int',has_traffic_filtering=True,id=7c976cd8-54d9-4233-be62-1cecf9cc63c6,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c976cd8-54') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG os_vif [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:c3:a8,bridge_name='br-int',has_traffic_filtering=True,id=7c976cd8-54d9-4233-be62-1cecf9cc63c6,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c976cd8-54') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c976cd8-54, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:01:26 user nova-compute[71557]: INFO os_vif [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:c3:a8,bridge_name='br-int',has_traffic_filtering=True,id=7c976cd8-54d9-4233-be62-1cecf9cc63c6,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c976cd8-54')
Apr 12 11:01:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OSMsbAGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:01:26 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:01:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c257ff37-847b-4f7b-a86d-f23ee9ab12f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 11:01:26 user nova-compute[71557]: No targets found.
Apr 12 11:01:26 user nova-compute[71557]: iSNS:
Apr 12 11:01:26 user nova-compute[71557]: No targets found.
Apr 12 11:01:26 user nova-compute[71557]: STATIC:
Apr 12 11:01:26 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d
Apr 12 11:01:26 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 11:01:26 user nova-compute[71557]:                 Iface Name: default
Apr 12 11:01:26 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9
Apr 12 11:01:26 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 11:01:26 user nova-compute[71557]:                 Iface Name: default
Apr 12 11:01:26 user nova-compute[71557]: FIRMWARE:
Apr 12 11:01:26 user nova-compute[71557]: No targets found.
Apr 12 11:01:26 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 11:01:26 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 11:01:26 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e8dd58-bf13-4f98-813c-0c7986d74cd2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4037a0-3b1e-4254-acaa-8c906867eded]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 11:01:26 user nova-compute[71557]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d (non-flash)
Apr 12 11:01:26 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 11:01:26 user nova-compute[71557]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d (non-flash)
Apr 12 11:01:26 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd448cb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d'): ({'sdb'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Removing single pathed devices sdb {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd9df8c-5ba1-4009-9539-e1d637dcdabc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[204ce331-7835-4b64-80af-81533d4bd8c6]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flushing IO for device /dev/sdb {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG nova.compute.manager [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Received event network-changed-7c976cd8-54d9-4233-be62-1cecf9cc63c6 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG nova.compute.manager [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Refreshing instance network info cache due to event network-changed-7c976cd8-54d9-4233-be62-1cecf9cc63c6. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] Acquiring lock "refresh_cache-948c893b-1292-4b9a-8c77-0e23c94387ae" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] Acquired lock "refresh_cache-948c893b-1292-4b9a-8c77-0e23c94387ae" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG nova.network.neutron [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Refreshing network info cache for port 7c976cd8-54d9-4233-be62-1cecf9cc63c6 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[985d270d-89a5-4e8d-8b07-15e72d576dd9]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2231319-3d77-4e55-814b-5151fd52e936]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4001350-af33-44b9-98fa-460ae28b19ed]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4e7ded-79a6-4b2f-91dd-7dfb0fda3076]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d, portal: 172.16.0.220,3260]
Apr 12 11:01:26 user nova-compute[71557]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d, portal: 172.16.0.220,3260] successful.
Apr 12 11:01:26 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e779651-b7b5-4fa7-8451-d72ec750c44d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e36862-628c-4a59-a22c-7fe5d6e235ce]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] <== disconnect_volume: return (381ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 11:01:26 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Deleting instance files /opt/stack/data/nova/instances/948c893b-1292-4b9a-8c77-0e23c94387ae_del
Apr 12 11:01:26 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Deletion of /opt/stack/data/nova/instances/948c893b-1292-4b9a-8c77-0e23c94387ae_del complete
Apr 12 11:01:26 user nova-compute[71557]: INFO nova.compute.manager [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Took 1.36 seconds to destroy the instance on the hypervisor.
Apr 12 11:01:26 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG nova.network.neutron [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Updated VIF entry in instance network info cache for port 7c976cd8-54d9-4233-be62-1cecf9cc63c6. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 11:01:26 user nova-compute[71557]: DEBUG nova.network.neutron [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Updating instance_info_cache with network_info: [{"id": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "address": "fa:16:3e:93:c3:a8", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c976cd8-54", "ovs_interfaceid": "7c976cd8-54d9-4233-be62-1cecf9cc63c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] Releasing lock "refresh_cache-948c893b-1292-4b9a-8c77-0e23c94387ae" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG nova.compute.manager [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Received event network-vif-unplugged-7c976cd8-54d9-4233-be62-1cecf9cc63c6 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] Acquiring lock "948c893b-1292-4b9a-8c77-0e23c94387ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] Lock "948c893b-1292-4b9a-8c77-0e23c94387ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] Lock "948c893b-1292-4b9a-8c77-0e23c94387ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG nova.compute.manager [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] No waiting events found dispatching network-vif-unplugged-7c976cd8-54d9-4233-be62-1cecf9cc63c6 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG nova.compute.manager [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Received event network-vif-unplugged-7c976cd8-54d9-4233-be62-1cecf9cc63c6 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG nova.compute.manager [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Received event network-vif-plugged-7c976cd8-54d9-4233-be62-1cecf9cc63c6 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] Acquiring lock "948c893b-1292-4b9a-8c77-0e23c94387ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] Lock "948c893b-1292-4b9a-8c77-0e23c94387ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] Lock "948c893b-1292-4b9a-8c77-0e23c94387ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG nova.compute.manager [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] No waiting events found dispatching network-vif-plugged-7c976cd8-54d9-4233-be62-1cecf9cc63c6 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:01:27 user nova-compute[71557]: WARNING nova.compute.manager [req-d952bdc1-5779-4018-96ba-1cbe6c80acb8 req-9c4ea77e-fc6a-4700-a708-992a5b173880 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Received unexpected event network-vif-plugged-7c976cd8-54d9-4233-be62-1cecf9cc63c6 for instance with vm_state active and task_state deleting.
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG nova.objects.instance [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lazy-loading 'flavor' on Instance uuid ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:01:27 user nova-compute[71557]: INFO nova.compute.manager [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Attaching volume 21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 to /dev/vdb
Apr 12 11:01:27 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Took 0.52 seconds to deallocate network for instance.
Apr 12 11:01:27 user nova-compute[71557]: DEBUG nova.compute.manager [req-9ba893c1-fd16-45d5-a7a3-4d45ce30751d req-678282ac-6f57-4e04-a2ed-f90452a14288 service nova] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Received event network-vif-deleted-7c976cd8-54d9-4233-be62-1cecf9cc63c6 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG os_brick.utils [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07f9b52-c3aa-415f-bcb3-797c59c1c98c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e49cb18-d4cd-4d9b-97d2-6ce3404600df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3468422-c252-4977-a933-a56a4d71834d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb54055-085f-46c2-b1c2-786ec691b8d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 11:01:27 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 11:01:27 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8277e9a-d0ff-4c78-b689-4add69edb8a4]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG os_brick.utils [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:01:27 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Updating existing volume attachment record: 19c76b5b-ec57-4abb-86df-72ded0c0d6d4 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 11:01:28 user nova-compute[71557]: INFO nova.compute.manager [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Took 0.74 seconds to detach 1 volumes for instance.
Apr 12 11:01:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:01:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:01:28 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 11:01:28 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 11:01:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:01:28 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Deleted allocations for instance 948c893b-1292-4b9a-8c77-0e23c94387ae
Apr 12 11:01:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f9a28b56-d54d-4c6b-afe2-7f728080170c tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "948c893b-1292-4b9a-8c77-0e23c94387ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.061s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:01:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:31 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zvSbuWwh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:01:32 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:01:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:01:32 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:01:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:01:32 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[132dcd21-8e5f-45be-a0c4-ed86142b7d9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 11:01:32 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8878b7-fc83-45b0-9eb6-c6d0f1351fe0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7] added
Apr 12 11:01:32 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[713f5fef-d256-4d04-9d60-f382d1f31031]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ceab07-1ed4-47c7-ab9f-3df9acc99599]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zvSbuWwh {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zvSbuWwh" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[002025f4-7ef9-4c04-b81b-f9efb2187384]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zvSbuWwh'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aeaaf08-a36b-4c00-b4cf-6b549153fd75]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac9519e-4246-42da-bf61-a8cc5705a216]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 11:01:32 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 11:01:32 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0511bc98-caad-4b25-8a78-a5f1c54b1e34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7, portal: 172.16.0.220,3260]
Apr 12 11:01:32 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7, portal: 172.16.0.220,3260] successful.
Apr 12 11:01:32 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4ef401-7c8e-4feb-b8d8-171de25345d3]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1d0475-2a4a-42b3-9869-3a96f25b5254]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 11:01:32 user nova-compute[71557]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 (non-flash)
Apr 12 11:01:32 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 11:01:32 user nova-compute[71557]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 (non-flash)
Apr 12 11:01:32 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5ae2ef-30d1-44f3-a79c-8f54ae60e5a3]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:32 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 11:01:33 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:01:33 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 11:01:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zvSbuWwh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 11:01:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:01:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26462663261303130', 'path': '/dev/sdb'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:01:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462663261303130', 'path': '/dev/sdb'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 11:01:33 user nova-compute[71557]: DEBUG nova.objects.instance [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lazy-loading 'flavor' on Instance uuid ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:01:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 11:01:33 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 11:01:33 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 11:01:33 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 11:01:33 user nova-compute[71557]:   <serial>21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7</serial>
Apr 12 11:01:33 user nova-compute[71557]: </disk>
Apr 12 11:01:33 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 11:01:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 11:01:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 11:01:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] No VIF found with MAC fa:16:3e:f5:af:c7, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 11:01:34 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:01:34 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 11:01:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-516ccb91-3edf-4da4-b598-106820bd745a tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.094s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:01:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:01:35 user nova-compute[71557]: INFO nova.compute.manager [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Detaching volume 21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7
Apr 12 11:01:35 user nova-compute[71557]: INFO nova.virt.block_device [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Attempting to driver detach volume 21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 from mountpoint /dev/vdb
Apr 12 11:01:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Attempting to detach device vdb from instance ca545a0c-89fd-4a04-9d87-c2698051ca87 from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 11:01:35 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 11:01:35 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 11:01:35 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 11:01:35 user nova-compute[71557]:   <serial>21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7</serial>
Apr 12 11:01:35 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 11:01:35 user nova-compute[71557]: </disk>
Apr 12 11:01:35 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 11:01:35 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Successfully detached device vdb from instance ca545a0c-89fd-4a04-9d87-c2698051ca87 from the persistent domain config.
Apr 12 11:01:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ca545a0c-89fd-4a04-9d87-c2698051ca87 from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 11:01:35 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 11:01:35 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 11:01:35 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 11:01:35 user nova-compute[71557]:   <serial>21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7</serial>
Apr 12 11:01:35 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 11:01:35 user nova-compute[71557]: </disk>
Apr 12 11:01:35 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681297295.8734076, ca545a0c-89fd-4a04-9d87-c2698051ca87 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 11:01:35 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Successfully detached device vdb from instance ca545a0c-89fd-4a04-9d87-c2698051ca87 from the live domain config.
Apr 12 11:01:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zvSbuWwh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:01:35 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:01:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15c505e-d638-4612-b89e-534de05f274f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 11:01:35 user nova-compute[71557]: No targets found.
Apr 12 11:01:35 user nova-compute[71557]: iSNS:
Apr 12 11:01:35 user nova-compute[71557]: No targets found.
Apr 12 11:01:35 user nova-compute[71557]: STATIC:
Apr 12 11:01:35 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7
Apr 12 11:01:35 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 11:01:35 user nova-compute[71557]:                 Iface Name: default
Apr 12 11:01:35 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9
Apr 12 11:01:35 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 11:01:35 user nova-compute[71557]:                 Iface Name: default
Apr 12 11:01:35 user nova-compute[71557]: FIRMWARE:
Apr 12 11:01:35 user nova-compute[71557]: No targets found.
Apr 12 11:01:35 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 11:01:35 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 11:01:35 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c226f2c7-70a6-4961-a0c7-1be3244c2b82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[600ea668-76fd-49ec-9e7f-e03685d250ce]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 11:01:35 user nova-compute[71557]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 (non-flash)
Apr 12 11:01:35 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 11:01:35 user nova-compute[71557]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 (non-flash)
Apr 12 11:01:35 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fe12d8280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7'): ({'sdb'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Removing single pathed devices sdb {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9342af8d-3e84-45dc-b4ec-e84a65ee20af]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:35 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdb41b4-3abb-4a3d-b9c1-4d811f8c1f45]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Flushing IO for device /dev/sdb {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6a4417-58de-42bc-8331-f6af79ad1c1b]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.064s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9e3c96-e7b2-4fd8-887a-c16a42bf5979]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c836633e-f9b9-4c10-86a3-2e92678d469a]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a75fb1-aaf9-4333-b8e5-80b576db53e5]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7, portal: 172.16.0.220,3260]
Apr 12 11:01:36 user nova-compute[71557]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7, portal: 172.16.0.220,3260] successful.
Apr 12 11:01:36 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21f8a049-18fe-4ab8-aed2-79f4dbc4e0f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7075d27-ef11-4a97-ada6-69e48f50971c]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] <== disconnect_volume: return (312ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG nova.objects.instance [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lazy-loading 'flavor' on Instance uuid ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:01:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-d47b77f1-a405-4ba8-b613-27018f2b4f2b tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.606s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:01:39 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:01:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 11:01:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-faf5e629-c914-43a1-bd73-ce4adfafe9d6" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 11:01:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-faf5e629-c914-43a1-bd73-ce4adfafe9d6" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 11:01:39 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 11:01:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:39 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Updating instance_info_cache with network_info: [{"id": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "address": "fa:16:3e:f6:ad:69", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a5f64-a4", "ovs_interfaceid": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:01:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-faf5e629-c914-43a1-bd73-ce4adfafe9d6" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 11:01:39 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 11:01:39 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:01:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:01:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:01:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:01:39 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 11:01:39 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:40 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71557) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 11:01:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec82dbf-d946-4aca-9320-8fd0c197e1c0/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec82dbf-d946-4aca-9320-8fd0c197e1c0/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec82dbf-d946-4aca-9320-8fd0c197e1c0/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:01:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec82dbf-d946-4aca-9320-8fd0c197e1c0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:01:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:41 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681297286.2254033, 948c893b-1292-4b9a-8c77-0e23c94387ae => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 11:01:41 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] VM Stopped (Lifecycle Event)
Apr 12 11:01:41 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:01:41 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:01:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=8217MB free_disk=26.064453125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 11:01:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:01:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:01:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-bbe2bf55-ca76-45dc-add9-0300851fd9f6 None None] [instance: 948c893b-1292-4b9a-8c77-0e23c94387ae] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 11:01:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 11:01:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 11:01:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 11:01:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance ca545a0c-89fd-4a04-9d87-c2698051ca87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 11:01:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance eec82dbf-d946-4aca-9320-8fd0c197e1c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 11:01:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 11:01:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 11:01:41 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 11:01:41 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 11:01:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 11:01:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:01:41 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:01:42 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:01:42 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Cleaning up deleted instances with incomplete migration  {{(pid=71557) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 11:01:42 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:01:42 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:01:42 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:01:42 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:01:44 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:01:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:46 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:01:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:49 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:01:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Cleaning up deleted instances {{(pid=71557) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 11:01:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] There are 0 instances to clean {{(pid=71557) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 11:01:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:51 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:01:56 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_power_states {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid faf5e629-c914-43a1-bd73-ce4adfafe9d6 {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Triggering sync for uuid eec82dbf-d946-4aca-9320-8fd0c197e1c0 {{(pid=71557) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-72f643a9-5589-4663-9fe8-c10d9500ae8b req-9b0cbde5-1751-4609-97bb-b34df6259213 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Received event network-changed-619a1e09-7376-4439-a5bb-72a26f4865ad {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-72f643a9-5589-4663-9fe8-c10d9500ae8b req-9b0cbde5-1751-4609-97bb-b34df6259213 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Refreshing instance network info cache due to event network-changed-619a1e09-7376-4439-a5bb-72a26f4865ad. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-72f643a9-5589-4663-9fe8-c10d9500ae8b req-9b0cbde5-1751-4609-97bb-b34df6259213 service nova] Acquiring lock "refresh_cache-eec82dbf-d946-4aca-9320-8fd0c197e1c0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-72f643a9-5589-4663-9fe8-c10d9500ae8b req-9b0cbde5-1751-4609-97bb-b34df6259213 service nova] Acquired lock "refresh_cache-eec82dbf-d946-4aca-9320-8fd0c197e1c0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG nova.network.neutron [req-72f643a9-5589-4663-9fe8-c10d9500ae8b req-9b0cbde5-1751-4609-97bb-b34df6259213 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Refreshing network info cache for port 619a1e09-7376-4439-a5bb-72a26f4865ad {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lazy-loading 'flavor' on Instance uuid eec82dbf-d946-4aca-9320-8fd0c197e1c0 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:13 user nova-compute[71557]: INFO nova.compute.manager [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Attaching volume 03d8e234-e7b8-4854-8c8c-3f715bbef045 to /dev/vdb
Apr 12 11:02:13 user nova-compute[71557]: DEBUG nova.network.neutron [req-72f643a9-5589-4663-9fe8-c10d9500ae8b req-9b0cbde5-1751-4609-97bb-b34df6259213 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Updated VIF entry in instance network info cache for port 619a1e09-7376-4439-a5bb-72a26f4865ad. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG nova.network.neutron [req-72f643a9-5589-4663-9fe8-c10d9500ae8b req-9b0cbde5-1751-4609-97bb-b34df6259213 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Updating instance_info_cache with network_info: [{"id": "619a1e09-7376-4439-a5bb-72a26f4865ad", "address": "fa:16:3e:30:0e:e5", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a1e09-73", "ovs_interfaceid": "619a1e09-7376-4439-a5bb-72a26f4865ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-72f643a9-5589-4663-9fe8-c10d9500ae8b req-9b0cbde5-1751-4609-97bb-b34df6259213 service nova] Releasing lock "refresh_cache-eec82dbf-d946-4aca-9320-8fd0c197e1c0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG os_brick.utils [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da3bc04-47ae-4971-ab4e-78654b3e1ab3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5fafa1-f653-463c-94e3-c14ba85b6b2d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49fe8aa-fff2-48e0-bb9b-b9d155e9c1e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db5c9dc-7180-4019-a5e9-879d4faf20fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 11:02:13 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 11:02:13 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[07542ad0-af63-4a7d-b314-eb95f0d020d8]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG os_brick.utils [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:02:13 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Updating existing volume attachment record: 99bcf7ce-ed81-4f4e-a125-ac27e2c4aecb {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 11:02:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:15 user nova-compute[71557]: INFO nova.compute.manager [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Terminating instance
Apr 12 11:02:15 user nova-compute[71557]: DEBUG nova.compute.manager [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 11:02:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-3ea41656-9acb-46e4-969d-69d8bcb9fe2e req-b9ff9787-8f97-4c65-a761-36c3035cf6f3 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received event network-vif-unplugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:02:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3ea41656-9acb-46e4-969d-69d8bcb9fe2e req-b9ff9787-8f97-4c65-a761-36c3035cf6f3 service nova] Acquiring lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3ea41656-9acb-46e4-969d-69d8bcb9fe2e req-b9ff9787-8f97-4c65-a761-36c3035cf6f3 service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-3ea41656-9acb-46e4-969d-69d8bcb9fe2e req-b9ff9787-8f97-4c65-a761-36c3035cf6f3 service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-3ea41656-9acb-46e4-969d-69d8bcb9fe2e req-b9ff9787-8f97-4c65-a761-36c3035cf6f3 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] No waiting events found dispatching network-vif-unplugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:02:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-3ea41656-9acb-46e4-969d-69d8bcb9fe2e req-b9ff9787-8f97-4c65-a761-36c3035cf6f3 service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received event network-vif-unplugged-8786a087-f036-403b-9b82-c75fc6dbb110 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 11:02:16 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Instance destroyed successfully.
Apr 12 11:02:16 user nova-compute[71557]: DEBUG nova.objects.instance [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'resources' on Instance uuid 2aef35e7-5daf-4d41-b91b-a7ff4a481644 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:02:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:52:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1710761960',display_name='tempest-AttachVolumeTestJSON-server-1710761960',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1710761960',id=38,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQLwZrl3jPnPhohKnRnR2qfd8ly9sETNwW4CsnbJ63gmB7R0QElmNz5jXYfSBpJs0XqGEZmxFm/4XJScQktvDrpb6FHDkQYZ7pSrXVh9P+kxqpboxMoLpeKxHkx0WwNzw==',key_name='tempest-keypair-1222347782',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:52:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9878bfe34ceb4a6695b253ad161c4f7b',ramdisk_id='',reservation_id='r-u8xhdlhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1953237893',owner_user_name='tempest-AttachVolumeTestJSON-1953237893-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T11:00:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6576467073e41e9b497097d5a8dfd3d',uuid=2aef35e7-5daf-4d41-b91b-a7ff4a481644,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 11:02:16 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converting VIF {"id": "8786a087-f036-403b-9b82-c75fc6dbb110", "address": "fa:16:3e:59:45:ef", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8786a087-f0", "ovs_interfaceid": "8786a087-f036-403b-9b82-c75fc6dbb110", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 11:02:16 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=8786a087-f036-403b-9b82-c75fc6dbb110,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8786a087-f0') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 11:02:16 user nova-compute[71557]: DEBUG os_vif [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=8786a087-f036-403b-9b82-c75fc6dbb110,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8786a087-f0') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 11:02:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8786a087-f0, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 11:02:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:02:16 user nova-compute[71557]: INFO os_vif [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:45:ef,bridge_name='br-int',has_traffic_filtering=True,id=8786a087-f036-403b-9b82-c75fc6dbb110,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8786a087-f0')
Apr 12 11:02:16 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Deleting instance files /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644_del
Apr 12 11:02:16 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Deletion of /opt/stack/data/nova/instances/2aef35e7-5daf-4d41-b91b-a7ff4a481644_del complete
Apr 12 11:02:16 user nova-compute[71557]: INFO nova.compute.manager [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 12 11:02:16 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 11:02:16 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 11:02:16 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 11:02:17 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:02:17 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Took 0.90 seconds to deallocate network for instance.
Apr 12 11:02:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:17 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 11:02:17 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 11:02:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:17 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Deleted allocations for instance 2aef35e7-5daf-4d41-b91b-a7ff4a481644
Apr 12 11:02:17 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-46c098ee-2d8d-4f16-b1e3-c5191549c82f tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.172s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igvOJZEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:02:18 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:02:18 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:02:18 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bc85d2-90ad-409b-86c5-d671503e2a5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 11:02:18 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG nova.compute.manager [req-549cc622-0050-4bb5-a8b5-964b5f0a2211 req-5a5f1110-7c2f-40aa-b32d-1cdb553641fe service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received event network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-549cc622-0050-4bb5-a8b5-964b5f0a2211 req-5a5f1110-7c2f-40aa-b32d-1cdb553641fe service nova] Acquiring lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-549cc622-0050-4bb5-a8b5-964b5f0a2211 req-5a5f1110-7c2f-40aa-b32d-1cdb553641fe service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-549cc622-0050-4bb5-a8b5-964b5f0a2211 req-5a5f1110-7c2f-40aa-b32d-1cdb553641fe service nova] Lock "2aef35e7-5daf-4d41-b91b-a7ff4a481644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG nova.compute.manager [req-549cc622-0050-4bb5-a8b5-964b5f0a2211 req-5a5f1110-7c2f-40aa-b32d-1cdb553641fe service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] No waiting events found dispatching network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:02:18 user nova-compute[71557]: WARNING nova.compute.manager [req-549cc622-0050-4bb5-a8b5-964b5f0a2211 req-5a5f1110-7c2f-40aa-b32d-1cdb553641fe service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received unexpected event network-vif-plugged-8786a087-f036-403b-9b82-c75fc6dbb110 for instance with vm_state deleted and task_state None.
Apr 12 11:02:18 user nova-compute[71557]: DEBUG nova.compute.manager [req-549cc622-0050-4bb5-a8b5-964b5f0a2211 req-5a5f1110-7c2f-40aa-b32d-1cdb553641fe service nova] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Received event network-vif-deleted-8786a087-f036-403b-9b82-c75fc6dbb110 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[789883c1-98b0-433f-9c81-6f228cbeb0a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045] added
Apr 12 11:02:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[70060d60-3a7b-4215-85f6-3a411ad77019]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[153c61c5-bea2-49fb-8e1c-491d3ceda4fc]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v igvOJZEB {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v igvOJZEB" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c00ce5-d6ba-4167-85f2-78d5c7e359d7]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'igvOJZEB'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4c8821-e122-4610-9534-e572ef6c1e21]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7e7ffc-ab34-4603-ae3f-c2370575f8c7]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 11:02:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 11:02:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb982b23-3717-4eda-967c-98ae33132fb2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045, portal: 172.16.0.220,3260]
Apr 12 11:02:18 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045, portal: 172.16.0.220,3260] successful.
Apr 12 11:02:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecd289d-07d1-4891-b09a-8609888ea0f6]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7ad79b-694d-4b0b-8794-b60379b45f36]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 11:02:18 user nova-compute[71557]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 (non-flash)
Apr 12 11:02:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 11:02:18 user nova-compute[71557]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 (non-flash)
Apr 12 11:02:18 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e98c23-6e42-4cd0-ad18-a174ab79cde2]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 11:02:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igvOJZEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 11:02:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:02:19 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23633363233616534', 'path': '/dev/sdb'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:02:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633363233616534', 'path': '/dev/sdb'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 11:02:19 user nova-compute[71557]: DEBUG nova.objects.instance [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lazy-loading 'flavor' on Instance uuid eec82dbf-d946-4aca-9320-8fd0c197e1c0 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:02:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 11:02:19 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 11:02:19 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 11:02:19 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 11:02:19 user nova-compute[71557]:   <serial>03d8e234-e7b8-4854-8c8c-3f715bbef045</serial>
Apr 12 11:02:19 user nova-compute[71557]: </disk>
Apr 12 11:02:19 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 11:02:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 11:02:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 11:02:19 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] No VIF found with MAC fa:16:3e:30:0e:e5, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 11:02:19 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-a8eee874-9586-4e39-8db5-15f5a6c10ea0 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.550s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:20 user nova-compute[71557]: DEBUG nova.compute.manager [req-373c779f-1f1a-4994-9025-26f55410200b req-3f848090-3959-4de5-870d-f50ce4715dca service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Received event network-changed-f0316e9d-800d-42f6-9078-eafa6da69f0d {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:02:20 user nova-compute[71557]: DEBUG nova.compute.manager [req-373c779f-1f1a-4994-9025-26f55410200b req-3f848090-3959-4de5-870d-f50ce4715dca service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Refreshing instance network info cache due to event network-changed-f0316e9d-800d-42f6-9078-eafa6da69f0d. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 11:02:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-373c779f-1f1a-4994-9025-26f55410200b req-3f848090-3959-4de5-870d-f50ce4715dca service nova] Acquiring lock "refresh_cache-e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 11:02:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-373c779f-1f1a-4994-9025-26f55410200b req-3f848090-3959-4de5-870d-f50ce4715dca service nova] Acquired lock "refresh_cache-e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 11:02:20 user nova-compute[71557]: DEBUG nova.network.neutron [req-373c779f-1f1a-4994-9025-26f55410200b req-3f848090-3959-4de5-870d-f50ce4715dca service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Refreshing network info cache for port f0316e9d-800d-42f6-9078-eafa6da69f0d {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 11:02:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:20 user nova-compute[71557]: INFO nova.compute.manager [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Terminating instance
Apr 12 11:02:20 user nova-compute[71557]: DEBUG nova.compute.manager [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-6e4cf014-737e-4e14-a84b-4ca432578e0d req-b9f65b73-9556-494e-9cee-0cb1fa9e5369 service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Received event network-vif-unplugged-f0316e9d-800d-42f6-9078-eafa6da69f0d {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6e4cf014-737e-4e14-a84b-4ca432578e0d req-b9f65b73-9556-494e-9cee-0cb1fa9e5369 service nova] Acquiring lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6e4cf014-737e-4e14-a84b-4ca432578e0d req-b9f65b73-9556-494e-9cee-0cb1fa9e5369 service nova] Lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6e4cf014-737e-4e14-a84b-4ca432578e0d req-b9f65b73-9556-494e-9cee-0cb1fa9e5369 service nova] Lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-6e4cf014-737e-4e14-a84b-4ca432578e0d req-b9f65b73-9556-494e-9cee-0cb1fa9e5369 service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] No waiting events found dispatching network-vif-unplugged-f0316e9d-800d-42f6-9078-eafa6da69f0d {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG nova.compute.manager [req-6e4cf014-737e-4e14-a84b-4ca432578e0d req-b9f65b73-9556-494e-9cee-0cb1fa9e5369 service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Received event network-vif-unplugged-f0316e9d-800d-42f6-9078-eafa6da69f0d for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG nova.network.neutron [req-373c779f-1f1a-4994-9025-26f55410200b req-3f848090-3959-4de5-870d-f50ce4715dca service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Updated VIF entry in instance network info cache for port f0316e9d-800d-42f6-9078-eafa6da69f0d. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG nova.network.neutron [req-373c779f-1f1a-4994-9025-26f55410200b req-3f848090-3959-4de5-870d-f50ce4715dca service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Updating instance_info_cache with network_info: [{"id": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "address": "fa:16:3e:00:68:fe", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0316e9d-80", "ovs_interfaceid": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-373c779f-1f1a-4994-9025-26f55410200b req-3f848090-3959-4de5-870d-f50ce4715dca service nova] Releasing lock "refresh_cache-e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:21 user nova-compute[71557]: INFO nova.compute.manager [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Detaching volume 03d8e234-e7b8-4854-8c8c-3f715bbef045
Apr 12 11:02:21 user nova-compute[71557]: INFO nova.virt.block_device [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Attempting to driver detach volume 03d8e234-e7b8-4854-8c8c-3f715bbef045 from mountpoint /dev/vdb
Apr 12 11:02:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Attempting to detach device vdb from instance eec82dbf-d946-4aca-9320-8fd0c197e1c0 from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 11:02:21 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 11:02:21 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 11:02:21 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 11:02:21 user nova-compute[71557]:   <serial>03d8e234-e7b8-4854-8c8c-3f715bbef045</serial>
Apr 12 11:02:21 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 11:02:21 user nova-compute[71557]: </disk>
Apr 12 11:02:21 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 11:02:21 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Successfully detached device vdb from instance eec82dbf-d946-4aca-9320-8fd0c197e1c0 from the persistent domain config.
Apr 12 11:02:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eec82dbf-d946-4aca-9320-8fd0c197e1c0 from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 11:02:21 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 11:02:21 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 11:02:21 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 11:02:21 user nova-compute[71557]:   <serial>03d8e234-e7b8-4854-8c8c-3f715bbef045</serial>
Apr 12 11:02:21 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 11:02:21 user nova-compute[71557]: </disk>
Apr 12 11:02:21 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 11:02:21 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Instance destroyed successfully.
Apr 12 11:02:21 user nova-compute[71557]: DEBUG nova.objects.instance [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lazy-loading 'resources' on Instance uuid e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:57:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-153844544',display_name='tempest-TestVolumeBootPattern-server-153844544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-153844544',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeNYUbBfSwdaJdVL2RMsgRRuPmOdMNSAwl/DHzaeVhE0fDjZe84+pAYZqsgenmNqm/u0yGuL1KeKxxwsT2FNR2LdwQFC7iIcZOaTovpAXdmD/5wx/0lhCQf7gPsmZ5xfg==',key_name='tempest-TestVolumeBootPattern-162796269',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:57:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a67f3d23b8f74a9496d445c7fc75717e',ramdisk_id='',reservation_id='r-k64gcvv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-638607559',owner_user_name='tempest-TestVolumeBootPattern-638607559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:57:45Z,user_data=None,user_id='b914d7ca786f455baf120f98816abffd',uuid=e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "address": "fa:16:3e:00:68:fe", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0316e9d-80", "ovs_interfaceid": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converting VIF {"id": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "address": "fa:16:3e:00:68:fe", "network": {"id": "3ecf6069-4851-431c-a1c3-13e94566fa0b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-609134572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a67f3d23b8f74a9496d445c7fc75717e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0316e9d-80", "ovs_interfaceid": "f0316e9d-800d-42f6-9078-eafa6da69f0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:68:fe,bridge_name='br-int',has_traffic_filtering=True,id=f0316e9d-800d-42f6-9078-eafa6da69f0d,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0316e9d-80') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG os_vif [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:68:fe,bridge_name='br-int',has_traffic_filtering=True,id=f0316e9d-800d-42f6-9078-eafa6da69f0d,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0316e9d-80') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0316e9d-80, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:02:21 user nova-compute[71557]: INFO os_vif [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:68:fe,bridge_name='br-int',has_traffic_filtering=True,id=f0316e9d-800d-42f6-9078-eafa6da69f0d,network=Network(3ecf6069-4851-431c-a1c3-13e94566fa0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0316e9d-80')
Apr 12 11:02:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyTZNWEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:02:21 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:02:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4227705c-5750-45cd-be0a-4dcedf866c28]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 11:02:21 user nova-compute[71557]: No targets found.
Apr 12 11:02:21 user nova-compute[71557]: iSNS:
Apr 12 11:02:21 user nova-compute[71557]: No targets found.
Apr 12 11:02:21 user nova-compute[71557]: STATIC:
Apr 12 11:02:21 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045
Apr 12 11:02:21 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 11:02:21 user nova-compute[71557]:                 Iface Name: default
Apr 12 11:02:21 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9
Apr 12 11:02:21 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 11:02:21 user nova-compute[71557]:                 Iface Name: default
Apr 12 11:02:21 user nova-compute[71557]: FIRMWARE:
Apr 12 11:02:21 user nova-compute[71557]: No targets found.
Apr 12 11:02:21 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 11:02:21 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 11:02:21 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[388c753d-c3e7-45a4-adcf-ce84f07224a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece6ce03-3cf0-4b42-9e7a-bae0f7810058]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 11:02:21 user nova-compute[71557]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 (non-flash)
Apr 12 11:02:21 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 (non-flash)
Apr 12 11:02:21 user nova-compute[71557]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 (non-flash)
Apr 12 11:02:21 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd45e0ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9'): ({'sdc'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Removing single pathed devices sdc {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efa9c2e-0b4a-49cd-b161-2cd19f9015df]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6f6b24-9701-4e26-aced-92ce199d30ea]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Flushing IO for device /dev/sdc {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe79d897-241f-44d6-b85e-f1f5a8d8eb8e]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f481d3f-630b-466e-beb8-fa21a8e06d15]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] SCSI volumes sdc have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_78532188', '/dev/disk/by-id/scsi-1SCST_BIO78532188-a73701b4b62e8b59', '/dev/disk/by-id/scsi-26137333730316234') {{(pid=82009) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[536c3ebb-2c44-4044-a067-dc911b94cd16]: (4, None) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd41a47-2431-4498-bef6-8fdd2e0cac27]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d539df63-11a4-4c0f-924f-26d42c70cacf]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9, portal: 172.16.0.220,3260]
Apr 12 11:02:22 user nova-compute[71557]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9, portal: 172.16.0.220,3260] successful.
Apr 12 11:02:22 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a37b7e-8277-4e8d-8d37-9fbc82af9ff9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cef7ce-78e5-4d78-85a4-e56f16809b9b]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] <== disconnect_volume: return (272ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 11:02:22 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Deleting instance files /opt/stack/data/nova/instances/e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280_del
Apr 12 11:02:22 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Deletion of /opt/stack/data/nova/instances/e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280_del complete
Apr 12 11:02:22 user nova-compute[71557]: INFO nova.compute.manager [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Took 1.12 seconds to destroy the instance on the hypervisor.
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681297342.1477954, eec82dbf-d946-4aca-9320-8fd0c197e1c0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eec82dbf-d946-4aca-9320-8fd0c197e1c0 {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 11:02:22 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Successfully detached device vdb from instance eec82dbf-d946-4aca-9320-8fd0c197e1c0 from the live domain config.
Apr 12 11:02:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igvOJZEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:02:22 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fe2123-5c2f-4836-9926-f259cc9beb4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 11:02:22 user nova-compute[71557]: No targets found.
Apr 12 11:02:22 user nova-compute[71557]: iSNS:
Apr 12 11:02:22 user nova-compute[71557]: No targets found.
Apr 12 11:02:22 user nova-compute[71557]: STATIC:
Apr 12 11:02:22 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045
Apr 12 11:02:22 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 11:02:22 user nova-compute[71557]:                 Iface Name: default
Apr 12 11:02:22 user nova-compute[71557]: FIRMWARE:
Apr 12 11:02:22 user nova-compute[71557]: No targets found.
Apr 12 11:02:22 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 11:02:22 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 11:02:22 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e62cd5-3fd5-404a-bceb-a87a6e242ebd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a7af44-4a6a-4ef7-9b61-c69c480cfca5]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 (non-flash)
Apr 12 11:02:22 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 (non-flash)
Apr 12 11:02:22 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd462fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045'): ({'sdb'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Removing single pathed devices sdb {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e013ff1b-7f90-4e30-b71b-b62c2fbb132d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6b1f36-db5c-4f98-8d6d-5d7c655eeb1e]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Flushing IO for device /dev/sdb {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9206b453-0051-4eb2-b2ad-38c0d0339308]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f428f7-4f65-446e-b965-8d2f3630a43c]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[83287528-2084-4e63-ae58-4641ceeca68d]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c255149b-d218-4516-b25a-df22b7c885df]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045, portal: 172.16.0.220,3260]
Apr 12 11:02:22 user nova-compute[71557]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045, portal: 172.16.0.220,3260] successful.
Apr 12 11:02:22 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d8e234-e7b8-4854-8c8c-3f715bbef045 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[265cb584-91fe-42f3-9357-157b628e5689]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] <== disconnect_volume: return (268ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 11:02:22 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:02:22 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Took 0.83 seconds to deallocate network for instance.
Apr 12 11:02:22 user nova-compute[71557]: DEBUG nova.compute.manager [req-1fff48cf-1abb-437f-a509-65fe5f4ef308 req-5fdde0d1-a42e-45db-9268-488e5a9bb947 service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Received event network-vif-deleted-f0316e9d-800d-42f6-9078-eafa6da69f0d {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:02:23 user nova-compute[71557]: DEBUG nova.objects.instance [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lazy-loading 'flavor' on Instance uuid eec82dbf-d946-4aca-9320-8fd0c197e1c0 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:02:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-bd319649-40ac-43f6-8de4-bbf3bf21013e tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.728s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-f83b62c0-c1da-4aa0-9f60-54f0b828ddb8 req-0c5b7be9-cc1d-4bca-b3dc-68ea1392ed7a service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Received event network-vif-plugged-f0316e9d-800d-42f6-9078-eafa6da69f0d {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:02:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f83b62c0-c1da-4aa0-9f60-54f0b828ddb8 req-0c5b7be9-cc1d-4bca-b3dc-68ea1392ed7a service nova] Acquiring lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f83b62c0-c1da-4aa0-9f60-54f0b828ddb8 req-0c5b7be9-cc1d-4bca-b3dc-68ea1392ed7a service nova] Lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-f83b62c0-c1da-4aa0-9f60-54f0b828ddb8 req-0c5b7be9-cc1d-4bca-b3dc-68ea1392ed7a service nova] Lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:23 user nova-compute[71557]: DEBUG nova.compute.manager [req-f83b62c0-c1da-4aa0-9f60-54f0b828ddb8 req-0c5b7be9-cc1d-4bca-b3dc-68ea1392ed7a service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] No waiting events found dispatching network-vif-plugged-f0316e9d-800d-42f6-9078-eafa6da69f0d {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:02:23 user nova-compute[71557]: WARNING nova.compute.manager [req-f83b62c0-c1da-4aa0-9f60-54f0b828ddb8 req-0c5b7be9-cc1d-4bca-b3dc-68ea1392ed7a service nova] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Received unexpected event network-vif-plugged-f0316e9d-800d-42f6-9078-eafa6da69f0d for instance with vm_state active and task_state deleting.
Apr 12 11:02:23 user nova-compute[71557]: INFO nova.compute.manager [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Took 0.79 seconds to detach 1 volumes for instance.
Apr 12 11:02:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:23 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 11:02:23 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 11:02:23 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:24 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Deleted allocations for instance e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280
Apr 12 11:02:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-c697eda7-659c-4388-b250-80b7125dd986 tempest-TestVolumeBootPattern-638607559 tempest-TestVolumeBootPattern-638607559-project-member] Lock "e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.103s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG nova.objects.instance [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lazy-loading 'flavor' on Instance uuid ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:28 user nova-compute[71557]: INFO nova.compute.manager [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Attaching volume 0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 to /dev/vdb
Apr 12 11:02:28 user nova-compute[71557]: DEBUG os_brick.utils [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[60072fed-74cd-4546-a2e4-8d1b4ade5e21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6243865f-c83b-4418-b142-83d9a263ced6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adb8a3e-2a7e-4276-938c-9dc1e63e9967]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfc612c-aa30-4801-883c-7f8c094a91f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 11:02:28 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 11:02:28 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3182c1-beb0-40c7-8ab0-00b949bd9eb4]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG os_brick.utils [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:02:28 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Updating existing volume attachment record: 07c53de1-4519-4bee-b7f0-fb945384640f {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 11:02:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:31 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681297336.4759624, 2aef35e7-5daf-4d41-b91b-a7ff4a481644 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 11:02:31 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] VM Stopped (Lifecycle Event)
Apr 12 11:02:31 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ab0c05f5-745e-47b4-b948-2479e633d9e8 None None] [instance: 2aef35e7-5daf-4d41-b91b-a7ff4a481644] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 11:02:31 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:32 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 11:02:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PzTZdJrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:02:32 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:02:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:02:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:02:32 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:02:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:02:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:02:32 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 11:02:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93c10f7-78a9-439b-8b22-14c0e5fd8b5e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 11:02:32 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[960ab6b1-1dad-42b9-aee2-1098568ee8a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740] added
Apr 12 11:02:32 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36049f6-2e3d-40e9-a3a2-6d165b7dc56d]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:32 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:32 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:32 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4b9245-2085-4b98-b6cd-f99eba60ae99]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PzTZdJrp {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PzTZdJrp" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a5177d-372a-4def-ab09-c0fb4cff8bf9]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PzTZdJrp'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e914333d-e49d-4542-9a15-6db65ab50f10]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8241aef3-45bf-476b-8b2d-a74765ef4af8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 11:02:33 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 11:02:33 user nova-compute[71557]:  {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:02:33 user nova-compute[71557]: WARNING os_brick.initiator.connectors.iscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 11:02:33 user nova-compute[71557]: 
Apr 12 11:02:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f55d75-b3fd-4038-b244-408822aebb72]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740, portal: 172.16.0.220,3260]
Apr 12 11:02:33 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740, portal: 172.16.0.220,3260] successful.
Apr 12 11:02:33 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[520128e6-06fb-443f-81e8-a37665f068ab]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac26c871-16cd-45d5-997d-66f672019fcb]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 (non-flash)
Apr 12 11:02:33 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 (non-flash)
Apr 12 11:02:33 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.232s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1001e92c-64a4-4986-9817-8e698a788cb4]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 11:02:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PzTZdJrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 11:02:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:02:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '26433306436373261', 'path': '/dev/sdb'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:02:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433306436373261', 'path': '/dev/sdb'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 11:02:34 user nova-compute[71557]: DEBUG nova.objects.instance [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lazy-loading 'flavor' on Instance uuid ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:02:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 11:02:34 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 11:02:34 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 11:02:34 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 11:02:34 user nova-compute[71557]:   <serial>0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740</serial>
Apr 12 11:02:34 user nova-compute[71557]: </disk>
Apr 12 11:02:34 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 11:02:34 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:02:34 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 11:02:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 11:02:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 11:02:34 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] No VIF found with MAC fa:16:3e:f5:af:c7, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 11:02:34 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-cfd413b2-4fab-4172-a194-747f41891377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.096s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:35 user nova-compute[71557]: INFO nova.compute.manager [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Detaching volume 0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740
Apr 12 11:02:35 user nova-compute[71557]: INFO nova.virt.block_device [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Attempting to driver detach volume 0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 from mountpoint /dev/vdb
Apr 12 11:02:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Attempting to detach device vdb from instance ca545a0c-89fd-4a04-9d87-c2698051ca87 from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 11:02:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 11:02:35 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 11:02:35 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 11:02:35 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 11:02:35 user nova-compute[71557]:   <serial>0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740</serial>
Apr 12 11:02:35 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 11:02:35 user nova-compute[71557]: </disk>
Apr 12 11:02:35 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 11:02:35 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Successfully detached device vdb from instance ca545a0c-89fd-4a04-9d87-c2698051ca87 from the persistent domain config.
Apr 12 11:02:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ca545a0c-89fd-4a04-9d87-c2698051ca87 from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 11:02:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 11:02:35 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 11:02:35 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 11:02:35 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 11:02:35 user nova-compute[71557]:   <serial>0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740</serial>
Apr 12 11:02:35 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 11:02:35 user nova-compute[71557]: </disk>
Apr 12 11:02:35 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681297356.22586, ca545a0c-89fd-4a04-9d87-c2698051ca87 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 11:02:36 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Successfully detached device vdb from instance ca545a0c-89fd-4a04-9d87-c2698051ca87 from the live domain config.
Apr 12 11:02:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PzTZdJrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:02:36 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:02:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[4863caa4-65a8-4d06-ab34-33fcd415415f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 11:02:36 user nova-compute[71557]: No targets found.
Apr 12 11:02:36 user nova-compute[71557]: iSNS:
Apr 12 11:02:36 user nova-compute[71557]: No targets found.
Apr 12 11:02:36 user nova-compute[71557]: STATIC:
Apr 12 11:02:36 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740
Apr 12 11:02:36 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 11:02:36 user nova-compute[71557]:                 Iface Name: default
Apr 12 11:02:36 user nova-compute[71557]: FIRMWARE:
Apr 12 11:02:36 user nova-compute[71557]: No targets found.
Apr 12 11:02:36 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 11:02:36 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 11:02:36 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e42a373-ebaa-4506-9461-bae66bffe6cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20df564-9f3a-48ee-a8dc-7c28064e0946]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 (non-flash)
Apr 12 11:02:36 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 (non-flash)
Apr 12 11:02:36 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fe12d88b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740'): ({'sdb'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Removing single pathed devices sdb {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8fc5c0-8b06-4974-9226-709c29500039]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa9dd05-7909-4a6d-9500-1c365c30fbec]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Flushing IO for device /dev/sdb {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5035016-9d9d-4443-a38b-103d3c3343f1]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3ba8ca-d7d9-4931-a43d-3cbf22d39827]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc646cac-bac9-4f90-ac05-b5fbfeeb181f]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[15052bf9-5492-40ec-9d94-dc0a34fef919]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740, portal: 172.16.0.220,3260]
Apr 12 11:02:36 user nova-compute[71557]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740, portal: 172.16.0.220,3260] successful.
Apr 12 11:02:36 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cd8a3f0-0fd0-47a7-bf94-db2e32cb7740 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dab80e-3b7a-4f56-852f-c5dae8a51659]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] <== disconnect_volume: return (260ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681297341.719379, e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 11:02:36 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] VM Stopped (Lifecycle Event)
Apr 12 11:02:36 user nova-compute[71557]: DEBUG nova.compute.manager [None req-20a3bdb2-314a-44e5-b726-f8c5cee2e263 None None] [instance: e1d7f68a-5fc4-4167-a6ab-f2bb24c7f280] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 11:02:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:37 user nova-compute[71557]: DEBUG nova.objects.instance [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lazy-loading 'flavor' on Instance uuid ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:02:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-70227643-f228-4adb-b546-a30e46bb06b2 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.551s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:40 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:02:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:40 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:40 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 11:02:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:40 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec82dbf-d946-4aca-9320-8fd0c197e1c0/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec82dbf-d946-4aca-9320-8fd0c197e1c0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec82dbf-d946-4aca-9320-8fd0c197e1c0/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:02:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec82dbf-d946-4aca-9320-8fd0c197e1c0/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:02:41 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:02:41 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:02:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=8441MB free_disk=26.08248519897461GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 11:02:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:02:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:02:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 11:02:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance ca545a0c-89fd-4a04-9d87-c2698051ca87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 11:02:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance eec82dbf-d946-4aca-9320-8fd0c197e1c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 11:02:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 11:02:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 11:02:41 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Refreshing inventories for resource provider 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 11:02:41 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Updating ProviderTree inventory for provider 24299bcb-a671-492d-9d13-df83697a8f87 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 11:02:41 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Updating inventory in ProviderTree for provider 24299bcb-a671-492d-9d13-df83697a8f87 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 11:02:41 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Refreshing aggregate associations for resource provider 24299bcb-a671-492d-9d13-df83697a8f87, aggregates: None {{(pid=71557) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 11:02:41 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Refreshing trait associations for resource provider 24299bcb-a671-492d-9d13-df83697a8f87, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=71557) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 11:02:42 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 11:02:42 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 11:02:42 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 11:02:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:02:43 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:02:43 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:02:43 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 11:02:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-ca545a0c-89fd-4a04-9d87-c2698051ca87" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 11:02:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-ca545a0c-89fd-4a04-9d87-c2698051ca87" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 11:02:43 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 11:02:43 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Updating instance_info_cache with network_info: [{"id": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "address": "fa:16:3e:f5:af:c7", "network": {"id": "5335fcd4-c9ce-4288-a2e9-4e9a1da25000", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612126582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7541fb4f462b438dbef4ffe9be4725b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4aee7d-5b", "ovs_interfaceid": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:02:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-ca545a0c-89fd-4a04-9d87-c2698051ca87" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 11:02:43 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 11:02:43 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:02:43 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:02:44 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:02:44 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:02:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:51 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:56 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:02:56 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:56 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:02:56 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:02:56 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:02:56 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:02:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:03:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 11:03:10 user nova-compute[71557]: INFO nova.compute.claims [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Claim successful on node user
Apr 12 11:03:10 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG nova.network.neutron [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 11:03:10 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 11:03:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG nova.policy [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6576467073e41e9b497097d5a8dfd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9878bfe34ceb4a6695b253ad161c4f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG nova.compute.manager [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 11:03:10 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Creating image(s)
Apr 12 11:03:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a514b7a-d2a1-40d4-9b25-106a07771d72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "/opt/stack/data/nova/instances/8a514b7a-d2a1-40d4-9b25-106a07771d72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "/opt/stack/data/nova/instances/8a514b7a-d2a1-40d4-9b25-106a07771d72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.138s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.129s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:10 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/8a514b7a-d2a1-40d4-9b25-106a07771d72/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/8a514b7a-d2a1-40d4-9b25-106a07771d72/disk 1073741824" returned: 0 in 0.052s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:03:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.128s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:11 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a514b7a-d2a1-40d4-9b25-106a07771d72/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 11:03:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a514b7a-d2a1-40d4-9b25-106a07771d72/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a514b7a-d2a1-40d4-9b25-106a07771d72/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:11 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Cannot resize image /opt/stack/data/nova/instances/8a514b7a-d2a1-40d4-9b25-106a07771d72/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 11:03:11 user nova-compute[71557]: DEBUG nova.objects.instance [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'migration_context' on Instance uuid 8a514b7a-d2a1-40d4-9b25-106a07771d72 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:03:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 11:03:11 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Ensure instance console log exists: /opt/stack/data/nova/instances/8a514b7a-d2a1-40d4-9b25-106a07771d72/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 11:03:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:03:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:03:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:03:11 user nova-compute[71557]: DEBUG nova.network.neutron [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Successfully created port: 23d8547c-bdb5-4646-ac12-1dfb693e9491 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 11:03:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.network.neutron [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Successfully updated port: 23d8547c-bdb5-4646-ac12-1dfb693e9491 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "refresh_cache-8a514b7a-d2a1-40d4-9b25-106a07771d72" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquired lock "refresh_cache-8a514b7a-d2a1-40d4-9b25-106a07771d72" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.network.neutron [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-383f1848-f51e-4247-858b-55037942c49a req-da7448ba-02a9-4e9f-b08f-9d7c78561ef0 service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Received event network-changed-23d8547c-bdb5-4646-ac12-1dfb693e9491 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-383f1848-f51e-4247-858b-55037942c49a req-da7448ba-02a9-4e9f-b08f-9d7c78561ef0 service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Refreshing instance network info cache due to event network-changed-23d8547c-bdb5-4646-ac12-1dfb693e9491. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-383f1848-f51e-4247-858b-55037942c49a req-da7448ba-02a9-4e9f-b08f-9d7c78561ef0 service nova] Acquiring lock "refresh_cache-8a514b7a-d2a1-40d4-9b25-106a07771d72" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.network.neutron [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.network.neutron [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Updating instance_info_cache with network_info: [{"id": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "address": "fa:16:3e:2e:ca:09", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d8547c-bd", "ovs_interfaceid": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Releasing lock "refresh_cache-8a514b7a-d2a1-40d4-9b25-106a07771d72" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Instance network_info: |[{"id": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "address": "fa:16:3e:2e:ca:09", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d8547c-bd", "ovs_interfaceid": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-383f1848-f51e-4247-858b-55037942c49a req-da7448ba-02a9-4e9f-b08f-9d7c78561ef0 service nova] Acquired lock "refresh_cache-8a514b7a-d2a1-40d4-9b25-106a07771d72" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.network.neutron [req-383f1848-f51e-4247-858b-55037942c49a req-da7448ba-02a9-4e9f-b08f-9d7c78561ef0 service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Refreshing network info cache for port 23d8547c-bdb5-4646-ac12-1dfb693e9491 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Start _get_guest_xml network_info=[{"id": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "address": "fa:16:3e:2e:ca:09", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d8547c-bd", "ovs_interfaceid": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 11:03:12 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:03:12 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T11:03:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2098924335',display_name='tempest-AttachVolumeTestJSON-server-2098924335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2098924335',id=46,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNumieZsB8oe7GLTZgFC+G6r47EBCDso6tEsNDy7zRRdzpCxU2vuKELKugqdw77z7Fs89HUtjILuEicvB0lsORArcYlMG9UCGVeFqo7InCbLcoNREp0G6jUNvS1QG5UJSw==',key_name='tempest-keypair-1832184664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9878bfe34ceb4a6695b253ad161c4f7b',ramdisk_id='',reservation_id='r-wwk09v6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1953237893',owner_user_name='tempest-AttachVolumeTestJSON-1953237893-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T11:03:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6576467073e41e9b497097d5a8dfd3d',uuid=8a514b7a-d2a1-40d4-9b25-106a07771d72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "address": "fa:16:3e:2e:ca:09", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d8547c-bd", "ovs_interfaceid": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converting VIF {"id": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "address": "fa:16:3e:2e:ca:09", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d8547c-bd", "ovs_interfaceid": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ca:09,bridge_name='br-int',has_traffic_filtering=True,id=23d8547c-bdb5-4646-ac12-1dfb693e9491,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23d8547c-bd') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.objects.instance [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a514b7a-d2a1-40d4-9b25-106a07771d72 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-93ede07d-dc9b-437d-accd-a855e02fe1ff req-ba5f8c50-dde2-41d3-a253-b28fbdb1f1c5 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Received event network-changed-619a1e09-7376-4439-a5bb-72a26f4865ad {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.compute.manager [req-93ede07d-dc9b-437d-accd-a855e02fe1ff req-ba5f8c50-dde2-41d3-a253-b28fbdb1f1c5 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Refreshing instance network info cache due to event network-changed-619a1e09-7376-4439-a5bb-72a26f4865ad. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-93ede07d-dc9b-437d-accd-a855e02fe1ff req-ba5f8c50-dde2-41d3-a253-b28fbdb1f1c5 service nova] Acquiring lock "refresh_cache-eec82dbf-d946-4aca-9320-8fd0c197e1c0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-93ede07d-dc9b-437d-accd-a855e02fe1ff req-ba5f8c50-dde2-41d3-a253-b28fbdb1f1c5 service nova] Acquired lock "refresh_cache-eec82dbf-d946-4aca-9320-8fd0c197e1c0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.network.neutron [req-93ede07d-dc9b-437d-accd-a855e02fe1ff req-ba5f8c50-dde2-41d3-a253-b28fbdb1f1c5 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Refreshing network info cache for port 619a1e09-7376-4439-a5bb-72a26f4865ad {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] End _get_guest_xml xml=<domain type="kvm">
Apr 12 11:03:12 user nova-compute[71557]:   <uuid>8a514b7a-d2a1-40d4-9b25-106a07771d72</uuid>
Apr 12 11:03:12 user nova-compute[71557]:   <name>instance-0000002e</name>
Apr 12 11:03:12 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 11:03:12 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 11:03:12 user nova-compute[71557]:   <metadata>
Apr 12 11:03:12 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 11:03:12 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 11:03:12 user nova-compute[71557]:       <nova:name>tempest-AttachVolumeTestJSON-server-2098924335</nova:name>
Apr 12 11:03:12 user nova-compute[71557]:       <nova:creationTime>2023-04-12 11:03:12</nova:creationTime>
Apr 12 11:03:12 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 11:03:12 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 11:03:12 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 11:03:12 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 11:03:12 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 11:03:12 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 11:03:12 user nova-compute[71557]:       </nova:flavor>
Apr 12 11:03:12 user nova-compute[71557]:       <nova:owner>
Apr 12 11:03:12 user nova-compute[71557]:         <nova:user uuid="f6576467073e41e9b497097d5a8dfd3d">tempest-AttachVolumeTestJSON-1953237893-project-member</nova:user>
Apr 12 11:03:12 user nova-compute[71557]:         <nova:project uuid="9878bfe34ceb4a6695b253ad161c4f7b">tempest-AttachVolumeTestJSON-1953237893</nova:project>
Apr 12 11:03:12 user nova-compute[71557]:       </nova:owner>
Apr 12 11:03:12 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 11:03:12 user nova-compute[71557]:       <nova:ports>
Apr 12 11:03:12 user nova-compute[71557]:         <nova:port uuid="23d8547c-bdb5-4646-ac12-1dfb693e9491">
Apr 12 11:03:12 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 11:03:12 user nova-compute[71557]:         </nova:port>
Apr 12 11:03:12 user nova-compute[71557]:       </nova:ports>
Apr 12 11:03:12 user nova-compute[71557]:     </nova:instance>
Apr 12 11:03:12 user nova-compute[71557]:   </metadata>
Apr 12 11:03:12 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 11:03:12 user nova-compute[71557]:     <system>
Apr 12 11:03:12 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 11:03:12 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 11:03:12 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 11:03:12 user nova-compute[71557]:       <entry name="serial">8a514b7a-d2a1-40d4-9b25-106a07771d72</entry>
Apr 12 11:03:12 user nova-compute[71557]:       <entry name="uuid">8a514b7a-d2a1-40d4-9b25-106a07771d72</entry>
Apr 12 11:03:12 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 11:03:12 user nova-compute[71557]:     </system>
Apr 12 11:03:12 user nova-compute[71557]:   </sysinfo>
Apr 12 11:03:12 user nova-compute[71557]:   <os>
Apr 12 11:03:12 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 11:03:12 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 11:03:12 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 11:03:12 user nova-compute[71557]:   </os>
Apr 12 11:03:12 user nova-compute[71557]:   <features>
Apr 12 11:03:12 user nova-compute[71557]:     <acpi/>
Apr 12 11:03:12 user nova-compute[71557]:     <apic/>
Apr 12 11:03:12 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 11:03:12 user nova-compute[71557]:   </features>
Apr 12 11:03:12 user nova-compute[71557]:   <clock offset="utc">
Apr 12 11:03:12 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 11:03:12 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 11:03:12 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 11:03:12 user nova-compute[71557]:   </clock>
Apr 12 11:03:12 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 11:03:12 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 11:03:12 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 11:03:12 user nova-compute[71557]:   </cpu>
Apr 12 11:03:12 user nova-compute[71557]:   <devices>
Apr 12 11:03:12 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 11:03:12 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 11:03:12 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/8a514b7a-d2a1-40d4-9b25-106a07771d72/disk"/>
Apr 12 11:03:12 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 11:03:12 user nova-compute[71557]:     </disk>
Apr 12 11:03:12 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 11:03:12 user nova-compute[71557]:       <mac address="fa:16:3e:2e:ca:09"/>
Apr 12 11:03:12 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 11:03:12 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 11:03:12 user nova-compute[71557]:       <target dev="tap23d8547c-bd"/>
Apr 12 11:03:12 user nova-compute[71557]:     </interface>
Apr 12 11:03:12 user nova-compute[71557]:     <serial type="pty">
Apr 12 11:03:12 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/8a514b7a-d2a1-40d4-9b25-106a07771d72/console.log" append="off"/>
Apr 12 11:03:12 user nova-compute[71557]:     </serial>
Apr 12 11:03:12 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 11:03:12 user nova-compute[71557]:     <video>
Apr 12 11:03:12 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 11:03:12 user nova-compute[71557]:     </video>
Apr 12 11:03:12 user nova-compute[71557]:     <rng model="virtio">
Apr 12 11:03:12 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 11:03:12 user nova-compute[71557]:     </rng>
Apr 12 11:03:12 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 11:03:12 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 11:03:12 user nova-compute[71557]:       <stats period="10"/>
Apr 12 11:03:12 user nova-compute[71557]:     </memballoon>
Apr 12 11:03:12 user nova-compute[71557]:   </devices>
Apr 12 11:03:12 user nova-compute[71557]: </domain>
Apr 12 11:03:12 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T11:03:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2098924335',display_name='tempest-AttachVolumeTestJSON-server-2098924335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2098924335',id=46,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNumieZsB8oe7GLTZgFC+G6r47EBCDso6tEsNDy7zRRdzpCxU2vuKELKugqdw77z7Fs89HUtjILuEicvB0lsORArcYlMG9UCGVeFqo7InCbLcoNREp0G6jUNvS1QG5UJSw==',key_name='tempest-keypair-1832184664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9878bfe34ceb4a6695b253ad161c4f7b',ramdisk_id='',reservation_id='r-wwk09v6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1953237893',owner_user_name='tempest-AttachVolumeTestJSON-1953237893-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T11:03:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6576467073e41e9b497097d5a8dfd3d',uuid=8a514b7a-d2a1-40d4-9b25-106a07771d72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "address": "fa:16:3e:2e:ca:09", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d8547c-bd", "ovs_interfaceid": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converting VIF {"id": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "address": "fa:16:3e:2e:ca:09", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d8547c-bd", "ovs_interfaceid": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ca:09,bridge_name='br-int',has_traffic_filtering=True,id=23d8547c-bdb5-4646-ac12-1dfb693e9491,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23d8547c-bd') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG os_vif [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ca:09,bridge_name='br-int',has_traffic_filtering=True,id=23d8547c-bdb5-4646-ac12-1dfb693e9491,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23d8547c-bd') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23d8547c-bd, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap23d8547c-bd, col_values=(('external_ids', {'iface-id': '23d8547c-bdb5-4646-ac12-1dfb693e9491', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:ca:09', 'vm-uuid': '8a514b7a-d2a1-40d4-9b25-106a07771d72'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:12 user nova-compute[71557]: INFO os_vif [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ca:09,bridge_name='br-int',has_traffic_filtering=True,id=23d8547c-bdb5-4646-ac12-1dfb693e9491,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23d8547c-bd')
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] No VIF found with MAC fa:16:3e:2e:ca:09, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:03:12 user nova-compute[71557]: INFO nova.compute.manager [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Terminating instance
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.compute.manager [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.network.neutron [req-383f1848-f51e-4247-858b-55037942c49a req-da7448ba-02a9-4e9f-b08f-9d7c78561ef0 service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Updated VIF entry in instance network info cache for port 23d8547c-bdb5-4646-ac12-1dfb693e9491. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG nova.network.neutron [req-383f1848-f51e-4247-858b-55037942c49a req-da7448ba-02a9-4e9f-b08f-9d7c78561ef0 service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Updating instance_info_cache with network_info: [{"id": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "address": "fa:16:3e:2e:ca:09", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d8547c-bd", "ovs_interfaceid": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-383f1848-f51e-4247-858b-55037942c49a req-da7448ba-02a9-4e9f-b08f-9d7c78561ef0 service nova] Releasing lock "refresh_cache-8a514b7a-d2a1-40d4-9b25-106a07771d72" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 11:03:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-41ff70db-d405-45d8-87a1-34a540bec7e0 req-1b0a3850-9a15-46a1-a61c-703672f00538 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Received event network-vif-unplugged-619a1e09-7376-4439-a5bb-72a26f4865ad {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:03:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-41ff70db-d405-45d8-87a1-34a540bec7e0 req-1b0a3850-9a15-46a1-a61c-703672f00538 service nova] Acquiring lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:03:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-41ff70db-d405-45d8-87a1-34a540bec7e0 req-1b0a3850-9a15-46a1-a61c-703672f00538 service nova] Lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:03:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-41ff70db-d405-45d8-87a1-34a540bec7e0 req-1b0a3850-9a15-46a1-a61c-703672f00538 service nova] Lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:03:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-41ff70db-d405-45d8-87a1-34a540bec7e0 req-1b0a3850-9a15-46a1-a61c-703672f00538 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] No waiting events found dispatching network-vif-unplugged-619a1e09-7376-4439-a5bb-72a26f4865ad {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:03:13 user nova-compute[71557]: DEBUG nova.compute.manager [req-41ff70db-d405-45d8-87a1-34a540bec7e0 req-1b0a3850-9a15-46a1-a61c-703672f00538 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Received event network-vif-unplugged-619a1e09-7376-4439-a5bb-72a26f4865ad for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 11:03:13 user nova-compute[71557]: DEBUG nova.network.neutron [req-93ede07d-dc9b-437d-accd-a855e02fe1ff req-ba5f8c50-dde2-41d3-a253-b28fbdb1f1c5 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Updated VIF entry in instance network info cache for port 619a1e09-7376-4439-a5bb-72a26f4865ad. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 11:03:13 user nova-compute[71557]: DEBUG nova.network.neutron [req-93ede07d-dc9b-437d-accd-a855e02fe1ff req-ba5f8c50-dde2-41d3-a253-b28fbdb1f1c5 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Updating instance_info_cache with network_info: [{"id": "619a1e09-7376-4439-a5bb-72a26f4865ad", "address": "fa:16:3e:30:0e:e5", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a1e09-73", "ovs_interfaceid": "619a1e09-7376-4439-a5bb-72a26f4865ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:03:13 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-93ede07d-dc9b-437d-accd-a855e02fe1ff req-ba5f8c50-dde2-41d3-a253-b28fbdb1f1c5 service nova] Releasing lock "refresh_cache-eec82dbf-d946-4aca-9320-8fd0c197e1c0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 11:03:13 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Instance destroyed successfully.
Apr 12 11:03:13 user nova-compute[71557]: DEBUG nova.objects.instance [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lazy-loading 'resources' on Instance uuid eec82dbf-d946-4aca-9320-8fd0c197e1c0 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:03:13 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T11:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1353198364',display_name='tempest-TestStampPattern-server-1353198364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1353198364',id=45,image_ref='7c91e395-34dd-4893-b9af-62553efd7311',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaPyHRbcEnu+5+do5qHU+1eCHNMIdz7T58VS5Bcnzn0CUjwp6yQ03Ax3lmuZopCNO8dTcA62ZaKwisDZe976PqRTMzRs8Ozd6zeLPjLajysiE4TI0dVucPHR8mu4N+YIQ==',key_name='tempest-TestStampPattern-1731935486',keypairs=<?>,launch_index=0,launched_at=2023-04-12T11:00:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a0f2b52a1a04769803c3a44a924ff00',ramdisk_id='',reservation_id='r-hl9ae9hm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='faf5e629-c914-43a1-bd73-ce4adfafe9d6',image_min_disk='1',image_min_ram='0',image_owner_id='4a0f2b52a1a04769803c3a44a924ff00',image_owner_project_name='tempest-TestStampPattern-1356820597',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1356820597-project-member',image_user_id='aed741675f5944f1882c097c411437f6',owner_project_name='tempest-TestStampPattern-1356820597',owner_user_name='tempest-TestStampPattern-1356820597-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T11:00:31Z,user_data=None,user_id='aed741675f5944f1882c097c411437f6',uuid=eec82dbf-d946-4aca-9320-8fd0c197e1c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "619a1e09-7376-4439-a5bb-72a26f4865ad", "address": "fa:16:3e:30:0e:e5", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a1e09-73", "ovs_interfaceid": "619a1e09-7376-4439-a5bb-72a26f4865ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 11:03:13 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Converting VIF {"id": "619a1e09-7376-4439-a5bb-72a26f4865ad", "address": "fa:16:3e:30:0e:e5", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap619a1e09-73", "ovs_interfaceid": "619a1e09-7376-4439-a5bb-72a26f4865ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 11:03:13 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:0e:e5,bridge_name='br-int',has_traffic_filtering=True,id=619a1e09-7376-4439-a5bb-72a26f4865ad,network=Network(b1da98cc-b18c-477c-9e03-df8190b944d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap619a1e09-73') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 11:03:13 user nova-compute[71557]: DEBUG os_vif [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:0e:e5,bridge_name='br-int',has_traffic_filtering=True,id=619a1e09-7376-4439-a5bb-72a26f4865ad,network=Network(b1da98cc-b18c-477c-9e03-df8190b944d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap619a1e09-73') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 11:03:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap619a1e09-73, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 11:03:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:03:13 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:13 user nova-compute[71557]: INFO os_vif [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:0e:e5,bridge_name='br-int',has_traffic_filtering=True,id=619a1e09-7376-4439-a5bb-72a26f4865ad,network=Network(b1da98cc-b18c-477c-9e03-df8190b944d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap619a1e09-73')
Apr 12 11:03:13 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Deleting instance files /opt/stack/data/nova/instances/eec82dbf-d946-4aca-9320-8fd0c197e1c0_del
Apr 12 11:03:13 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Deletion of /opt/stack/data/nova/instances/eec82dbf-d946-4aca-9320-8fd0c197e1c0_del complete
Apr 12 11:03:13 user nova-compute[71557]: INFO nova.compute.manager [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Took 1.33 seconds to destroy the instance on the hypervisor.
Apr 12 11:03:13 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 11:03:13 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 11:03:13 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 11:03:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:14 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:03:14 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Took 0.54 seconds to deallocate network for instance.
Apr 12 11:03:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-afc81fb1-70af-4983-9e4b-c9b8514e6176 req-8ac25556-9f92-4f6f-a180-0482a4728638 service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Received event network-vif-plugged-23d8547c-bdb5-4646-ac12-1dfb693e9491 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:03:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-afc81fb1-70af-4983-9e4b-c9b8514e6176 req-8ac25556-9f92-4f6f-a180-0482a4728638 service nova] Acquiring lock "8a514b7a-d2a1-40d4-9b25-106a07771d72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:03:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-afc81fb1-70af-4983-9e4b-c9b8514e6176 req-8ac25556-9f92-4f6f-a180-0482a4728638 service nova] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:03:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-afc81fb1-70af-4983-9e4b-c9b8514e6176 req-8ac25556-9f92-4f6f-a180-0482a4728638 service nova] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:03:14 user nova-compute[71557]: DEBUG nova.compute.manager [req-afc81fb1-70af-4983-9e4b-c9b8514e6176 req-8ac25556-9f92-4f6f-a180-0482a4728638 service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] No waiting events found dispatching network-vif-plugged-23d8547c-bdb5-4646-ac12-1dfb693e9491 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:03:14 user nova-compute[71557]: WARNING nova.compute.manager [req-afc81fb1-70af-4983-9e4b-c9b8514e6176 req-8ac25556-9f92-4f6f-a180-0482a4728638 service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Received unexpected event network-vif-plugged-23d8547c-bdb5-4646-ac12-1dfb693e9491 for instance with vm_state building and task_state spawning.
Apr 12 11:03:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:03:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:03:14 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 11:03:14 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 11:03:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.210s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:03:14 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Deleted allocations for instance eec82dbf-d946-4aca-9320-8fd0c197e1c0
Apr 12 11:03:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:14 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-90a41a22-113d-42af-898b-068d2c4ce056 tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.291s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:03:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-7ce7540d-2299-4bbc-be90-b76c208c57ac req-73d184f7-b4db-4add-91af-f3a0837f3772 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Received event network-vif-plugged-619a1e09-7376-4439-a5bb-72a26f4865ad {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:03:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7ce7540d-2299-4bbc-be90-b76c208c57ac req-73d184f7-b4db-4add-91af-f3a0837f3772 service nova] Acquiring lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:03:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7ce7540d-2299-4bbc-be90-b76c208c57ac req-73d184f7-b4db-4add-91af-f3a0837f3772 service nova] Lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:03:15 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-7ce7540d-2299-4bbc-be90-b76c208c57ac req-73d184f7-b4db-4add-91af-f3a0837f3772 service nova] Lock "eec82dbf-d946-4aca-9320-8fd0c197e1c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:03:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-7ce7540d-2299-4bbc-be90-b76c208c57ac req-73d184f7-b4db-4add-91af-f3a0837f3772 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] No waiting events found dispatching network-vif-plugged-619a1e09-7376-4439-a5bb-72a26f4865ad {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:03:15 user nova-compute[71557]: WARNING nova.compute.manager [req-7ce7540d-2299-4bbc-be90-b76c208c57ac req-73d184f7-b4db-4add-91af-f3a0837f3772 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Received unexpected event network-vif-plugged-619a1e09-7376-4439-a5bb-72a26f4865ad for instance with vm_state deleted and task_state None.
Apr 12 11:03:15 user nova-compute[71557]: DEBUG nova.compute.manager [req-7ce7540d-2299-4bbc-be90-b76c208c57ac req-73d184f7-b4db-4add-91af-f3a0837f3772 service nova] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Received event network-vif-deleted-619a1e09-7376-4439-a5bb-72a26f4865ad {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:03:16 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681297396.5734591, 8a514b7a-d2a1-40d4-9b25-106a07771d72 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 11:03:16 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] VM Resumed (Lifecycle Event)
Apr 12 11:03:16 user nova-compute[71557]: DEBUG nova.compute.manager [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 11:03:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 11:03:16 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Instance spawned successfully.
Apr 12 11:03:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 11:03:16 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 11:03:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-81dca92b-2f99-4aa1-a2e7-7d979a92f334 req-9eb632bb-ed65-4a29-831e-30481dddd82d service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Received event network-vif-plugged-23d8547c-bdb5-4646-ac12-1dfb693e9491 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:03:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-81dca92b-2f99-4aa1-a2e7-7d979a92f334 req-9eb632bb-ed65-4a29-831e-30481dddd82d service nova] Acquiring lock "8a514b7a-d2a1-40d4-9b25-106a07771d72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:03:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-81dca92b-2f99-4aa1-a2e7-7d979a92f334 req-9eb632bb-ed65-4a29-831e-30481dddd82d service nova] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:03:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-81dca92b-2f99-4aa1-a2e7-7d979a92f334 req-9eb632bb-ed65-4a29-831e-30481dddd82d service nova] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:03:16 user nova-compute[71557]: DEBUG nova.compute.manager [req-81dca92b-2f99-4aa1-a2e7-7d979a92f334 req-9eb632bb-ed65-4a29-831e-30481dddd82d service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] No waiting events found dispatching network-vif-plugged-23d8547c-bdb5-4646-ac12-1dfb693e9491 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:03:16 user nova-compute[71557]: WARNING nova.compute.manager [req-81dca92b-2f99-4aa1-a2e7-7d979a92f334 req-9eb632bb-ed65-4a29-831e-30481dddd82d service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Received unexpected event network-vif-plugged-23d8547c-bdb5-4646-ac12-1dfb693e9491 for instance with vm_state building and task_state spawning.
Apr 12 11:03:16 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 11:03:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 11:03:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 11:03:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 11:03:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 11:03:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 11:03:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 11:03:16 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 11:03:16 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681297396.5763707, 8a514b7a-d2a1-40d4-9b25-106a07771d72 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 11:03:16 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] VM Started (Lifecycle Event)
Apr 12 11:03:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:16 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 11:03:16 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 11:03:16 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 11:03:16 user nova-compute[71557]: INFO nova.compute.manager [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Took 6.01 seconds to spawn the instance on the hypervisor.
Apr 12 11:03:16 user nova-compute[71557]: DEBUG nova.compute.manager [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 11:03:16 user nova-compute[71557]: INFO nova.compute.manager [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Took 6.55 seconds to build instance.
Apr 12 11:03:16 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-620832ef-a8f2-4152-8478-8934ccfaf83b tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.643s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:03:18 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:23 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:28 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681297393.8773544, eec82dbf-d946-4aca-9320-8fd0c197e1c0 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 11:03:28 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] VM Stopped (Lifecycle Event)
Apr 12 11:03:28 user nova-compute[71557]: DEBUG nova.compute.manager [None req-ba932f1c-93d7-4e65-ba37-4f8d0a0fddfa None None] [instance: eec82dbf-d946-4aca-9320-8fd0c197e1c0] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 11:03:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:03:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:03:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:03:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:03:28 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:03:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:03:28 user nova-compute[71557]: DEBUG nova.objects.instance [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lazy-loading 'flavor' on Instance uuid ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:03:28 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:03:29 user nova-compute[71557]: INFO nova.compute.manager [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Attaching volume 44c78380-6960-40b7-bcdd-3652330d3004 to /dev/vdb
Apr 12 11:03:29 user nova-compute[71557]: DEBUG os_brick.utils [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bce733a-3de1-4af1-b0ce-26c3d8a4b857]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4e887e-147b-4422-8388-7519f00bcf3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ff67b3-9f7c-4eaf-9d66-fbe8a6e7971a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c72c9c-e47b-47d5-bbe8-7155a745aaae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 11:03:29 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 11:03:29 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a0637f-49be-4a49-aaa6-c9507d082dcd]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG os_brick.utils [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Updating existing volume attachment record: 33ed5435-4db3-4987-8942-fcb44473655c {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 11:03:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaqCpchS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:03:33 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:03:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:03:33 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:03:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:03:33 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 11:03:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9a132c-8159-4614-a905-5790141439b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 11:03:33 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f05357-5e22-4107-ab35-418487b1e444]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004] added
Apr 12 11:03:33 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af4f921-8cd0-4990-978b-1f028ed89f3d]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3425116f-be7d-4f09-a2e1-63869a5f928e]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yaqCpchS {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yaqCpchS" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac5723e-e726-4674-8ebb-85d8cd54abd5]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yaqCpchS'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c4bcdf-d645-46a8-a349-04d30a723fa0]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d6737c-b45a-4e4f-a674-961e7bb7b61d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 11:03:33 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:03:33 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 11:03:33 user nova-compute[71557]:  {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:03:33 user nova-compute[71557]: WARNING os_brick.initiator.connectors.iscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 11:03:33 user nova-compute[71557]: 
Apr 12 11:03:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66b57e3-a3b9-444d-9ecf-5a71bc38774d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004, portal: 172.16.0.220,3260]
Apr 12 11:03:34 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004, portal: 172.16.0.220,3260] successful.
Apr 12 11:03:34 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:03:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[65aa13b0-c3df-4f0f-962a-4cfeac6beca6]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:03:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c53d1e1-a3d7-4ab3-a061-1326951faa07]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 (non-flash)
Apr 12 11:03:34 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:03:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 (non-flash)
Apr 12 11:03:34 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:03:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:03:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 11:03:34 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 11:03:34 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 11:03:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:34 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:34 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9478295c-e97c-4166-80d0-f508b8594fc8]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:34 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 11:03:34 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaqCpchS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 11:03:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:03:35 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23966323430346366', 'path': '/dev/sdb'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:03:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966323430346366', 'path': '/dev/sdb'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 11:03:35 user nova-compute[71557]: DEBUG nova.objects.instance [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lazy-loading 'flavor' on Instance uuid ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:03:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 11:03:35 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 11:03:35 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 11:03:35 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 11:03:35 user nova-compute[71557]:   <serial>44c78380-6960-40b7-bcdd-3652330d3004</serial>
Apr 12 11:03:35 user nova-compute[71557]: </disk>
Apr 12 11:03:35 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 11:03:35 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:03:35 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 11:03:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 11:03:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 11:03:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] No VIF found with MAC fa:16:3e:f5:af:c7, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 11:03:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-ea615c20-7886-4a32-b0a5-0c2aadcb2777 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.563s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:03:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:03:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:03:37 user nova-compute[71557]: INFO nova.compute.manager [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Detaching volume 44c78380-6960-40b7-bcdd-3652330d3004
Apr 12 11:03:37 user nova-compute[71557]: INFO nova.virt.block_device [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Attempting to driver detach volume 44c78380-6960-40b7-bcdd-3652330d3004 from mountpoint /dev/vdb
Apr 12 11:03:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Attempting to detach device vdb from instance ca545a0c-89fd-4a04-9d87-c2698051ca87 from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 11:03:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 11:03:37 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 11:03:37 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 11:03:37 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 11:03:37 user nova-compute[71557]:   <serial>44c78380-6960-40b7-bcdd-3652330d3004</serial>
Apr 12 11:03:37 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 11:03:37 user nova-compute[71557]: </disk>
Apr 12 11:03:37 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 11:03:37 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Successfully detached device vdb from instance ca545a0c-89fd-4a04-9d87-c2698051ca87 from the persistent domain config.
Apr 12 11:03:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ca545a0c-89fd-4a04-9d87-c2698051ca87 from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 11:03:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 11:03:37 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 11:03:37 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 11:03:37 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 11:03:37 user nova-compute[71557]:   <serial>44c78380-6960-40b7-bcdd-3652330d3004</serial>
Apr 12 11:03:37 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 11:03:37 user nova-compute[71557]: </disk>
Apr 12 11:03:37 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681297418.043832, ca545a0c-89fd-4a04-9d87-c2698051ca87 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 11:03:38 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Successfully detached device vdb from instance ca545a0c-89fd-4a04-9d87-c2698051ca87 from the live domain config.
Apr 12 11:03:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaqCpchS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:03:38 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:03:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a287ef0e-7f1b-46c4-92a9-8aa975eb2ed8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 11:03:38 user nova-compute[71557]: No targets found.
Apr 12 11:03:38 user nova-compute[71557]: iSNS:
Apr 12 11:03:38 user nova-compute[71557]: No targets found.
Apr 12 11:03:38 user nova-compute[71557]: STATIC:
Apr 12 11:03:38 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004
Apr 12 11:03:38 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 11:03:38 user nova-compute[71557]:                 Iface Name: default
Apr 12 11:03:38 user nova-compute[71557]: FIRMWARE:
Apr 12 11:03:38 user nova-compute[71557]: No targets found.
Apr 12 11:03:38 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 11:03:38 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 11:03:38 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[70206227-a4c3-4934-9a64-804de5382b2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[074dc6c6-5745-4185-8f4e-a60357d462eb]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 (non-flash)
Apr 12 11:03:38 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 (non-flash)
Apr 12 11:03:38 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fc42393f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004'): ({'sdb'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Removing single pathed devices sdb {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[329d4902-5205-4428-835f-f115cd3c6a7c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ebd42b-59ec-4417-a270-dac1e161c9d8]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Flushing IO for device /dev/sdb {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3dc62b-5fde-436a-ba92-5662cf452167]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d4cd11-1be2-4787-b3b9-6a49e5caa0eb]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bb8500-ebbf-4a02-8129-0d28ec57d550]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbef849f-60cf-49fa-aaae-5981a6e2da23]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004, portal: 172.16.0.220,3260]
Apr 12 11:03:38 user nova-compute[71557]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004, portal: 172.16.0.220,3260] successful.
Apr 12 11:03:38 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44c78380-6960-40b7-bcdd-3652330d3004 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bb3026-6561-4fe7-b1c0-364f6e15f1c8]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] <== disconnect_volume: return (270ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 11:03:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:39 user nova-compute[71557]: DEBUG nova.objects.instance [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lazy-loading 'flavor' on Instance uuid ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:03:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-b8a26c5e-29db-4762-bdc3-5e97f2ad3377 tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.650s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:03:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:41 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:03:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:03:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:03:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:03:41 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 11:03:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a514b7a-d2a1-40d4-9b25-106a07771d72/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a514b7a-d2a1-40d4-9b25-106a07771d72/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a514b7a-d2a1-40d4-9b25-106a07771d72/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:41 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a514b7a-d2a1-40d4-9b25-106a07771d72/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:42 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:42 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:42 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:03:42 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:03:42 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:03:42 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:03:42 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=8483MB free_disk=26.052825927734375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 11:03:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:03:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:03:42 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance faf5e629-c914-43a1-bd73-ce4adfafe9d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 11:03:42 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance ca545a0c-89fd-4a04-9d87-c2698051ca87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 11:03:42 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 11:03:42 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 11:03:42 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 11:03:42 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 11:03:42 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 11:03:43 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 11:03:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:03:43 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:44 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:03:44 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:03:44 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 11:03:44 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Didn't find any instances for network info cache update. {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 11:03:44 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:03:44 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:03:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:45 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:03:46 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:03:48 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:03:48 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:53 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:03:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:03:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:03:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:03:58 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:03:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:04:03 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:04:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:04:08 user nova-compute[71557]: DEBUG nova.compute.manager [req-00c0f9ce-42b1-4deb-8de5-d579716e69ae req-13be1b9f-329f-4794-a0f6-47c37241e6a4 service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Received event network-changed-f43a5f64-a4b2-481b-9785-6a556a795d0a {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:04:08 user nova-compute[71557]: DEBUG nova.compute.manager [req-00c0f9ce-42b1-4deb-8de5-d579716e69ae req-13be1b9f-329f-4794-a0f6-47c37241e6a4 service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Refreshing instance network info cache due to event network-changed-f43a5f64-a4b2-481b-9785-6a556a795d0a. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 11:04:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-00c0f9ce-42b1-4deb-8de5-d579716e69ae req-13be1b9f-329f-4794-a0f6-47c37241e6a4 service nova] Acquiring lock "refresh_cache-faf5e629-c914-43a1-bd73-ce4adfafe9d6" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 11:04:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-00c0f9ce-42b1-4deb-8de5-d579716e69ae req-13be1b9f-329f-4794-a0f6-47c37241e6a4 service nova] Acquired lock "refresh_cache-faf5e629-c914-43a1-bd73-ce4adfafe9d6" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 11:04:08 user nova-compute[71557]: DEBUG nova.network.neutron [req-00c0f9ce-42b1-4deb-8de5-d579716e69ae req-13be1b9f-329f-4794-a0f6-47c37241e6a4 service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Refreshing network info cache for port f43a5f64-a4b2-481b-9785-6a556a795d0a {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 11:04:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:04:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:04:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:04:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:04:08 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:04:08 user nova-compute[71557]: INFO nova.compute.manager [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Terminating instance
Apr 12 11:04:08 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 11:04:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:04:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:04:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:04:08 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:04:09 user nova-compute[71557]: DEBUG nova.network.neutron [req-00c0f9ce-42b1-4deb-8de5-d579716e69ae req-13be1b9f-329f-4794-a0f6-47c37241e6a4 service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Updated VIF entry in instance network info cache for port f43a5f64-a4b2-481b-9785-6a556a795d0a. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 11:04:09 user nova-compute[71557]: DEBUG nova.network.neutron [req-00c0f9ce-42b1-4deb-8de5-d579716e69ae req-13be1b9f-329f-4794-a0f6-47c37241e6a4 service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Updating instance_info_cache with network_info: [{"id": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "address": "fa:16:3e:f6:ad:69", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a5f64-a4", "ovs_interfaceid": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:04:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-00c0f9ce-42b1-4deb-8de5-d579716e69ae req-13be1b9f-329f-4794-a0f6-47c37241e6a4 service nova] Releasing lock "refresh_cache-faf5e629-c914-43a1-bd73-ce4adfafe9d6" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 11:04:09 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Instance destroyed successfully.
Apr 12 11:04:09 user nova-compute[71557]: DEBUG nova.objects.instance [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lazy-loading 'resources' on Instance uuid faf5e629-c914-43a1-bd73-ce4adfafe9d6 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:04:09 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:57:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1949196284',display_name='tempest-TestStampPattern-server-1949196284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1949196284',id=41,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaPyHRbcEnu+5+do5qHU+1eCHNMIdz7T58VS5Bcnzn0CUjwp6yQ03Ax3lmuZopCNO8dTcA62ZaKwisDZe976PqRTMzRs8Ozd6zeLPjLajysiE4TI0dVucPHR8mu4N+YIQ==',key_name='tempest-TestStampPattern-1731935486',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:57:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a0f2b52a1a04769803c3a44a924ff00',ramdisk_id='',reservation_id='r-nw28101f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1356820597',owner_user_name='tempest-TestStampPattern-1356820597-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T11:00:17Z,user_data=None,user_id='aed741675f5944f1882c097c411437f6',uuid=faf5e629-c914-43a1-bd73-ce4adfafe9d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "address": "fa:16:3e:f6:ad:69", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a5f64-a4", "ovs_interfaceid": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 11:04:09 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Converting VIF {"id": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "address": "fa:16:3e:f6:ad:69", "network": {"id": "b1da98cc-b18c-477c-9e03-df8190b944d1", "bridge": "br-int", "label": "tempest-TestStampPattern-1831797344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a0f2b52a1a04769803c3a44a924ff00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43a5f64-a4", "ovs_interfaceid": "f43a5f64-a4b2-481b-9785-6a556a795d0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 11:04:09 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:ad:69,bridge_name='br-int',has_traffic_filtering=True,id=f43a5f64-a4b2-481b-9785-6a556a795d0a,network=Network(b1da98cc-b18c-477c-9e03-df8190b944d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43a5f64-a4') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 11:04:09 user nova-compute[71557]: DEBUG os_vif [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:ad:69,bridge_name='br-int',has_traffic_filtering=True,id=f43a5f64-a4b2-481b-9785-6a556a795d0a,network=Network(b1da98cc-b18c-477c-9e03-df8190b944d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43a5f64-a4') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 11:04:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:04:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf43a5f64-a4, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 11:04:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:04:09 user nova-compute[71557]: INFO os_vif [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:ad:69,bridge_name='br-int',has_traffic_filtering=True,id=f43a5f64-a4b2-481b-9785-6a556a795d0a,network=Network(b1da98cc-b18c-477c-9e03-df8190b944d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43a5f64-a4')
Apr 12 11:04:09 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Deleting instance files /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6_del
Apr 12 11:04:09 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Deletion of /opt/stack/data/nova/instances/faf5e629-c914-43a1-bd73-ce4adfafe9d6_del complete
Apr 12 11:04:09 user nova-compute[71557]: INFO nova.compute.manager [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 12 11:04:09 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 11:04:09 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 11:04:09 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 11:04:10 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:04:10 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Took 0.48 seconds to deallocate network for instance.
Apr 12 11:04:10 user nova-compute[71557]: DEBUG nova.compute.manager [req-5b1f81c0-6b03-4ec8-8cb7-28d3b1cda49b req-47f8f276-e6fd-4472-ba75-01c9cca372c3 service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Received event network-vif-deleted-f43a5f64-a4b2-481b-9785-6a556a795d0a {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:04:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:04:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:04:10 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 11:04:10 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 11:04:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:04:10 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Deleted allocations for instance faf5e629-c914-43a1-bd73-ce4adfafe9d6
Apr 12 11:04:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f8643022-f866-44df-b5ec-102c165aecfc tempest-TestStampPattern-1356820597 tempest-TestStampPattern-1356820597-project-member] Lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.658s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:04:10 user nova-compute[71557]: DEBUG nova.compute.manager [req-266b972e-f1d6-46cc-afd1-a738d6e5366b req-6272844c-642a-4a91-8927-38a6da59124d service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Received event network-vif-unplugged-f43a5f64-a4b2-481b-9785-6a556a795d0a {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:04:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-266b972e-f1d6-46cc-afd1-a738d6e5366b req-6272844c-642a-4a91-8927-38a6da59124d service nova] Acquiring lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:04:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-266b972e-f1d6-46cc-afd1-a738d6e5366b req-6272844c-642a-4a91-8927-38a6da59124d service nova] Lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:04:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-266b972e-f1d6-46cc-afd1-a738d6e5366b req-6272844c-642a-4a91-8927-38a6da59124d service nova] Lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:04:10 user nova-compute[71557]: DEBUG nova.compute.manager [req-266b972e-f1d6-46cc-afd1-a738d6e5366b req-6272844c-642a-4a91-8927-38a6da59124d service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] No waiting events found dispatching network-vif-unplugged-f43a5f64-a4b2-481b-9785-6a556a795d0a {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:04:10 user nova-compute[71557]: WARNING nova.compute.manager [req-266b972e-f1d6-46cc-afd1-a738d6e5366b req-6272844c-642a-4a91-8927-38a6da59124d service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Received unexpected event network-vif-unplugged-f43a5f64-a4b2-481b-9785-6a556a795d0a for instance with vm_state deleted and task_state None.
Apr 12 11:04:10 user nova-compute[71557]: DEBUG nova.compute.manager [req-266b972e-f1d6-46cc-afd1-a738d6e5366b req-6272844c-642a-4a91-8927-38a6da59124d service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Received event network-vif-plugged-f43a5f64-a4b2-481b-9785-6a556a795d0a {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:04:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-266b972e-f1d6-46cc-afd1-a738d6e5366b req-6272844c-642a-4a91-8927-38a6da59124d service nova] Acquiring lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:04:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-266b972e-f1d6-46cc-afd1-a738d6e5366b req-6272844c-642a-4a91-8927-38a6da59124d service nova] Lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:04:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-266b972e-f1d6-46cc-afd1-a738d6e5366b req-6272844c-642a-4a91-8927-38a6da59124d service nova] Lock "faf5e629-c914-43a1-bd73-ce4adfafe9d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:04:10 user nova-compute[71557]: DEBUG nova.compute.manager [req-266b972e-f1d6-46cc-afd1-a738d6e5366b req-6272844c-642a-4a91-8927-38a6da59124d service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] No waiting events found dispatching network-vif-plugged-f43a5f64-a4b2-481b-9785-6a556a795d0a {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:04:10 user nova-compute[71557]: WARNING nova.compute.manager [req-266b972e-f1d6-46cc-afd1-a738d6e5366b req-6272844c-642a-4a91-8927-38a6da59124d service nova] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Received unexpected event network-vif-plugged-f43a5f64-a4b2-481b-9785-6a556a795d0a for instance with vm_state deleted and task_state None.
Apr 12 11:04:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:04:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:04:24 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681297449.4750698, faf5e629-c914-43a1-bd73-ce4adfafe9d6 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 11:04:24 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] VM Stopped (Lifecycle Event)
Apr 12 11:04:24 user nova-compute[71557]: DEBUG nova.compute.manager [None req-cd9f4649-196c-4655-b310-45cd1e993b71 None None] [instance: faf5e629-c914-43a1-bd73-ce4adfafe9d6] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 11:04:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:04:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:04:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:04:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:04:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:04:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:04:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:04:29 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:04:34 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:04:37 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:04:37 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 11:04:38 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:04:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:04:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-1a91396a-af96-4786-ba36-51dda3d1314f req-a29abe8f-5ea0-4128-836e-8cb6cfde57c3 service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Received event network-changed-4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:04:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-1a91396a-af96-4786-ba36-51dda3d1314f req-a29abe8f-5ea0-4128-836e-8cb6cfde57c3 service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Refreshing instance network info cache due to event network-changed-4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 11:04:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-1a91396a-af96-4786-ba36-51dda3d1314f req-a29abe8f-5ea0-4128-836e-8cb6cfde57c3 service nova] Acquiring lock "refresh_cache-ca545a0c-89fd-4a04-9d87-c2698051ca87" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 11:04:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-1a91396a-af96-4786-ba36-51dda3d1314f req-a29abe8f-5ea0-4128-836e-8cb6cfde57c3 service nova] Acquired lock "refresh_cache-ca545a0c-89fd-4a04-9d87-c2698051ca87" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 11:04:41 user nova-compute[71557]: DEBUG nova.network.neutron [req-1a91396a-af96-4786-ba36-51dda3d1314f req-a29abe8f-5ea0-4128-836e-8cb6cfde57c3 service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Refreshing network info cache for port 4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 11:04:42 user nova-compute[71557]: DEBUG nova.network.neutron [req-1a91396a-af96-4786-ba36-51dda3d1314f req-a29abe8f-5ea0-4128-836e-8cb6cfde57c3 service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Updated VIF entry in instance network info cache for port 4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 11:04:42 user nova-compute[71557]: DEBUG nova.network.neutron [req-1a91396a-af96-4786-ba36-51dda3d1314f req-a29abe8f-5ea0-4128-836e-8cb6cfde57c3 service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Updating instance_info_cache with network_info: [{"id": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "address": "fa:16:3e:f5:af:c7", "network": {"id": "5335fcd4-c9ce-4288-a2e9-4e9a1da25000", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612126582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7541fb4f462b438dbef4ffe9be4725b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4aee7d-5b", "ovs_interfaceid": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:04:42 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-1a91396a-af96-4786-ba36-51dda3d1314f req-a29abe8f-5ea0-4128-836e-8cb6cfde57c3 service nova] Releasing lock "refresh_cache-ca545a0c-89fd-4a04-9d87-c2698051ca87" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 11:04:43 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:04:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:04:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:04:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:04:43 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 11:04:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:04:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:04:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:04:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:04:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a514b7a-d2a1-40d4-9b25-106a07771d72/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:04:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a514b7a-d2a1-40d4-9b25-106a07771d72/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:04:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a514b7a-d2a1-40d4-9b25-106a07771d72/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:04:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:04:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:04:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "ca545a0c-89fd-4a04-9d87-c2698051ca87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:04:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:04:43 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:04:43 user nova-compute[71557]: INFO nova.compute.manager [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Terminating instance
Apr 12 11:04:43 user nova-compute[71557]: DEBUG nova.compute.manager [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 11:04:43 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a514b7a-d2a1-40d4-9b25-106a07771d72/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-cb02ffff-eab1-467d-a209-d733a52796b9 req-ca0580f3-4c94-4046-9602-d6088d7d8053 service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Received event network-vif-unplugged-4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cb02ffff-eab1-467d-a209-d733a52796b9 req-ca0580f3-4c94-4046-9602-d6088d7d8053 service nova] Acquiring lock "ca545a0c-89fd-4a04-9d87-c2698051ca87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cb02ffff-eab1-467d-a209-d733a52796b9 req-ca0580f3-4c94-4046-9602-d6088d7d8053 service nova] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-cb02ffff-eab1-467d-a209-d733a52796b9 req-ca0580f3-4c94-4046-9602-d6088d7d8053 service nova] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-cb02ffff-eab1-467d-a209-d733a52796b9 req-ca0580f3-4c94-4046-9602-d6088d7d8053 service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] No waiting events found dispatching network-vif-unplugged-4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG nova.compute.manager [req-cb02ffff-eab1-467d-a209-d733a52796b9 req-ca0580f3-4c94-4046-9602-d6088d7d8053 service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Received event network-vif-unplugged-4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 11:04:44 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:04:44 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:04:44 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=8569MB free_disk=26.143268585205078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:04:44 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Instance destroyed successfully.
Apr 12 11:04:44 user nova-compute[71557]: DEBUG nova.objects.instance [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lazy-loading 'resources' on Instance uuid ca545a0c-89fd-4a04-9d87-c2698051ca87 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T10:58:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-889710473',display_name='tempest-SnapshotDataIntegrityTests-server-889710473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-889710473',id=43,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBwO2yVN0u4XlGH0M6pDTSgYUXsaaLN0zeC0aV1LGDSj49QfeGZM69qUPGAnK7OxkSIagJ6xwwO/GKxzZp+RcnTTv3Y+zrrV1Kux6mF8yggHb85/hY7NtDL0hDRxifjmA==',key_name='tempest-SnapshotDataIntegrityTests-1583885298',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:58:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7541fb4f462b438dbef4ffe9be4725b5',ramdisk_id='',reservation_id='r-tlbyc3fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1196660338',owner_user_name='tempest-SnapshotDataIntegrityTests-1196660338-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:58:30Z,user_data=None,user_id='325a0abaf7b6485ca97e2d2af2bc9778',uuid=ca545a0c-89fd-4a04-9d87-c2698051ca87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "address": "fa:16:3e:f5:af:c7", "network": {"id": "5335fcd4-c9ce-4288-a2e9-4e9a1da25000", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612126582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7541fb4f462b438dbef4ffe9be4725b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4aee7d-5b", "ovs_interfaceid": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Converting VIF {"id": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "address": "fa:16:3e:f5:af:c7", "network": {"id": "5335fcd4-c9ce-4288-a2e9-4e9a1da25000", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1612126582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7541fb4f462b438dbef4ffe9be4725b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4aee7d-5b", "ovs_interfaceid": "4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:af:c7,bridge_name='br-int',has_traffic_filtering=True,id=4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74,network=Network(5335fcd4-c9ce-4288-a2e9-4e9a1da25000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4aee7d-5b') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG os_vif [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:af:c7,bridge_name='br-int',has_traffic_filtering=True,id=4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74,network=Network(5335fcd4-c9ce-4288-a2e9-4e9a1da25000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4aee7d-5b') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d4aee7d-5b, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:04:44 user nova-compute[71557]: INFO os_vif [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:af:c7,bridge_name='br-int',has_traffic_filtering=True,id=4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74,network=Network(5335fcd4-c9ce-4288-a2e9-4e9a1da25000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4aee7d-5b')
Apr 12 11:04:44 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Deleting instance files /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87_del
Apr 12 11:04:44 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Deletion of /opt/stack/data/nova/instances/ca545a0c-89fd-4a04-9d87-c2698051ca87_del complete
Apr 12 11:04:44 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance ca545a0c-89fd-4a04-9d87-c2698051ca87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 11:04:44 user nova-compute[71557]: INFO nova.compute.manager [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 12 11:04:44 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 11:04:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:04:45 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:04:45 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Took 0.55 seconds to deallocate network for instance.
Apr 12 11:04:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:04:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:04:45 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 11:04:45 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 11:04:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:04:45 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Deleted allocations for instance ca545a0c-89fd-4a04-9d87-c2698051ca87
Apr 12 11:04:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-3c1f255f-9123-4e90-bd19-245411355ccf tempest-SnapshotDataIntegrityTests-1196660338 tempest-SnapshotDataIntegrityTests-1196660338-project-member] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.766s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:04:45 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:04:45 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:04:45 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 11:04:45 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Rebuilding the list of instances to heal {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 11:04:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-8a514b7a-d2a1-40d4-9b25-106a07771d72" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 11:04:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-8a514b7a-d2a1-40d4-9b25-106a07771d72" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 11:04:45 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 11:04:45 user nova-compute[71557]: DEBUG nova.objects.instance [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lazy-loading 'info_cache' on Instance uuid 8a514b7a-d2a1-40d4-9b25-106a07771d72 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:04:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-bcdc03d5-f920-4dc7-99fd-8f958bbf84b2 req-c8d0dc47-b1e9-4347-8150-795e02e401cc service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Received event network-vif-plugged-4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:04:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bcdc03d5-f920-4dc7-99fd-8f958bbf84b2 req-c8d0dc47-b1e9-4347-8150-795e02e401cc service nova] Acquiring lock "ca545a0c-89fd-4a04-9d87-c2698051ca87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:04:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bcdc03d5-f920-4dc7-99fd-8f958bbf84b2 req-c8d0dc47-b1e9-4347-8150-795e02e401cc service nova] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:04:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bcdc03d5-f920-4dc7-99fd-8f958bbf84b2 req-c8d0dc47-b1e9-4347-8150-795e02e401cc service nova] Lock "ca545a0c-89fd-4a04-9d87-c2698051ca87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:04:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-bcdc03d5-f920-4dc7-99fd-8f958bbf84b2 req-c8d0dc47-b1e9-4347-8150-795e02e401cc service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] No waiting events found dispatching network-vif-plugged-4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:04:46 user nova-compute[71557]: WARNING nova.compute.manager [req-bcdc03d5-f920-4dc7-99fd-8f958bbf84b2 req-c8d0dc47-b1e9-4347-8150-795e02e401cc service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Received unexpected event network-vif-plugged-4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 for instance with vm_state deleted and task_state None.
Apr 12 11:04:46 user nova-compute[71557]: DEBUG nova.compute.manager [req-bcdc03d5-f920-4dc7-99fd-8f958bbf84b2 req-c8d0dc47-b1e9-4347-8150-795e02e401cc service nova] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Received event network-vif-deleted-4d4aee7d-5bf6-4d20-8d10-1d57e0c1fb74 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:04:46 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Updating instance_info_cache with network_info: [{"id": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "address": "fa:16:3e:2e:ca:09", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d8547c-bd", "ovs_interfaceid": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:04:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-8a514b7a-d2a1-40d4-9b25-106a07771d72" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 11:04:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 11:04:46 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:04:46 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:04:46 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:04:46 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:04:49 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:04:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:04:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:04:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:04:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:04:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:04:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:04:59 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681297484.7088175, ca545a0c-89fd-4a04-9d87-c2698051ca87 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 11:04:59 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] VM Stopped (Lifecycle Event)
Apr 12 11:04:59 user nova-compute[71557]: DEBUG nova.compute.manager [None req-71bdacf9-1ea5-4728-9f36-33a0994adc3b None None] [instance: ca545a0c-89fd-4a04-9d87-c2698051ca87] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 11:04:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:05:01 user nova-compute[71557]: DEBUG nova.compute.manager [req-15d0d78e-39bd-4303-a879-deb277dbf732 req-07849d74-bc41-490c-82a2-3e4015ca605b service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Received event network-changed-23d8547c-bdb5-4646-ac12-1dfb693e9491 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:05:01 user nova-compute[71557]: DEBUG nova.compute.manager [req-15d0d78e-39bd-4303-a879-deb277dbf732 req-07849d74-bc41-490c-82a2-3e4015ca605b service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Refreshing instance network info cache due to event network-changed-23d8547c-bdb5-4646-ac12-1dfb693e9491. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 11:05:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-15d0d78e-39bd-4303-a879-deb277dbf732 req-07849d74-bc41-490c-82a2-3e4015ca605b service nova] Acquiring lock "refresh_cache-8a514b7a-d2a1-40d4-9b25-106a07771d72" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 11:05:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-15d0d78e-39bd-4303-a879-deb277dbf732 req-07849d74-bc41-490c-82a2-3e4015ca605b service nova] Acquired lock "refresh_cache-8a514b7a-d2a1-40d4-9b25-106a07771d72" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 11:05:01 user nova-compute[71557]: DEBUG nova.network.neutron [req-15d0d78e-39bd-4303-a879-deb277dbf732 req-07849d74-bc41-490c-82a2-3e4015ca605b service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Refreshing network info cache for port 23d8547c-bdb5-4646-ac12-1dfb693e9491 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 11:05:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:01 user nova-compute[71557]: DEBUG nova.network.neutron [req-15d0d78e-39bd-4303-a879-deb277dbf732 req-07849d74-bc41-490c-82a2-3e4015ca605b service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Updated VIF entry in instance network info cache for port 23d8547c-bdb5-4646-ac12-1dfb693e9491. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 11:05:01 user nova-compute[71557]: DEBUG nova.network.neutron [req-15d0d78e-39bd-4303-a879-deb277dbf732 req-07849d74-bc41-490c-82a2-3e4015ca605b service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Updating instance_info_cache with network_info: [{"id": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "address": "fa:16:3e:2e:ca:09", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d8547c-bd", "ovs_interfaceid": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:05:01 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-15d0d78e-39bd-4303-a879-deb277dbf732 req-07849d74-bc41-490c-82a2-3e4015ca605b service nova] Releasing lock "refresh_cache-8a514b7a-d2a1-40d4-9b25-106a07771d72" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 11:05:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:05:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:05:02 user nova-compute[71557]: DEBUG nova.objects.instance [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'flavor' on Instance uuid 8a514b7a-d2a1-40d4-9b25-106a07771d72 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:05:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:05:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:05:02 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:05:02 user nova-compute[71557]: INFO nova.compute.manager [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Attaching volume a4269e32-9613-4dbd-be28-6421b7f7ee86 to /dev/vdb
Apr 12 11:05:02 user nova-compute[71557]: DEBUG os_brick.utils [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:05:02 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:02 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:02 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75ad4bc-fb0e-4320-b73b-68d077b9d1d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:02 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:02 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:02 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec756b8d-8173-4ca4-ad56-9476ebe28c7a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:02 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:03 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:03 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[260493f4-1136-4436-8b16-3dce6d7fa39f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:03 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a657c585-55cb-40dc-bb40-93ba375bcc15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:03 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:03 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 11:05:03 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 11:05:03 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:03 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 11:05:03 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 11:05:03 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bc432a-df1a-48fb-99c2-fdbb50b8c832]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:03 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 11:05:03 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 11:05:03 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 11:05:03 user nova-compute[71557]: DEBUG os_brick.utils [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:05:03 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Updating existing volume attachment record: 3303ba2f-bcf5-4abb-890a-7760ecb1383f {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 11:05:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:04 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jysLwElo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:05:07 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:05:07 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:05:07 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23e1608-8801-48e0-b4a6-b0bfb787ec4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 11:05:07 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1f52e0-0e4b-4eaf-8fa3-adf95db32c80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86] added
Apr 12 11:05:07 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea9a067-f71f-41ab-9fff-2ba925a872b7]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea3932a-cca4-4488-8afc-78c52ceb8663]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jysLwElo {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jysLwElo" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[c662d479-37fc-4eaf-92fe-8b8ff064b0cb]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jysLwElo'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[066d18fd-4bfd-407f-b893-84f217aadb68]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4172bda-bf3c-4595-9adc-5f391fc8a19d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 11:05:07 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 11:05:07 user nova-compute[71557]:  {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:05:07 user nova-compute[71557]: WARNING os_brick.initiator.connectors.iscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 11:05:07 user nova-compute[71557]: 
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c25138-2ae1-42af-9ef0-6c392c4090b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86, portal: 172.16.0.220,3260]
Apr 12 11:05:07 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86, portal: 172.16.0.220,3260] successful.
Apr 12 11:05:07 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1406fb38-c1c8-49e6-8640-d19f2a9e54d7]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b51dad-a64d-4b90-8091-a0bce5af5e1c]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 (non-flash)
Apr 12 11:05:07 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 (non-flash)
Apr 12 11:05:07 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1bd1ce-6a1d-4ca4-a276-2e67c4dddf06]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jysLwElo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 11:05:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:08 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:05:08 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23935656262353531', 'path': '/dev/sdb'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:05:08 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935656262353531', 'path': '/dev/sdb'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 11:05:08 user nova-compute[71557]: DEBUG nova.objects.instance [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'flavor' on Instance uuid 8a514b7a-d2a1-40d4-9b25-106a07771d72 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:05:08 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 11:05:08 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 11:05:08 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 11:05:08 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 11:05:08 user nova-compute[71557]:   <serial>a4269e32-9613-4dbd-be28-6421b7f7ee86</serial>
Apr 12 11:05:08 user nova-compute[71557]: </disk>
Apr 12 11:05:08 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 11:05:08 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 11:05:08 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 11:05:08 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] No VIF found with MAC fa:16:3e:2e:ca:09, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 11:05:09 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f5d0c711-07e0-47b7-ae70-315deb095868 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.174s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:05:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:05:10 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:05:10 user nova-compute[71557]: DEBUG nova.objects.instance [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'flavor' on Instance uuid 8a514b7a-d2a1-40d4-9b25-106a07771d72 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:05:11 user nova-compute[71557]: INFO nova.compute.manager [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Attaching volume fd1c3cf1-d5a9-44a2-813d-6d816218a1be to /dev/vdc
Apr 12 11:05:11 user nova-compute[71557]: DEBUG os_brick.utils [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf6c7d6-428a-4002-a696-7de7d198a1e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8dd953b26b42\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f2e48e-5744-4e22-93ee-2bc2d5c5707b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f0e5b8-102b-442b-a930-c3071212601c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1464a517-b3c9-4b76-bc29-a73bed4cfde0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Running cmd (subprocess): nvme version {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] 'nvme version' failed. Not Retrying. {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.nvmeof [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] nvme not present on system {{(pid=71557) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 11:05:11 user nova-compute[71557]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 11:05:11 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda0295b-7771-47ed-b803-97f8d6d18161]: (4, '') {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71557) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.lightos [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] LIGHTOS: no hostnqn found. {{(pid=71557) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG os_brick.utils [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8dd953b26b42', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:05:11 user nova-compute[71557]: DEBUG nova.virt.block_device [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Updating existing volume attachment record: 92572cb8-6d43-4006-aae3-cbd4879e8246 {{(pid=71557) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 11:05:14 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:05:16 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Calling os-brick to attach iSCSI Volume {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 11:05:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qlYufwrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:05:16 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:05:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:05:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:05:16 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:05:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:05:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:05:16 user nova-compute[71557]: INFO os_brick.initiator.connectors.iscsi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 11:05:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be -p 172.16.0.220:3260 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:16 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbc4ffc-aebf-4552-9edc-b442aa732110]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:16 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 11:05:16 user nova-compute[71557]:  {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:05:16 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be -p 172.16.0.220:3260 --interface default --op new {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64d8798-4ebe-41df-ae73-911e9bb86b77]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be] added\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be] added
Apr 12 11:05:17 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb2f369-5934-4510-9731-b1dba005d855]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09dc450-538a-49c0-98ce-0a890ea5acee]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qlYufwrA {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qlYufwrA" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a452703-0c01-42b1-a15b-e828a490e27d]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qlYufwrA'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[309b490f-f993-44d8-ae62-e4efb5064b3d]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6c3f0a-42eb-4ec4-b521-36d1dc0050c0]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 (non-flash)
Apr 12 11:05:17 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 (non-flash)
Apr 12 11:05:17 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be -p 172.16.0.220:3260 --login {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a06728d-e433-4087-ad59-93cc09e6da60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be, portal: 172.16.0.220,3260]
Apr 12 11:05:17 user nova-compute[71557]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be, portal: 172.16.0.220,3260] successful.
Apr 12 11:05:17 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3ae145-a705-44ab-bb63-295c87f5d03f]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbe7fd2-dfb0-4e8b-b801-4bbc1ef368cd]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 (non-flash)
Apr 12 11:05:17 user nova-compute[71557]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be (non-flash)
Apr 12 11:05:17 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 (non-flash)
Apr 12 11:05:17 user nova-compute[71557]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be (non-flash)
Apr 12 11:05:17 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Connected to 172.16.0.220:3260 {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=71557) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71557) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd65836c-f344-47fe-a39e-54938cf26393]: (4, ('- - 0', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71557) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 11:05:17 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qlYufwrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71557) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 11:05:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:05:18 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26636633832663033', 'path': '/dev/sdc'} {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:05:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636633832663033', 'path': '/dev/sdc'} {{(pid=71557) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 11:05:18 user nova-compute[71557]: DEBUG nova.objects.instance [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'flavor' on Instance uuid 8a514b7a-d2a1-40d4-9b25-106a07771d72 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:05:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 11:05:18 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 11:05:18 user nova-compute[71557]:   <source dev="/dev/sdc"/>
Apr 12 11:05:18 user nova-compute[71557]:   <target dev="vdc" bus="virtio"/>
Apr 12 11:05:18 user nova-compute[71557]:   <serial>fd1c3cf1-d5a9-44a2-813d-6d816218a1be</serial>
Apr 12 11:05:18 user nova-compute[71557]: </disk>
Apr 12 11:05:18 user nova-compute[71557]:  {{(pid=71557) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 11:05:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 11:05:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 11:05:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 11:05:18 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] No VIF found with MAC fa:16:3e:2e:ca:09, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 11:05:18 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-427a97d0-5432-469d-b013-b646c65d4ce8 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.693s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:05:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:19 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:05:20 user nova-compute[71557]: INFO nova.compute.manager [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Detaching volume a4269e32-9613-4dbd-be28-6421b7f7ee86
Apr 12 11:05:20 user nova-compute[71557]: INFO nova.virt.block_device [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Attempting to driver detach volume a4269e32-9613-4dbd-be28-6421b7f7ee86 from mountpoint /dev/vdb
Apr 12 11:05:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Attempting to detach device vdb from instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 11:05:20 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 11:05:20 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 11:05:20 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 11:05:20 user nova-compute[71557]:   <serial>a4269e32-9613-4dbd-be28-6421b7f7ee86</serial>
Apr 12 11:05:20 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 11:05:20 user nova-compute[71557]: </disk>
Apr 12 11:05:20 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 11:05:20 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Successfully detached device vdb from instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 from the persistent domain config.
Apr 12 11:05:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 11:05:20 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 11:05:20 user nova-compute[71557]:   <source dev="/dev/sdb"/>
Apr 12 11:05:20 user nova-compute[71557]:   <target dev="vdb" bus="virtio"/>
Apr 12 11:05:20 user nova-compute[71557]:   <serial>a4269e32-9613-4dbd-be28-6421b7f7ee86</serial>
Apr 12 11:05:20 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 11:05:20 user nova-compute[71557]: </disk>
Apr 12 11:05:20 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681297520.6948354, 8a514b7a-d2a1-40d4-9b25-106a07771d72 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 11:05:20 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Successfully detached device vdb from instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 from the live domain config.
Apr 12 11:05:20 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jysLwElo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:05:20 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:05:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f14cc29-f6e2-4309-adb5-279c40d96464]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 11:05:20 user nova-compute[71557]: No targets found.
Apr 12 11:05:20 user nova-compute[71557]: iSNS:
Apr 12 11:05:20 user nova-compute[71557]: No targets found.
Apr 12 11:05:20 user nova-compute[71557]: STATIC:
Apr 12 11:05:20 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86
Apr 12 11:05:20 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 11:05:20 user nova-compute[71557]:                 Iface Name: default
Apr 12 11:05:20 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be
Apr 12 11:05:20 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 11:05:20 user nova-compute[71557]:                 Iface Name: default
Apr 12 11:05:20 user nova-compute[71557]: FIRMWARE:
Apr 12 11:05:20 user nova-compute[71557]: No targets found.
Apr 12 11:05:20 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 11:05:20 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 11:05:20 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[db339174-4a84-4c0a-9de3-28adae52daac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[21efd9e4-3088-481b-9c24-274d70071a0c]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 (non-flash)
Apr 12 11:05:20 user nova-compute[71557]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be (non-flash)
Apr 12 11:05:20 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 (non-flash)
Apr 12 11:05:20 user nova-compute[71557]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be (non-flash)
Apr 12 11:05:20 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fe1294280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86'): ({'sdb'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Removing single pathed devices sdb {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ce6a9a-f924-4308-9630-40a0cc9e178c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[be987018-5c90-49ad-8776-e43dd2e7be6a]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Flushing IO for device /dev/sdb {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[848aa128-b98c-48a0-af4d-96f9e24d7238]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[be367575-3c20-44e1-b797-58c4c3473926]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] SCSI volumes sdb have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcda0010-88f7-436d-9fb5-c45a4d713932]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[e290a10f-7be7-434a-b85b-96ed7c1bb146]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86, portal: 172.16.0.220,3260]
Apr 12 11:05:20 user nova-compute[71557]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86, portal: 172.16.0.220,3260] successful.
Apr 12 11:05:20 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:05:20 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:21 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4269e32-9613-4dbd-be28-6421b7f7ee86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:21 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8390a1f-147e-4ce8-85f6-043c5aa51c8e]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:05:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:05:21 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] <== disconnect_volume: return (307ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:05:21 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 11:05:21 user nova-compute[71557]: DEBUG nova.objects.instance [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'flavor' on Instance uuid 8a514b7a-d2a1-40d4-9b25-106a07771d72 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:05:21 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-8191939b-ca05-4861-aaf6-4c98a15fb00c tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.674s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:05:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:05:22 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:05:22 user nova-compute[71557]: INFO nova.compute.manager [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Detaching volume fd1c3cf1-d5a9-44a2-813d-6d816218a1be
Apr 12 11:05:22 user nova-compute[71557]: INFO nova.virt.block_device [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Attempting to driver detach volume fd1c3cf1-d5a9-44a2-813d-6d816218a1be from mountpoint /dev/vdc
Apr 12 11:05:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Attempting to detach device vdc from instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 from the persistent domain config. {{(pid=71557) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 11:05:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 11:05:22 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 11:05:22 user nova-compute[71557]:   <source dev="/dev/sdc"/>
Apr 12 11:05:22 user nova-compute[71557]:   <target dev="vdc" bus="virtio"/>
Apr 12 11:05:22 user nova-compute[71557]:   <serial>fd1c3cf1-d5a9-44a2-813d-6d816218a1be</serial>
Apr 12 11:05:22 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 11:05:22 user nova-compute[71557]: </disk>
Apr 12 11:05:22 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 11:05:22 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Successfully detached device vdc from instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 from the persistent domain config.
Apr 12 11:05:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 from the live domain config. {{(pid=71557) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 11:05:22 user nova-compute[71557]: DEBUG nova.virt.libvirt.guest [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 11:05:22 user nova-compute[71557]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 11:05:22 user nova-compute[71557]:   <source dev="/dev/sdc"/>
Apr 12 11:05:22 user nova-compute[71557]:   <target dev="vdc" bus="virtio"/>
Apr 12 11:05:22 user nova-compute[71557]:   <serial>fd1c3cf1-d5a9-44a2-813d-6d816218a1be</serial>
Apr 12 11:05:22 user nova-compute[71557]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 11:05:22 user nova-compute[71557]: </disk>
Apr 12 11:05:22 user nova-compute[71557]:  {{(pid=71557) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Received event <DeviceRemovedEvent: 1681297523.12016, 8a514b7a-d2a1-40d4-9b25-106a07771d72 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71557) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 {{(pid=71557) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 11:05:23 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Successfully detached device vdc from instance 8a514b7a-d2a1-40d4-9b25-106a07771d72 from the live domain config.
Apr 12 11:05:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] calling os-brick to detach iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fd416a9b0>, {'target_iqn': 'iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qlYufwrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 11:05:23 user nova-compute[71557]: WARNING os_brick.initiator.connectors.base [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 11:05:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[13039e9f-fcc5-4e3c-9c65-2660e5764aa5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 11:05:23 user nova-compute[71557]: No targets found.
Apr 12 11:05:23 user nova-compute[71557]: iSNS:
Apr 12 11:05:23 user nova-compute[71557]: No targets found.
Apr 12 11:05:23 user nova-compute[71557]: STATIC:
Apr 12 11:05:23 user nova-compute[71557]: Target: iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be
Apr 12 11:05:23 user nova-compute[71557]:         Portal: 172.16.0.220:3260,-1
Apr 12 11:05:23 user nova-compute[71557]:                 Iface Name: default
Apr 12 11:05:23 user nova-compute[71557]: FIRMWARE:
Apr 12 11:05:23 user nova-compute[71557]: No targets found.
Apr 12 11:05:23 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 11:05:23 user nova-compute[71557]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 11:05:23 user nova-compute[71557]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71557) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be', 0)] {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6998f9-5f54-4274-9780-5f11caaf4922]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4fca5a-6c66-4871-bc40-1876b6f8416e]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be (non-flash)\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be (non-flash)
Apr 12 11:05:23 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be (non-flash)
Apr 12 11:05:23 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd4247e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be'): ({'sdc'}, set())}) {{(pid=71557) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Removing single pathed devices sdc {{(pid=71557) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[962dbd4b-9f20-489f-9724-17a574973e32]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a32e4b4-5857-4be6-ba7a-7efa6cc56fe4]: (4, ('ok\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Flushing IO for device /dev/sdc {{(pid=71557) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[479e4dbc-2302-4124-8347-cdbf4417e26c]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71557) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[1612aa08-06b4-49d8-b0e3-99e199b9ab82]: (4, ('1', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG os_brick.initiator.linuxscsi [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] SCSI volumes sdc have been removed. {{(pid=71557) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be')] {{(pid=71557) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d917791-7001-4c59-9ae3-377475ccd7fd]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be -p 172.16.0.220:3260 --logout {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfde10a-cc8f-47a2-b1ef-306e6d50c19a]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be, portal: 172.16.0.220,3260]
Apr 12 11:05:23 user nova-compute[71557]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be, portal: 172.16.0.220,3260] successful.
Apr 12 11:05:23 user nova-compute[71557]:  stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be -p 172.16.0.220:3260 --op delete {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1c3cf1-d5a9-44a2-813d-6d816218a1be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82009) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG oslo.privsep.daemon [-] privsep: reply[555e248d-3cfd-4eb5-991c-6117e3ef726e]: (4, ('', '')) {{(pid=82009) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71557) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.base [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] <== disconnect_volume: return (289ms) None {{(pid=71557) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 11:05:23 user nova-compute[71557]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Disconnected iSCSI Volume {{(pid=71557) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 11:05:24 user nova-compute[71557]: DEBUG nova.objects.instance [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'flavor' on Instance uuid 8a514b7a-d2a1-40d4-9b25-106a07771d72 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:05:24 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-edd31d43-a5d2-46b2-80ca-6d3c3c0fb577 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.850s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:05:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:05:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:05:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "8a514b7a-d2a1-40d4-9b25-106a07771d72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:05:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:05:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:05:25 user nova-compute[71557]: INFO nova.compute.manager [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Terminating instance
Apr 12 11:05:25 user nova-compute[71557]: DEBUG nova.compute.manager [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 11:05:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-6714c904-c35a-4702-8820-6e169a6b128e req-7fbb7a83-acaa-4045-8306-f4650a154d46 service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Received event network-vif-unplugged-23d8547c-bdb5-4646-ac12-1dfb693e9491 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:05:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6714c904-c35a-4702-8820-6e169a6b128e req-7fbb7a83-acaa-4045-8306-f4650a154d46 service nova] Acquiring lock "8a514b7a-d2a1-40d4-9b25-106a07771d72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:05:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6714c904-c35a-4702-8820-6e169a6b128e req-7fbb7a83-acaa-4045-8306-f4650a154d46 service nova] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:05:25 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-6714c904-c35a-4702-8820-6e169a6b128e req-7fbb7a83-acaa-4045-8306-f4650a154d46 service nova] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:05:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-6714c904-c35a-4702-8820-6e169a6b128e req-7fbb7a83-acaa-4045-8306-f4650a154d46 service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] No waiting events found dispatching network-vif-unplugged-23d8547c-bdb5-4646-ac12-1dfb693e9491 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:05:25 user nova-compute[71557]: DEBUG nova.compute.manager [req-6714c904-c35a-4702-8820-6e169a6b128e req-7fbb7a83-acaa-4045-8306-f4650a154d46 service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Received event network-vif-unplugged-23d8547c-bdb5-4646-ac12-1dfb693e9491 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 11:05:26 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Instance destroyed successfully.
Apr 12 11:05:26 user nova-compute[71557]: DEBUG nova.objects.instance [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lazy-loading 'resources' on Instance uuid 8a514b7a-d2a1-40d4-9b25-106a07771d72 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:05:26 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T11:03:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2098924335',display_name='tempest-AttachVolumeTestJSON-server-2098924335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2098924335',id=46,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNumieZsB8oe7GLTZgFC+G6r47EBCDso6tEsNDy7zRRdzpCxU2vuKELKugqdw77z7Fs89HUtjILuEicvB0lsORArcYlMG9UCGVeFqo7InCbLcoNREp0G6jUNvS1QG5UJSw==',key_name='tempest-keypair-1832184664',keypairs=<?>,launch_index=0,launched_at=2023-04-12T11:03:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9878bfe34ceb4a6695b253ad161c4f7b',ramdisk_id='',reservation_id='r-wwk09v6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1953237893',owner_user_name='tempest-AttachVolumeTestJSON-1953237893-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T11:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6576467073e41e9b497097d5a8dfd3d',uuid=8a514b7a-d2a1-40d4-9b25-106a07771d72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "address": "fa:16:3e:2e:ca:09", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d8547c-bd", "ovs_interfaceid": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 11:05:26 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converting VIF {"id": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "address": "fa:16:3e:2e:ca:09", "network": {"id": "cd7a59d4-de6d-47fd-acf3-4304f60a460c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1312229957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9878bfe34ceb4a6695b253ad161c4f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d8547c-bd", "ovs_interfaceid": "23d8547c-bdb5-4646-ac12-1dfb693e9491", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 11:05:26 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:ca:09,bridge_name='br-int',has_traffic_filtering=True,id=23d8547c-bdb5-4646-ac12-1dfb693e9491,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23d8547c-bd') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 11:05:26 user nova-compute[71557]: DEBUG os_vif [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:ca:09,bridge_name='br-int',has_traffic_filtering=True,id=23d8547c-bdb5-4646-ac12-1dfb693e9491,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23d8547c-bd') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 11:05:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23d8547c-bd, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 11:05:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:05:26 user nova-compute[71557]: INFO os_vif [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:ca:09,bridge_name='br-int',has_traffic_filtering=True,id=23d8547c-bdb5-4646-ac12-1dfb693e9491,network=Network(cd7a59d4-de6d-47fd-acf3-4304f60a460c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23d8547c-bd')
Apr 12 11:05:26 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Deleting instance files /opt/stack/data/nova/instances/8a514b7a-d2a1-40d4-9b25-106a07771d72_del
Apr 12 11:05:26 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Deletion of /opt/stack/data/nova/instances/8a514b7a-d2a1-40d4-9b25-106a07771d72_del complete
Apr 12 11:05:26 user nova-compute[71557]: INFO nova.compute.manager [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Took 0.96 seconds to destroy the instance on the hypervisor.
Apr 12 11:05:26 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 11:05:26 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 11:05:26 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 11:05:27 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:05:27 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Took 1.08 seconds to deallocate network for instance.
Apr 12 11:05:27 user nova-compute[71557]: DEBUG nova.compute.manager [req-7c19e0f0-bf45-417f-b7a7-2d4f4c46d4c2 req-aeb4bea7-d8d1-4e89-b39d-0a008089ee18 service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Received event network-vif-deleted-23d8547c-bdb5-4646-ac12-1dfb693e9491 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:05:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:05:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:05:27 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 11:05:27 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 11:05:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:05:27 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Deleted allocations for instance 8a514b7a-d2a1-40d4-9b25-106a07771d72
Apr 12 11:05:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-59fb1159-c6ea-4694-a869-f5af782c81b9 tempest-AttachVolumeTestJSON-1953237893 tempest-AttachVolumeTestJSON-1953237893-project-member] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.354s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:05:27 user nova-compute[71557]: DEBUG nova.compute.manager [req-0ebd9251-ff93-4190-89a6-b10ef916af88 req-793e5e99-1c6b-484f-90bc-c89f0372a30e service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Received event network-vif-plugged-23d8547c-bdb5-4646-ac12-1dfb693e9491 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:05:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0ebd9251-ff93-4190-89a6-b10ef916af88 req-793e5e99-1c6b-484f-90bc-c89f0372a30e service nova] Acquiring lock "8a514b7a-d2a1-40d4-9b25-106a07771d72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:05:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0ebd9251-ff93-4190-89a6-b10ef916af88 req-793e5e99-1c6b-484f-90bc-c89f0372a30e service nova] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:05:27 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-0ebd9251-ff93-4190-89a6-b10ef916af88 req-793e5e99-1c6b-484f-90bc-c89f0372a30e service nova] Lock "8a514b7a-d2a1-40d4-9b25-106a07771d72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:05:27 user nova-compute[71557]: DEBUG nova.compute.manager [req-0ebd9251-ff93-4190-89a6-b10ef916af88 req-793e5e99-1c6b-484f-90bc-c89f0372a30e service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] No waiting events found dispatching network-vif-plugged-23d8547c-bdb5-4646-ac12-1dfb693e9491 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:05:27 user nova-compute[71557]: WARNING nova.compute.manager [req-0ebd9251-ff93-4190-89a6-b10ef916af88 req-793e5e99-1c6b-484f-90bc-c89f0372a30e service nova] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Received unexpected event network-vif-plugged-23d8547c-bdb5-4646-ac12-1dfb693e9491 for instance with vm_state deleted and task_state None.
Apr 12 11:05:31 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:05:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:05:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:05:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:05:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:05:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:38 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:05:38 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:05:38 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 11:05:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:41 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681297526.034411, 8a514b7a-d2a1-40d4-9b25-106a07771d72 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 11:05:41 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] VM Stopped (Lifecycle Event)
Apr 12 11:05:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-37c2d14d-bc31-4a13-9725-d5b1707b3622 None None] [instance: 8a514b7a-d2a1-40d4-9b25-106a07771d72] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 11:05:41 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:44 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:05:44 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:05:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:05:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:05:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:05:44 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 11:05:44 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:05:44 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:05:44 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=8806MB free_disk=26.170734405517578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 11:05:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:05:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:05:44 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 11:05:44 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 11:05:44 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 11:05:44 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 11:05:44 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 11:05:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:05:45 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:05:46 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:05:46 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:05:46 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:05:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 11:05:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Rebuilding the list of instances to heal {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 11:05:46 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Didn't find any instances for network info cache update. {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 11:05:46 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:05:46 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:05:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:51 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:05:53 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:05:56 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:06:01 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:06:06 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:06:11 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:06:16 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:06:21 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:06:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:06:26 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:06:31 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:06:31 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:06:31 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:06:31 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:06:31 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:06:31 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:06:33 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Acquiring lock "9963614d-458a-4521-94a8-8b6811efa9d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9963614d-458a-4521-94a8-8b6811efa9d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Starting instance... {{(pid=71557) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71557) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 11:06:35 user nova-compute[71557]: INFO nova.compute.claims [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Claim successful on node user
Apr 12 11:06:35 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.189s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Start building networks asynchronously for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Allocating IP information in the background. {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] allocate_for_instance() {{(pid=71557) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 11:06:35 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 11:06:35 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Start building block device mappings for instance. {{(pid=71557) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG nova.policy [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0c5b108917440ad862967ea398c6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80171401e13a447f9410c3a2bd339f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71557) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Start spawning the instance on the hypervisor. {{(pid=71557) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Creating instance directory {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 11:06:35 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Creating image(s)
Apr 12 11:06:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Acquiring lock "/opt/stack/data/nova/instances/9963614d-458a-4521-94a8-8b6811efa9d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "/opt/stack/data/nova/instances/9963614d-458a-4521-94a8-8b6811efa9d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "/opt/stack/data/nova/instances/9963614d-458a-4521-94a8-8b6811efa9d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.135s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Acquiring lock "e0e145002aa61d7e280533450edf689aabd5ee2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.131s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/9963614d-458a-4521-94a8-8b6811efa9d0/disk 1073741824 {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c,backing_fmt=raw /opt/stack/data/nova/instances/9963614d-458a-4521-94a8-8b6811efa9d0/disk 1073741824" returned: 0 in 0.053s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "e0e145002aa61d7e280533450edf689aabd5ee2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:06:35 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:06:36 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:06:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0e145002aa61d7e280533450edf689aabd5ee2c --force-share --output=json" returned: 0 in 0.129s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:06:36 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9963614d-458a-4521-94a8-8b6811efa9d0/disk. size=1073741824 {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 11:06:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9963614d-458a-4521-94a8-8b6811efa9d0/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:06:36 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9963614d-458a-4521-94a8-8b6811efa9d0/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:06:36 user nova-compute[71557]: DEBUG nova.virt.disk.api [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Cannot resize image /opt/stack/data/nova/instances/9963614d-458a-4521-94a8-8b6811efa9d0/disk to a smaller size. {{(pid=71557) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 11:06:36 user nova-compute[71557]: DEBUG nova.objects.instance [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lazy-loading 'migration_context' on Instance uuid 9963614d-458a-4521-94a8-8b6811efa9d0 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:06:36 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Successfully created port: f73636a3-a1e1-4de0-ad09-375ffb94a996 {{(pid=71557) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 11:06:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Created local disks {{(pid=71557) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 11:06:36 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Ensure instance console log exists: /opt/stack/data/nova/instances/9963614d-458a-4521-94a8-8b6811efa9d0/console.log {{(pid=71557) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 11:06:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:06:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:06:36 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Successfully updated port: f73636a3-a1e1-4de0-ad09-375ffb94a996 {{(pid=71557) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Acquiring lock "refresh_cache-9963614d-458a-4521-94a8-8b6811efa9d0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Acquired lock "refresh_cache-9963614d-458a-4521-94a8-8b6811efa9d0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Building network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.compute.manager [req-a460fd8e-616b-4ed4-a5b8-87a81aebd7ea req-94422b05-bd49-47ad-a380-c2edbeaafe62 service nova] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Received event network-changed-f73636a3-a1e1-4de0-ad09-375ffb94a996 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.compute.manager [req-a460fd8e-616b-4ed4-a5b8-87a81aebd7ea req-94422b05-bd49-47ad-a380-c2edbeaafe62 service nova] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Refreshing instance network info cache due to event network-changed-f73636a3-a1e1-4de0-ad09-375ffb94a996. {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a460fd8e-616b-4ed4-a5b8-87a81aebd7ea req-94422b05-bd49-47ad-a380-c2edbeaafe62 service nova] Acquiring lock "refresh_cache-9963614d-458a-4521-94a8-8b6811efa9d0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Instance cache missing network info. {{(pid=71557) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.network.neutron [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Updating instance_info_cache with network_info: [{"id": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "address": "fa:16:3e:b3:a4:82", "network": {"id": "c4caf2aa-9cd4-49ef-87c6-26505451e622", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1236912207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "80171401e13a447f9410c3a2bd339f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73636a3-a1", "ovs_interfaceid": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Releasing lock "refresh_cache-9963614d-458a-4521-94a8-8b6811efa9d0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Instance network_info: |[{"id": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "address": "fa:16:3e:b3:a4:82", "network": {"id": "c4caf2aa-9cd4-49ef-87c6-26505451e622", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1236912207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "80171401e13a447f9410c3a2bd339f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73636a3-a1", "ovs_interfaceid": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71557) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a460fd8e-616b-4ed4-a5b8-87a81aebd7ea req-94422b05-bd49-47ad-a380-c2edbeaafe62 service nova] Acquired lock "refresh_cache-9963614d-458a-4521-94a8-8b6811efa9d0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.network.neutron [req-a460fd8e-616b-4ed4-a5b8-87a81aebd7ea req-94422b05-bd49-47ad-a380-c2edbeaafe62 service nova] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Refreshing network info cache for port f73636a3-a1e1-4de0-ad09-375ffb94a996 {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Start _get_guest_xml network_info=[{"id": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "address": "fa:16:3e:b3:a4:82", "network": {"id": "c4caf2aa-9cd4-49ef-87c6-26505451e622", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1236912207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "80171401e13a447f9410c3a2bd339f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73636a3-a1", "ovs_interfaceid": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3dd4c04b-7ffb-4200-9900-d3e99c6da7a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 11:06:37 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:06:37 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71557) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T10:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T10:31:39Z,direct_url=<?>,disk_format='qcow2',id=3dd4c04b-7ffb-4200-9900-d3e99c6da7a0,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='fef1d0d3952d43e2be1c2b52c16966b3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T10:31:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Flavor limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Image limits 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Flavor pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Image pref 0:0:0 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Got 1 possible topologies {{(pid=71557) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.virt.hardware [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71557) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T11:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1573222300',display_name='tempest-VolumesActionsTest-instance-1573222300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1573222300',id=47,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80171401e13a447f9410c3a2bd339f59',ramdisk_id='',reservation_id='r-el2w6730',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-838117246',owner_user_name='tempest-VolumesActionsTest-838117246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T11:06:36Z,user_data=None,user_id='f0c5b108917440ad862967ea398c6ee1',uuid=9963614d-458a-4521-94a8-8b6811efa9d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "address": "fa:16:3e:b3:a4:82", "network": {"id": "c4caf2aa-9cd4-49ef-87c6-26505451e622", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1236912207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "80171401e13a447f9410c3a2bd339f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73636a3-a1", "ovs_interfaceid": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71557) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Converting VIF {"id": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "address": "fa:16:3e:b3:a4:82", "network": {"id": "c4caf2aa-9cd4-49ef-87c6-26505451e622", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1236912207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "80171401e13a447f9410c3a2bd339f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73636a3-a1", "ovs_interfaceid": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a4:82,bridge_name='br-int',has_traffic_filtering=True,id=f73636a3-a1e1-4de0-ad09-375ffb94a996,network=Network(c4caf2aa-9cd4-49ef-87c6-26505451e622),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf73636a3-a1') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.objects.instance [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lazy-loading 'pci_devices' on Instance uuid 9963614d-458a-4521-94a8-8b6811efa9d0 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] End _get_guest_xml xml=<domain type="kvm">
Apr 12 11:06:37 user nova-compute[71557]:   <uuid>9963614d-458a-4521-94a8-8b6811efa9d0</uuid>
Apr 12 11:06:37 user nova-compute[71557]:   <name>instance-0000002f</name>
Apr 12 11:06:37 user nova-compute[71557]:   <memory>131072</memory>
Apr 12 11:06:37 user nova-compute[71557]:   <vcpu>1</vcpu>
Apr 12 11:06:37 user nova-compute[71557]:   <metadata>
Apr 12 11:06:37 user nova-compute[71557]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 11:06:37 user nova-compute[71557]:       <nova:package version="0.0.0"/>
Apr 12 11:06:37 user nova-compute[71557]:       <nova:name>tempest-VolumesActionsTest-instance-1573222300</nova:name>
Apr 12 11:06:37 user nova-compute[71557]:       <nova:creationTime>2023-04-12 11:06:37</nova:creationTime>
Apr 12 11:06:37 user nova-compute[71557]:       <nova:flavor name="m1.nano">
Apr 12 11:06:37 user nova-compute[71557]:         <nova:memory>128</nova:memory>
Apr 12 11:06:37 user nova-compute[71557]:         <nova:disk>1</nova:disk>
Apr 12 11:06:37 user nova-compute[71557]:         <nova:swap>0</nova:swap>
Apr 12 11:06:37 user nova-compute[71557]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 11:06:37 user nova-compute[71557]:         <nova:vcpus>1</nova:vcpus>
Apr 12 11:06:37 user nova-compute[71557]:       </nova:flavor>
Apr 12 11:06:37 user nova-compute[71557]:       <nova:owner>
Apr 12 11:06:37 user nova-compute[71557]:         <nova:user uuid="f0c5b108917440ad862967ea398c6ee1">tempest-VolumesActionsTest-838117246-project-member</nova:user>
Apr 12 11:06:37 user nova-compute[71557]:         <nova:project uuid="80171401e13a447f9410c3a2bd339f59">tempest-VolumesActionsTest-838117246</nova:project>
Apr 12 11:06:37 user nova-compute[71557]:       </nova:owner>
Apr 12 11:06:37 user nova-compute[71557]:       <nova:root type="image" uuid="3dd4c04b-7ffb-4200-9900-d3e99c6da7a0"/>
Apr 12 11:06:37 user nova-compute[71557]:       <nova:ports>
Apr 12 11:06:37 user nova-compute[71557]:         <nova:port uuid="f73636a3-a1e1-4de0-ad09-375ffb94a996">
Apr 12 11:06:37 user nova-compute[71557]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 11:06:37 user nova-compute[71557]:         </nova:port>
Apr 12 11:06:37 user nova-compute[71557]:       </nova:ports>
Apr 12 11:06:37 user nova-compute[71557]:     </nova:instance>
Apr 12 11:06:37 user nova-compute[71557]:   </metadata>
Apr 12 11:06:37 user nova-compute[71557]:   <sysinfo type="smbios">
Apr 12 11:06:37 user nova-compute[71557]:     <system>
Apr 12 11:06:37 user nova-compute[71557]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 11:06:37 user nova-compute[71557]:       <entry name="product">OpenStack Nova</entry>
Apr 12 11:06:37 user nova-compute[71557]:       <entry name="version">0.0.0</entry>
Apr 12 11:06:37 user nova-compute[71557]:       <entry name="serial">9963614d-458a-4521-94a8-8b6811efa9d0</entry>
Apr 12 11:06:37 user nova-compute[71557]:       <entry name="uuid">9963614d-458a-4521-94a8-8b6811efa9d0</entry>
Apr 12 11:06:37 user nova-compute[71557]:       <entry name="family">Virtual Machine</entry>
Apr 12 11:06:37 user nova-compute[71557]:     </system>
Apr 12 11:06:37 user nova-compute[71557]:   </sysinfo>
Apr 12 11:06:37 user nova-compute[71557]:   <os>
Apr 12 11:06:37 user nova-compute[71557]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 11:06:37 user nova-compute[71557]:     <boot dev="hd"/>
Apr 12 11:06:37 user nova-compute[71557]:     <smbios mode="sysinfo"/>
Apr 12 11:06:37 user nova-compute[71557]:   </os>
Apr 12 11:06:37 user nova-compute[71557]:   <features>
Apr 12 11:06:37 user nova-compute[71557]:     <acpi/>
Apr 12 11:06:37 user nova-compute[71557]:     <apic/>
Apr 12 11:06:37 user nova-compute[71557]:     <vmcoreinfo/>
Apr 12 11:06:37 user nova-compute[71557]:   </features>
Apr 12 11:06:37 user nova-compute[71557]:   <clock offset="utc">
Apr 12 11:06:37 user nova-compute[71557]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 11:06:37 user nova-compute[71557]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 11:06:37 user nova-compute[71557]:     <timer name="hpet" present="no"/>
Apr 12 11:06:37 user nova-compute[71557]:   </clock>
Apr 12 11:06:37 user nova-compute[71557]:   <cpu mode="custom" match="exact">
Apr 12 11:06:37 user nova-compute[71557]:     <model>Nehalem</model>
Apr 12 11:06:37 user nova-compute[71557]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 11:06:37 user nova-compute[71557]:   </cpu>
Apr 12 11:06:37 user nova-compute[71557]:   <devices>
Apr 12 11:06:37 user nova-compute[71557]:     <disk type="file" device="disk">
Apr 12 11:06:37 user nova-compute[71557]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 11:06:37 user nova-compute[71557]:       <source file="/opt/stack/data/nova/instances/9963614d-458a-4521-94a8-8b6811efa9d0/disk"/>
Apr 12 11:06:37 user nova-compute[71557]:       <target dev="vda" bus="virtio"/>
Apr 12 11:06:37 user nova-compute[71557]:     </disk>
Apr 12 11:06:37 user nova-compute[71557]:     <interface type="ethernet">
Apr 12 11:06:37 user nova-compute[71557]:       <mac address="fa:16:3e:b3:a4:82"/>
Apr 12 11:06:37 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 11:06:37 user nova-compute[71557]:       <mtu size="1442"/>
Apr 12 11:06:37 user nova-compute[71557]:       <target dev="tapf73636a3-a1"/>
Apr 12 11:06:37 user nova-compute[71557]:     </interface>
Apr 12 11:06:37 user nova-compute[71557]:     <serial type="pty">
Apr 12 11:06:37 user nova-compute[71557]:       <log file="/opt/stack/data/nova/instances/9963614d-458a-4521-94a8-8b6811efa9d0/console.log" append="off"/>
Apr 12 11:06:37 user nova-compute[71557]:     </serial>
Apr 12 11:06:37 user nova-compute[71557]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 11:06:37 user nova-compute[71557]:     <video>
Apr 12 11:06:37 user nova-compute[71557]:       <model type="virtio"/>
Apr 12 11:06:37 user nova-compute[71557]:     </video>
Apr 12 11:06:37 user nova-compute[71557]:     <rng model="virtio">
Apr 12 11:06:37 user nova-compute[71557]:       <backend model="random">/dev/urandom</backend>
Apr 12 11:06:37 user nova-compute[71557]:     </rng>
Apr 12 11:06:37 user nova-compute[71557]:     <controller type="usb" index="0" model="none"/>
Apr 12 11:06:37 user nova-compute[71557]:     <memballoon model="virtio">
Apr 12 11:06:37 user nova-compute[71557]:       <stats period="10"/>
Apr 12 11:06:37 user nova-compute[71557]:     </memballoon>
Apr 12 11:06:37 user nova-compute[71557]:   </devices>
Apr 12 11:06:37 user nova-compute[71557]: </domain>
Apr 12 11:06:37 user nova-compute[71557]:  {{(pid=71557) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T11:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1573222300',display_name='tempest-VolumesActionsTest-instance-1573222300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1573222300',id=47,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80171401e13a447f9410c3a2bd339f59',ramdisk_id='',reservation_id='r-el2w6730',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-838117246',owner_user_name='tempest-VolumesActionsTest-838117246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T11:06:36Z,user_data=None,user_id='f0c5b108917440ad862967ea398c6ee1',uuid=9963614d-458a-4521-94a8-8b6811efa9d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "address": "fa:16:3e:b3:a4:82", "network": {"id": "c4caf2aa-9cd4-49ef-87c6-26505451e622", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1236912207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "80171401e13a447f9410c3a2bd339f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73636a3-a1", "ovs_interfaceid": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Converting VIF {"id": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "address": "fa:16:3e:b3:a4:82", "network": {"id": "c4caf2aa-9cd4-49ef-87c6-26505451e622", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1236912207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "80171401e13a447f9410c3a2bd339f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73636a3-a1", "ovs_interfaceid": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a4:82,bridge_name='br-int',has_traffic_filtering=True,id=f73636a3-a1e1-4de0-ad09-375ffb94a996,network=Network(c4caf2aa-9cd4-49ef-87c6-26505451e622),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf73636a3-a1') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG os_vif [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a4:82,bridge_name='br-int',has_traffic_filtering=True,id=f73636a3-a1e1-4de0-ad09-375ffb94a996,network=Network(c4caf2aa-9cd4-49ef-87c6-26505451e622),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf73636a3-a1') {{(pid=71557) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf73636a3-a1, may_exist=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf73636a3-a1, col_values=(('external_ids', {'iface-id': 'f73636a3-a1e1-4de0-ad09-375ffb94a996', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:a4:82', 'vm-uuid': '9963614d-458a-4521-94a8-8b6811efa9d0'}),)) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:06:37 user nova-compute[71557]: INFO os_vif [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a4:82,bridge_name='br-int',has_traffic_filtering=True,id=f73636a3-a1e1-4de0-ad09-375ffb94a996,network=Network(c4caf2aa-9cd4-49ef-87c6-26505451e622),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf73636a3-a1')
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] No BDM found with device name vda, not building metadata. {{(pid=71557) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] No VIF found with MAC fa:16:3e:b3:a4:82, not building metadata {{(pid=71557) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.network.neutron [req-a460fd8e-616b-4ed4-a5b8-87a81aebd7ea req-94422b05-bd49-47ad-a380-c2edbeaafe62 service nova] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Updated VIF entry in instance network info cache for port f73636a3-a1e1-4de0-ad09-375ffb94a996. {{(pid=71557) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 11:06:37 user nova-compute[71557]: DEBUG nova.network.neutron [req-a460fd8e-616b-4ed4-a5b8-87a81aebd7ea req-94422b05-bd49-47ad-a380-c2edbeaafe62 service nova] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Updating instance_info_cache with network_info: [{"id": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "address": "fa:16:3e:b3:a4:82", "network": {"id": "c4caf2aa-9cd4-49ef-87c6-26505451e622", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1236912207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "80171401e13a447f9410c3a2bd339f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73636a3-a1", "ovs_interfaceid": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:06:38 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-a460fd8e-616b-4ed4-a5b8-87a81aebd7ea req-94422b05-bd49-47ad-a380-c2edbeaafe62 service nova] Releasing lock "refresh_cache-9963614d-458a-4521-94a8-8b6811efa9d0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 11:06:38 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:06:38 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:06:38 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 11:06:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:06:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:06:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:06:38 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:06:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-bb17ef16-88f7-4014-a9f3-5b43a6b252dc req-e62d277f-9577-4d6d-aa1a-5a3df634852c service nova] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Received event network-vif-plugged-f73636a3-a1e1-4de0-ad09-375ffb94a996 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:06:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bb17ef16-88f7-4014-a9f3-5b43a6b252dc req-e62d277f-9577-4d6d-aa1a-5a3df634852c service nova] Acquiring lock "9963614d-458a-4521-94a8-8b6811efa9d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:06:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bb17ef16-88f7-4014-a9f3-5b43a6b252dc req-e62d277f-9577-4d6d-aa1a-5a3df634852c service nova] Lock "9963614d-458a-4521-94a8-8b6811efa9d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:06:39 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-bb17ef16-88f7-4014-a9f3-5b43a6b252dc req-e62d277f-9577-4d6d-aa1a-5a3df634852c service nova] Lock "9963614d-458a-4521-94a8-8b6811efa9d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:06:39 user nova-compute[71557]: DEBUG nova.compute.manager [req-bb17ef16-88f7-4014-a9f3-5b43a6b252dc req-e62d277f-9577-4d6d-aa1a-5a3df634852c service nova] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] No waiting events found dispatching network-vif-plugged-f73636a3-a1e1-4de0-ad09-375ffb94a996 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:06:39 user nova-compute[71557]: WARNING nova.compute.manager [req-bb17ef16-88f7-4014-a9f3-5b43a6b252dc req-e62d277f-9577-4d6d-aa1a-5a3df634852c service nova] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Received unexpected event network-vif-plugged-f73636a3-a1e1-4de0-ad09-375ffb94a996 for instance with vm_state building and task_state spawning.
Apr 12 11:06:39 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:06:41 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681297601.113354, 9963614d-458a-4521-94a8-8b6811efa9d0 => Resumed> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 11:06:41 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] VM Resumed (Lifecycle Event)
Apr 12 11:06:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Instance event wait completed in 0 seconds for  {{(pid=71557) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 11:06:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Guest created on hypervisor {{(pid=71557) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 11:06:41 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Instance spawned successfully.
Apr 12 11:06:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 11:06:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 11:06:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 11:06:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Found default for hw_cdrom_bus of ide {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 11:06:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Found default for hw_disk_bus of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 11:06:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Found default for hw_input_bus of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 11:06:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Found default for hw_pointer_model of None {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 11:06:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Found default for hw_video_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 11:06:41 user nova-compute[71557]: DEBUG nova.virt.libvirt.driver [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Found default for hw_vif_model of virtio {{(pid=71557) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 11:06:41 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 11:06:41 user nova-compute[71557]: DEBUG nova.virt.driver [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] Emitting event <LifecycleEvent: 1681297601.115113, 9963614d-458a-4521-94a8-8b6811efa9d0 => Started> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 11:06:41 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] VM Started (Lifecycle Event)
Apr 12 11:06:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 11:06:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71557) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 11:06:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-d37739a5-6ea2-46de-912f-c6014a6f76f8 req-db1b0cba-43da-4a92-81d2-d81ef87f44ea service nova] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Received event network-vif-plugged-f73636a3-a1e1-4de0-ad09-375ffb94a996 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:06:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d37739a5-6ea2-46de-912f-c6014a6f76f8 req-db1b0cba-43da-4a92-81d2-d81ef87f44ea service nova] Acquiring lock "9963614d-458a-4521-94a8-8b6811efa9d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:06:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d37739a5-6ea2-46de-912f-c6014a6f76f8 req-db1b0cba-43da-4a92-81d2-d81ef87f44ea service nova] Lock "9963614d-458a-4521-94a8-8b6811efa9d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:06:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d37739a5-6ea2-46de-912f-c6014a6f76f8 req-db1b0cba-43da-4a92-81d2-d81ef87f44ea service nova] Lock "9963614d-458a-4521-94a8-8b6811efa9d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:06:41 user nova-compute[71557]: DEBUG nova.compute.manager [req-d37739a5-6ea2-46de-912f-c6014a6f76f8 req-db1b0cba-43da-4a92-81d2-d81ef87f44ea service nova] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] No waiting events found dispatching network-vif-plugged-f73636a3-a1e1-4de0-ad09-375ffb94a996 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:06:41 user nova-compute[71557]: WARNING nova.compute.manager [req-d37739a5-6ea2-46de-912f-c6014a6f76f8 req-db1b0cba-43da-4a92-81d2-d81ef87f44ea service nova] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Received unexpected event network-vif-plugged-f73636a3-a1e1-4de0-ad09-375ffb94a996 for instance with vm_state building and task_state spawning.
Apr 12 11:06:41 user nova-compute[71557]: INFO nova.compute.manager [None req-5a154f3d-312d-4bd7-9897-422222416d5a None None] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 11:06:41 user nova-compute[71557]: INFO nova.compute.manager [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Took 5.57 seconds to spawn the instance on the hypervisor.
Apr 12 11:06:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 11:06:41 user nova-compute[71557]: INFO nova.compute.manager [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Took 6.06 seconds to build instance.
Apr 12 11:06:41 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-5fa1fa68-99d9-475b-9ad6-91f4dfb4acd3 tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9963614d-458a-4521-94a8-8b6811efa9d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.151s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:06:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:06:44 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:06:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:06:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:06:44 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:06:44 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 11:06:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9963614d-458a-4521-94a8-8b6811efa9d0/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:06:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9963614d-458a-4521-94a8-8b6811efa9d0/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:06:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9963614d-458a-4521-94a8-8b6811efa9d0/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:06:44 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9963614d-458a-4521-94a8-8b6811efa9d0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:06:45 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:06:45 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:06:45 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=8821MB free_disk=26.167774200439453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 11:06:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:06:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:06:45 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 9963614d-458a-4521-94a8-8b6811efa9d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 11:06:45 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 11:06:45 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 11:06:45 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 11:06:45 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 11:06:45 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 11:06:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:06:46 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:06:46 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:06:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:06:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:06:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:06:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:06:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:06:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:06:48 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:06:48 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:06:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 11:06:48 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Rebuilding the list of instances to heal {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 11:06:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-9963614d-458a-4521-94a8-8b6811efa9d0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 11:06:48 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-9963614d-458a-4521-94a8-8b6811efa9d0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 11:06:48 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 11:06:48 user nova-compute[71557]: DEBUG nova.objects.instance [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lazy-loading 'info_cache' on Instance uuid 9963614d-458a-4521-94a8-8b6811efa9d0 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:06:49 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Updating instance_info_cache with network_info: [{"id": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "address": "fa:16:3e:b3:a4:82", "network": {"id": "c4caf2aa-9cd4-49ef-87c6-26505451e622", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1236912207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "80171401e13a447f9410c3a2bd339f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73636a3-a1", "ovs_interfaceid": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:06:49 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-9963614d-458a-4521-94a8-8b6811efa9d0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 11:06:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 11:06:49 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:06:49 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:06:49 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:06:49 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Cleaning up deleted instances with incomplete migration  {{(pid=71557) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 11:06:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:06:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:06:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:06:59 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:06:59 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Cleaning up deleted instances {{(pid=71557) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 11:06:59 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] There are 0 instances to clean {{(pid=71557) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 11:06:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:07:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:07:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:07:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:07:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:07:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:07:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:07:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:07:09 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:07:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:07:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:07:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:07:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:07:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:07:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:07:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:07:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:07:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:07:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:07:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:07:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:07:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:07:24 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:07:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:07:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:07:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:07:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:07:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:07:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:07:32 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:07:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:07:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:07:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:07:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:07:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:07:37 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:07:40 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:07:40 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:07:40 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 11:07:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:07:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:07:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:07:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:07:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:07:42 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:07:45 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:07:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:07:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:07:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:07:45 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 11:07:45 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9963614d-458a-4521-94a8-8b6811efa9d0/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:07:45 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9963614d-458a-4521-94a8-8b6811efa9d0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:07:45 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9963614d-458a-4521-94a8-8b6811efa9d0/disk --force-share --output=json {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 11:07:45 user nova-compute[71557]: DEBUG oslo_concurrency.processutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9963614d-458a-4521-94a8-8b6811efa9d0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71557) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 11:07:46 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:07:46 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:07:46 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=8781MB free_disk=26.14883041381836GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 11:07:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:07:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:07:46 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Instance 9963614d-458a-4521-94a8-8b6811efa9d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71557) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 11:07:46 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 11:07:46 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 11:07:46 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Refreshing inventories for resource provider 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 11:07:46 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Updating ProviderTree inventory for provider 24299bcb-a671-492d-9d13-df83697a8f87 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 11:07:46 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Updating inventory in ProviderTree for provider 24299bcb-a671-492d-9d13-df83697a8f87 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 11:07:46 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Refreshing aggregate associations for resource provider 24299bcb-a671-492d-9d13-df83697a8f87, aggregates: None {{(pid=71557) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 11:07:46 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Refreshing trait associations for resource provider 24299bcb-a671-492d-9d13-df83697a8f87, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=71557) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 11:07:46 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 11:07:46 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 11:07:46 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 11:07:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.323s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:07:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:07:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:07:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:07:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:07:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:07:47 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:07:48 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:07:48 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:07:48 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:07:50 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:07:50 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:07:50 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 11:07:50 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Rebuilding the list of instances to heal {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 11:07:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "refresh_cache-9963614d-458a-4521-94a8-8b6811efa9d0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 11:07:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquired lock "refresh_cache-9963614d-458a-4521-94a8-8b6811efa9d0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 11:07:50 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Forcefully refreshing network info cache for instance {{(pid=71557) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 11:07:50 user nova-compute[71557]: DEBUG nova.objects.instance [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lazy-loading 'info_cache' on Instance uuid 9963614d-458a-4521-94a8-8b6811efa9d0 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:07:50 user nova-compute[71557]: DEBUG nova.network.neutron [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Updating instance_info_cache with network_info: [{"id": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "address": "fa:16:3e:b3:a4:82", "network": {"id": "c4caf2aa-9cd4-49ef-87c6-26505451e622", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1236912207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "80171401e13a447f9410c3a2bd339f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73636a3-a1", "ovs_interfaceid": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:07:50 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Releasing lock "refresh_cache-9963614d-458a-4521-94a8-8b6811efa9d0" {{(pid=71557) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 11:07:50 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Updated the network info_cache for instance {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 11:07:50 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:07:52 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:07:54 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:07:55 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:07:57 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:07:59 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:08:02 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:08:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:08:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:08:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:08:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:08:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:08:07 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:08:12 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:08:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:08:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:08:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:08:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:08:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:08:17 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:08:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:08:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:08:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:08:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:08:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:08:22 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:08:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:08:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:08:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:08:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:08:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:08:27 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Acquiring lock "9963614d-458a-4521-94a8-8b6811efa9d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9963614d-458a-4521-94a8-8b6811efa9d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Acquiring lock "9963614d-458a-4521-94a8-8b6811efa9d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9963614d-458a-4521-94a8-8b6811efa9d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9963614d-458a-4521-94a8-8b6811efa9d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:08:30 user nova-compute[71557]: INFO nova.compute.manager [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Terminating instance
Apr 12 11:08:30 user nova-compute[71557]: DEBUG nova.compute.manager [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Start destroying the instance on the hypervisor. {{(pid=71557) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:08:30 user nova-compute[71557]: INFO nova.virt.libvirt.driver [-] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Instance destroyed successfully.
Apr 12 11:08:30 user nova-compute[71557]: DEBUG nova.objects.instance [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lazy-loading 'resources' on Instance uuid 9963614d-458a-4521-94a8-8b6811efa9d0 {{(pid=71557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG nova.virt.libvirt.vif [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T11:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1573222300',display_name='tempest-VolumesActionsTest-instance-1573222300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1573222300',id=47,image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T11:06:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80171401e13a447f9410c3a2bd339f59',ramdisk_id='',reservation_id='r-el2w6730',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3dd4c04b-7ffb-4200-9900-d3e99c6da7a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-838117246',owner_user_name='tempest-VolumesActionsTest-838117246-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T11:06:41Z,user_data=None,user_id='f0c5b108917440ad862967ea398c6ee1',uuid=9963614d-458a-4521-94a8-8b6811efa9d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "address": "fa:16:3e:b3:a4:82", "network": {"id": "c4caf2aa-9cd4-49ef-87c6-26505451e622", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1236912207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "80171401e13a447f9410c3a2bd339f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73636a3-a1", "ovs_interfaceid": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Converting VIF {"id": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "address": "fa:16:3e:b3:a4:82", "network": {"id": "c4caf2aa-9cd4-49ef-87c6-26505451e622", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1236912207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "80171401e13a447f9410c3a2bd339f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73636a3-a1", "ovs_interfaceid": "f73636a3-a1e1-4de0-ad09-375ffb94a996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG nova.network.os_vif_util [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:a4:82,bridge_name='br-int',has_traffic_filtering=True,id=f73636a3-a1e1-4de0-ad09-375ffb94a996,network=Network(c4caf2aa-9cd4-49ef-87c6-26505451e622),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf73636a3-a1') {{(pid=71557) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG os_vif [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:a4:82,bridge_name='br-int',has_traffic_filtering=True,id=f73636a3-a1e1-4de0-ad09-375ffb94a996,network=Network(c4caf2aa-9cd4-49ef-87c6-26505451e622),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf73636a3-a1') {{(pid=71557) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf73636a3-a1, bridge=br-int, if_exists=True) {{(pid=71557) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:08:30 user nova-compute[71557]: INFO os_vif [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:a4:82,bridge_name='br-int',has_traffic_filtering=True,id=f73636a3-a1e1-4de0-ad09-375ffb94a996,network=Network(c4caf2aa-9cd4-49ef-87c6-26505451e622),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf73636a3-a1')
Apr 12 11:08:30 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Deleting instance files /opt/stack/data/nova/instances/9963614d-458a-4521-94a8-8b6811efa9d0_del
Apr 12 11:08:30 user nova-compute[71557]: INFO nova.virt.libvirt.driver [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Deletion of /opt/stack/data/nova/instances/9963614d-458a-4521-94a8-8b6811efa9d0_del complete
Apr 12 11:08:30 user nova-compute[71557]: DEBUG nova.compute.manager [req-fdc69ca9-05b2-47a4-bccf-dc2528e863db req-5b209179-de8c-470d-8eb2-2c33bea46fb5 service nova] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Received event network-vif-unplugged-f73636a3-a1e1-4de0-ad09-375ffb94a996 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fdc69ca9-05b2-47a4-bccf-dc2528e863db req-5b209179-de8c-470d-8eb2-2c33bea46fb5 service nova] Acquiring lock "9963614d-458a-4521-94a8-8b6811efa9d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fdc69ca9-05b2-47a4-bccf-dc2528e863db req-5b209179-de8c-470d-8eb2-2c33bea46fb5 service nova] Lock "9963614d-458a-4521-94a8-8b6811efa9d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-fdc69ca9-05b2-47a4-bccf-dc2528e863db req-5b209179-de8c-470d-8eb2-2c33bea46fb5 service nova] Lock "9963614d-458a-4521-94a8-8b6811efa9d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG nova.compute.manager [req-fdc69ca9-05b2-47a4-bccf-dc2528e863db req-5b209179-de8c-470d-8eb2-2c33bea46fb5 service nova] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] No waiting events found dispatching network-vif-unplugged-f73636a3-a1e1-4de0-ad09-375ffb94a996 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG nova.compute.manager [req-fdc69ca9-05b2-47a4-bccf-dc2528e863db req-5b209179-de8c-470d-8eb2-2c33bea46fb5 service nova] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Received event network-vif-unplugged-f73636a3-a1e1-4de0-ad09-375ffb94a996 for instance with task_state deleting. {{(pid=71557) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 11:08:30 user nova-compute[71557]: INFO nova.compute.manager [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 12 11:08:30 user nova-compute[71557]: DEBUG oslo.service.loopingcall [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71557) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG nova.compute.manager [-] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Deallocating network for instance {{(pid=71557) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] deallocate_for_instance() {{(pid=71557) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 11:08:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:08:31 user nova-compute[71557]: DEBUG nova.network.neutron [-] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Updating instance_info_cache with network_info: [] {{(pid=71557) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 11:08:31 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Took 0.49 seconds to deallocate network for instance.
Apr 12 11:08:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:08:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:08:31 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 11:08:31 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 11:08:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:08:31 user nova-compute[71557]: INFO nova.scheduler.client.report [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Deleted allocations for instance 9963614d-458a-4521-94a8-8b6811efa9d0
Apr 12 11:08:31 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-2de2a97f-3070-4c62-8a33-59e9da8cd43e tempest-VolumesActionsTest-838117246 tempest-VolumesActionsTest-838117246-project-member] Lock "9963614d-458a-4521-94a8-8b6811efa9d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.476s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:08:32 user nova-compute[71557]: DEBUG nova.compute.manager [req-d47eea1e-59d4-419e-8028-27fd509cfe57 req-20bf4e28-9675-4f39-a3aa-29a3bb58ffe3 service nova] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Received event network-vif-plugged-f73636a3-a1e1-4de0-ad09-375ffb94a996 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:08:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d47eea1e-59d4-419e-8028-27fd509cfe57 req-20bf4e28-9675-4f39-a3aa-29a3bb58ffe3 service nova] Acquiring lock "9963614d-458a-4521-94a8-8b6811efa9d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:08:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d47eea1e-59d4-419e-8028-27fd509cfe57 req-20bf4e28-9675-4f39-a3aa-29a3bb58ffe3 service nova] Lock "9963614d-458a-4521-94a8-8b6811efa9d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:08:32 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [req-d47eea1e-59d4-419e-8028-27fd509cfe57 req-20bf4e28-9675-4f39-a3aa-29a3bb58ffe3 service nova] Lock "9963614d-458a-4521-94a8-8b6811efa9d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:08:32 user nova-compute[71557]: DEBUG nova.compute.manager [req-d47eea1e-59d4-419e-8028-27fd509cfe57 req-20bf4e28-9675-4f39-a3aa-29a3bb58ffe3 service nova] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] No waiting events found dispatching network-vif-plugged-f73636a3-a1e1-4de0-ad09-375ffb94a996 {{(pid=71557) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 11:08:32 user nova-compute[71557]: WARNING nova.compute.manager [req-d47eea1e-59d4-419e-8028-27fd509cfe57 req-20bf4e28-9675-4f39-a3aa-29a3bb58ffe3 service nova] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Received unexpected event network-vif-plugged-f73636a3-a1e1-4de0-ad09-375ffb94a996 for instance with vm_state deleted and task_state None.
Apr 12 11:08:32 user nova-compute[71557]: DEBUG nova.compute.manager [req-d47eea1e-59d4-419e-8028-27fd509cfe57 req-20bf4e28-9675-4f39-a3aa-29a3bb58ffe3 service nova] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Received event network-vif-deleted-f73636a3-a1e1-4de0-ad09-375ffb94a996 {{(pid=71557) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 11:08:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:08:40 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:08:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:08:41 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:08:41 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 11:08:45 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:08:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:08:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:08:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:08:45 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 11:08:45 user nova-compute[71557]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681297710.683594, 9963614d-458a-4521-94a8-8b6811efa9d0 => Stopped> {{(pid=71557) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 11:08:45 user nova-compute[71557]: INFO nova.compute.manager [-] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] VM Stopped (Lifecycle Event)
Apr 12 11:08:45 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:08:45 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:08:45 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=8882MB free_disk=26.16643524169922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 11:08:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:08:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:08:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:08:45 user nova-compute[71557]: DEBUG nova.compute.manager [None req-e18358fb-9f5a-4d3b-b78e-a410caa20cd5 None None] [instance: 9963614d-458a-4521-94a8-8b6811efa9d0] Checking state {{(pid=71557) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 11:08:45 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 11:08:45 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 11:08:45 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 11:08:45 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 11:08:45 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 11:08:45 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:08:49 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:08:49 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:08:50 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:08:50 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:08:50 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 11:08:50 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Rebuilding the list of instances to heal {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 11:08:50 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Didn't find any instances for network info cache update. {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 11:08:50 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:08:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:08:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:08:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:08:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:08:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:08:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:08:51 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:08:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:09:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:09:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:09:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:09:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:09:20 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:09:25 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:09:30 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:09:35 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:09:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:09:40 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:09:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:09:40 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:09:43 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:09:43 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71557) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 11:09:45 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:09:46 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager.update_available_resource {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:09:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:09:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:09:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:09:46 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Auditing locally available compute resources for user (node: user) {{(pid=71557) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 11:09:46 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:09:46 user nova-compute[71557]: WARNING nova.virt.libvirt.driver [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 11:09:46 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Hypervisor/Node resource view: name=user free_ram=8887MB free_disk=26.164592742919922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71557) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 11:09:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 11:09:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 11:09:46 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 11:09:46 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71557) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 11:09:46 user nova-compute[71557]: DEBUG nova.compute.provider_tree [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed in ProviderTree for provider: 24299bcb-a671-492d-9d13-df83697a8f87 {{(pid=71557) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 11:09:46 user nova-compute[71557]: DEBUG nova.scheduler.client.report [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Inventory has not changed for provider 24299bcb-a671-492d-9d13-df83697a8f87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71557) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 11:09:46 user nova-compute[71557]: DEBUG nova.compute.resource_tracker [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Compute_service record updated for user:user {{(pid=71557) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 11:09:46 user nova-compute[71557]: DEBUG oslo_concurrency.lockutils [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=71557) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 11:09:50 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:09:50 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:09:50 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Starting heal instance info cache {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 11:09:50 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Rebuilding the list of instances to heal {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 11:09:50 user nova-compute[71557]: DEBUG nova.compute.manager [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Didn't find any instances for network info cache update. {{(pid=71557) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 11:09:50 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:09:50 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:09:51 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:09:52 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:09:52 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:09:55 user nova-compute[71557]: DEBUG oslo_service.periodic_task [None req-f7b8833a-77a0-4024-bde9-5857488c9bba None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71557) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 11:09:55 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:10:00 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:10:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:10:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 11:10:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71557) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 11:10:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:10:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71557) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 11:10:05 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:10:10 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 11:10:15 user nova-compute[71557]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71557) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}